AI FIRST – Senior Software Development Engineer in Test (India/Sri Lanka – Remote)

Full Time
India, Srilanka
Posted 2 weeks ago

Contract Type: Full-Time Contract (40 hrs/week – long-term engagement)

Location: Remote – Tamil Nadu, Karnataka, Pondicherry (India) + Sri Lanka (Colombo)

Role Overview

We’re looking for a Senior SDET to take ownership of quality strategy and test engineering across our AI-powered products. In this role, you’ll architect scalable automation frameworks, define quality standards, and actively shape how AI transforms our testing practices. You’ll be a technical authority on quality — mentoring peers, collaborating closely with engineering and product, and driving a culture where quality is built in, not bolted on. 

Key Responsibilities 

Quality & Test Engineering 

  • 4 Years of experience in Automation is a must. 
  • Architect and own end-to-end test automation frameworks covering UI, API, integration, and performance testing. 
  • Define test strategies and quality standards for complex, cross-functional features and services. 
  • Design and maintain scalable, maintainable test infrastructure, including containerized environments using Docker. 
  • Build and optimize CI/CD pipelines for test execution, ensuring fast and reliable feedback loops. 
  • Lead performance and load testing using tools like JMeter, k6, or Locust; analyze results and drive improvements. 
  • Conduct thorough test design reviews and code reviews for automation code produced by the team. 
  • Work closely with engineering leads to embed quality at the design and architecture stage. 
  • Operate within an Agile delivery model; drive quality metrics, coverage reporting, and sprint-level test governance. 
  • Mentor junior and mid-level SDETs; share knowledge and elevate the team’s automation maturity. 

AI-Augmented Testing 

  • Lead the integration of AI-powered testing tools into the team’s quality stack (e.g., AI-based test generation, visual testing, self-healing tests). 
  • Design frameworks for testing LLM-powered features — including prompt validation, output quality checks, and regression testing for AI responses. 
  • Build evaluation harnesses to benchmark and monitor GenAI model behavior in production. 
  • Develop strategies for testing non-deterministic AI outputs — defining acceptable variance, edge cases, and failure modes. 
  • Champion the use of GenAI tools to accelerate test authoring, coverage analysis, and defect triage. 

Candidate Requirements 

  • 5–7 years of experience in SDET or test automation engineering roles. 
  • Strong expertise in automation frameworks: Playwright, Selenium, Cypress, Pytest, or similar. 
  • Proficiency in Python, JavaScript, or Java; able to write production-quality automation code. 
  • Deep experience with API testing, performance testing, and integration testing at scale. 
  • Strong understanding of CI/CD pipelines and experience integrating tests into automated delivery workflows. 
  • Solid knowledge of Docker and containerized test environments. 
  • Proven ability to define and implement test strategies across complex product areas. 
  • Experience mentoring engineers and conducting automation code reviews. 
  • Familiarity with AWS or other cloud platforms for test infrastructure. 

Good to Have 

  • Experience testing LLM-powered features or AI-generated outputs. 
  • Familiarity with AI/ML testing concepts: model evaluation, hallucination detection, output validation. 
  • Exposure to chaos engineering or reliability testing practices. 
  • Experience with observability tools (Datadog, Grafana, or similar) for quality monitoring. 
  • Background in security testing or accessibility testing. 

ID: P14

Job Features

Job CategoryBackend Engineer, Technical Leadership

Apply For This Job

A valid phone number is required.