AI FIRST – Senior Software Development Engineer in Test (India/Sri Lanka – Remote)
Full Time
India, Srilanka
Posted 2 weeks ago
Contract Type: Full-Time Contract (40 hrs/week – long-term engagement)
Location: Remote – Tamil Nadu, Karnataka, Pondicherry (India) + Sri Lanka (Colombo)
Role Overview
We’re looking for a Senior SDET to take ownership of quality strategy and test engineering across our AI-powered products. In this role, you’ll architect scalable automation frameworks, define quality standards, and actively shape how AI transforms our testing practices. You’ll be a technical authority on quality — mentoring peers, collaborating closely with engineering and product, and driving a culture where quality is built in, not bolted on.
Key Responsibilities
Quality & Test Engineering
- 4 Years of experience in Automation is a must.
- Architect and own end-to-end test automation frameworks covering UI, API, integration, and performance testing.
- Define test strategies and quality standards for complex, cross-functional features and services.
- Design and maintain scalable, maintainable test infrastructure, including containerized environments using Docker.
- Build and optimize CI/CD pipelines for test execution, ensuring fast and reliable feedback loops.
- Lead performance and load testing using tools like JMeter, k6, or Locust; analyze results and drive improvements.
- Conduct thorough test design reviews and code reviews for automation code produced by the team.
- Work closely with engineering leads to embed quality at the design and architecture stage.
- Operate within an Agile delivery model; drive quality metrics, coverage reporting, and sprint-level test governance.
- Mentor junior and mid-level SDETs; share knowledge and elevate the team’s automation maturity.
AI-Augmented Testing
- Lead the integration of AI-powered testing tools into the team’s quality stack (e.g., AI-based test generation, visual testing, self-healing tests).
- Design frameworks for testing LLM-powered features — including prompt validation, output quality checks, and regression testing for AI responses.
- Build evaluation harnesses to benchmark and monitor GenAI model behavior in production.
- Develop strategies for testing non-deterministic AI outputs — defining acceptable variance, edge cases, and failure modes.
- Champion the use of GenAI tools to accelerate test authoring, coverage analysis, and defect triage.
Candidate Requirements
- 5–7 years of experience in SDET or test automation engineering roles.
- Strong expertise in automation frameworks: Playwright, Selenium, Cypress, Pytest, or similar.
- Proficiency in Python, JavaScript, or Java; able to write production-quality automation code.
- Deep experience with API testing, performance testing, and integration testing at scale.
- Strong understanding of CI/CD pipelines and experience integrating tests into automated delivery workflows.
- Solid knowledge of Docker and containerized test environments.
- Proven ability to define and implement test strategies across complex product areas.
- Experience mentoring engineers and conducting automation code reviews.
- Familiarity with AWS or other cloud platforms for test infrastructure.
Good to Have
- Experience testing LLM-powered features or AI-generated outputs.
- Familiarity with AI/ML testing concepts: model evaluation, hallucination detection, output validation.
- Exposure to chaos engineering or reliability testing practices.
- Experience with observability tools (Datadog, Grafana, or similar) for quality monitoring.
- Background in security testing or accessibility testing.
ID: P14
Job Features
| Job Category | Backend Engineer, Technical Leadership |