SDET

Responsibilities:
Define and own the end-to-end test strategy for all initiatives, from feature-level acceptance criteria through system and regression testing.
Establish quality gates, test coverage standards, and release readiness criteria across the engineering organization.
Champion a shift-left testing culture by embedding quality practices early in the product development lifecycle.
Design, build, and maintain scalable test automation frameworks for UI, API, and data layers.
Develop automated regression and smoke test suites integrated into CI/CD pipelines such as GitHub Actions, Azure DevOps, or similar tools.
Implement performance and load testing to validate system behavior at scale.
Validate embedding models and vector search pipelines using semantic similarity, recall@k, precision metrics, and tools such as RAGAS, DeepEval, or custom harnesses.
Build regression suites for LLM-powered features to detect prompt regressions, hallucination patterns, and output drift across model versions.
Collaborate with AI/ML engineers to define ground-truth datasets, golden datasets, and human-in-the-loop evaluation workflows.
Test multi-modal and agentic AI systems for correctness, safety, and performance.
Partner with product managers, software engineers, and data scientists to review requirements and identify testable acceptance criteria early.
Participate in sprint planning and retrospectives, representing quality and risk perspectives.
Report test results, defect trends, and quality metrics to engineering leadership with actionable insights.
Requirements:
6+ years of individual contributor experience in software QA and test automation roles.
Demonstrated track record of building and maintaining automation frameworks using Playwright, Selenium, Cypress, or pytest.
Hands-on experience testing AI/ML systems, particularly RAG pipelines, LLM outputs, embeddings, or semantic search.
Proficiency in Python and/or JavaScript/TypeScript for framework and tooling development.
Experience integrating automated tests into CI/CD pipelines.
Most recent experience at a technology or product-led company.
Bachelor's or master's degree in computer science, software engineering, or a related field from a Tier 1 or Tier 2 institute.

Skills
Quality Assurance, SDET, Automation Testing, Playwright, Cypress, Python, JavaScript, Selenium, Generative AI, Agentic AI

Experience
5-8 yrs