Live opening · Posted 1 day ago
At a glance
The key details from the original listing.
Your early-applicant advantage
Live timing from JobBeeper.
About the role
Description supplied by the original job listing.
Responsibilities:
Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD pipelines.
Review testing strategies, approaches, and test plans, and provide insight to development teams.
Architect, design, and build software to automate a variety of testing methods (e. g. API validation, performance/load testing, fuzzing, etc. )
Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs.
Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability.
Work as part of a team of highly skilled software professionals.
Continuously learn and expand your technical horizons.
Our Technology Stack: Selenium, Playwright, Docker, Kubernetes, AWS (Bedrock, Lambda, SQS, S3 etc. ), LangChain, LLM evaluation frameworks (e. g., Ragas), OpenAPI, Postgres, Linux.
Requirements:
Excited to work at the intersection of AIML, Big Data, and the Cybersecurity problem space.
Have 5+ years of experience shipping quality software.
Love driving high software quality.
Have experience deploying services on cloud computing platforms (e. g., AWS, Azure, GCP).
An expert using common tools for executing functional, load, and fuzz testing (e. g. Locust, CATS).
Have worked on distributed systems and microservices architecture (preferred).
Additional notes:
Functional and Non-functional Testing.
Functional: test planning, UI, and API manual testing
Non-functional: Understanding or hands-on experience with performance testing tools such as Locust, JMeter, or any similar tool.
Experience in Automation (UI and API).
UI Automation: identifying locators, writing scripts, and automating test scenarios.
API Automation: using RestAssured or any similar framework to automate APIs.
Skills like MCP, AI exposure, or any other relevant competencies listed in the JD would also be valuable.
Experience
5-8 yrs
More openings worth a look
Recently tracked roles with full details and direct application links.