Live opening · Posted 2 days ago
At a glance
The key details from the original listing.
Your early-applicant advantage
Live timing from JobBeeper.
About the role
Description supplied by the original job listing.
We are seeking an experienced AI and Mobile Test Automation Engineer to drive quality engineering initiatives across mobile applications, APIs, and AI-powered products. The ideal candidate should possess strong expertise in mobile automation, API testing using Rest Assured, and modern AI testing methodologies.
This role combines traditional QA automation with next-generation AI testing practices to ensure reliability, scalability, and accuracy of intelligent applications.
The candidate will have responsibilities across the following functions:
Mobile Test Automation:
Design, develop, and maintain automated test frameworks for Android and iOS applications.
Create robust end-to-end mobile automation suites.
Perform functional, regression, integration, and smoke testing.
Validate mobile application performance, usability, and compatibility across devices.
Execute cross-platform testing and device coverage strategies.
API Test Automation:
Develop and maintain API automation frameworks using Rest Assured.
Validate RESTful services, microservices, and backend integrations.
Design automated API regression suites.
Perform contract testing and service validation.
Integrate API automation into CI/CD pipelines.
AI Testing and Quality Engineering:
Test AI-powered applications, chatbots, copilots, and LLM-based systems.
Validate AI response accuracy, consistency, relevance, and safety.
Design prompt validation and AI evaluation test scenarios.
Create test datasets and benchmarking frameworks for GenAI applications.
Verify RAG-based systems and AI agent workflows.
Monitor AI quality metrics and identify model-related defects.
Quality Engineering:
Collaborate with Product Managers, Developers, and AI Engineers.
Define test strategies and quality gates.
Drive automation-first testing practices.
Participate in Agile ceremonies and release planning.
Ensure high-quality software delivery through continuous testing.
Requirements:
Experience testing OpenAI, Gemini, Claude, or other LLM-based applications.
Knowledge of LangChain, LangGraph, CrewAI, or Agentic AI systems.
Experience with performance testing tools such as JMeter.
Exposure to cloud platforms (AWS, Azure, GCP).
Knowledge of AI observability and evaluation frameworks.
Experience in telecom, fintech, e-commerce, or digital products.
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field.
Mandatory Skills:
API Automation: Rest Assured, Postman, API Validation, JSON/XML Parsing, Microservices Testing.
Programming: Java, Selenium WebDriver, TestNG / JUnit, Maven / Gradle.
AI Testing: Generative AI Testing, LLM Validation, Prompt Testing, AI Response Evaluation, RAG Testing, Chatbot Testing.
CI/CD and DevOps: Jenkins, GitHub Actions, GitLab CI/CD, Docker (Good to Have).
Test Management: JIRA, Confluence, Test Planning and Reporting, Defect Lifecycle Management.
Key Competencies:
Strong analytical and debugging skills.
Automation-first mindset.
Understanding of AI quality and evaluation methodologies.
Excellent communication and stakeholder management.
Ability to work in fast-paced Agile environments.
Expectations:
Automation coverage across mobile and API layers.
Reduction in production defects.
AI response quality and validation effectiveness.
Test execution efficiency and release readiness.
Continuous improvement of QA automation frameworks.
Experience
5-8 yrs
More openings worth a look
Recently tracked roles with full details and direct application links.