Live opening · Posted 5 days ago
AI Tester (AI Quality Engineer)
ThirdEye IT Consulting Services (Pty) Ltd · India (Remote)
JobBeeper subscribers received an alert for this role.
At a glance
The key details from the original listing.
CompanyThirdEye IT Consulting Services (Pty) Ltd
LocationIndia (Remote)
Work modeYes
SkillsPython
Source
Linkedin
ListedPosted 5 days ago
Your early-applicant advantage
Live timing from JobBeeper.
8 min
from Linkedin publishing this role to us finding it
2 min
median time from a role going live to a subscriber being told
6 hours
subscribers had this role before this page existed
64,597
roles found in the last 24 hours — the newest are not on this site yet
About the role
Description supplied by the original job listing.
AI Tester (AI Quality Engineer)
Role Summary
Responsible for validating AI, GenAI, Agentic AI, Chatbot, and Voice AI solutions through functional, non-functional, and model evaluation testing.
Key Responsibilities
Design and execute AI testing strategies and frameworks.
Validate LLM responses, grounding, hallucination control, and citation accuracy.
Perform RAG testing, retrieval accuracy testing, and context validation.
Conduct Evals using RAGAS, DeepEval, LangSmith, and custom evaluation frameworks.
Perform chatbot testing, voice testing, STT/TTS testing, multilingual testing, and conversation-flow validation.
Automate AI testing and integrate into CI/CD pipelines.
Measure latency, relevance, faithfulness, toxicity, safety, and model drift.
Required Skills
AI/GenAI Testing
RAGAS, DeepEval, LangSmith
Functional & Automation Testing
API Testing (Postman, Playwright)
Voice Testing (ASR/TTS)
Prompt Validation
Performance & Security Testing
Python, Test Automation
Experience
5+ years QA/Automation Testing
2+ years AI/GenAI Testing
Work arrangement
Yes
More openings worth a look
Recently tracked roles with full details and direct application links.
Senior Telecom Architect – Roaming, Messaging & Signalling
Senior Cloud & Identity Security Architect
Senior Software Developer (Python, Azure & Generative AI)
Digital Solution Architect
Data Scientist(Machine Learning | Customer Analytics | Financial Services)
Azure Power Apps Administrator / Developer
Good roles move before most people even see them.
Tell JobBeeper what you want and get fresh matches delivered in minutes.
Start your free trial →