AI Response Quality Evaluator

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Response Quality Evaluator based in Australia.
As an AI Response Quality Evaluator, you’ll help improve the quality and usefulness of AI-generated responses by assessing how well they understand and respond to personalized user context.
You’ll review responses generated from personalized prompts and information retrieved through connected Google applications.
Your work will focus on relevance, accuracy, contextual understanding, personalization, and the overall quality of the user experience.
You’ll identify subtle issues such as incorrect assumptions, irrelevant recommendations, inconsistencies, and inappropriate personalization.
The role requires careful analysis and strong written communication to turn observations into clear, actionable feedback for AI model improvement.
You’ll work independently in a remote environment while following detailed evaluation guidelines and maintaining strict confidentiality.
This is a project-based opportunity for someone who enjoys analyzing nuanced AI outputs and contributing to the development of more helpful and context-aware AI systems.

Employment type
Contract

Work arrangement
Yes