AI Quality Analyst

Company Description Riafy Technologies is a product innovation company that collaborates closely with global partners to design, build, and scale impactful digital solutions. Its consumer apps are trusted by over 100 million users in 160 countries and 23 languages, and have been repeatedly recognized by Google for quality and innovation. Riafy’s proprietary Generative AI platform, R10, helps enterprises deploy production-ready AI agents that automate complex operations and deliver highly personalized customer experiences at scale. R10 is live across major sectors including banking, aviation, automotive, telecom, healthcare, beauty & FMCG, and manufacturing, and is featured as a Google Cloud case study. Riafy fosters an inclusive, diverse, and growth-oriented culture and was honored with the Google Partner Award 2023 for DEI (APAC).
Role Description The AI Quality Analyst role at Riafy Technologies is a full-time, on-site position based in Kochi. This role involves evaluating AI outputs for accuracy, relevance, bias, and consistency, and documenting findings to improve model performance and user experience. The AI Quality Analyst will design and execute test plans, develop quality benchmarks, and collaborate with product, engineering, and data science teams to refine AI behavior. Day-to-day tasks include reviewing large volumes of AI responses, identifying patterns and edge cases, suggesting improvements to prompts and workflows, and maintaining detailed quality reports and dashboards. The role also includes contributing to process documentation, supporting incident analysis, and helping shape best practices for enterprise-grade AI quality.
Qualifications
Strong analytical skills to interpret data, evaluate AI outputs, and identify trends and anomalies.
Proficiency in quality assurance and quality control practices, including test design, execution, and reporting.
Experience with quality management principles, process improvement, and maintaining consistent standards.
Effective communication skills for clear documentation, cross-functional collaboration, and stakeholder updates.
Bachelor’s degree in engineering, computer science, statistics, or a related field, or equivalent practical experience.
Familiarity with AI/ML concepts, large language models, or enterprise software testing is highly beneficial.
Comfort working with structured and unstructured data, and using basic analytical or visualization tools.
Attention to detail, ability to work in a fast-paced environment, and a strong commitment to inclusive, ethical AI practices.

Work arrangement
No