QA Reviewer

We're building high-quality training data from real Hindi-English telephone conversations, where speakers switch fluidly between both languages mid-sentence. As an Audio Annotation QA Reviewer, you'll be the quality backbone of the project — reviewing transcripts and annotations produced by our specialist team, ensuring accuracy and consistency, and driving the feedback and calibration that keeps output aligned to our style guidelines. Precision, sound judgment, and a sharp ear for natural conversational speech are at the heart of this work.
Responsibilities
Review & correction — Review verbatim transcripts and structured annotations for accuracy, checking that fillers, false starts, repetitions, and code-switching are captured exactly as spoken and per our style guidelines.
Quality auditing — Audit speaker labeling and audio-event tagging (background noise, crosstalk/overlap, inaudible segments, silence, non-speech sounds) for correctness and consistency across files.
PII compliance checks — Verify that personal information (names, phone numbers, account details, addresses, etc.) has been redacted strictly per our PII handling rules to keep data compliant and secure.
Calibration & feedback — Lead regular calibration sessions and deliver clear, actionable feedback to the annotation team; help resolve edge cases and ambiguous calls consistently.
Guideline stewardship — Help refine and evolve the style guide, and ensure formatting, spelling, and tagging conventions stay consistent as guidelines are updated.
Quality reporting — Track error patterns, accuracy metrics, and throughput quality, flagging recurring issues and surfacing improvements to the team.
Requirements
Bilingual fluency — Native or near-native Hindi and strong English proficiency; our calls code-switch between both languages mid-sentence, so you must follow and evaluate both effortlessly.
Listening comprehension — Excellent ear for natural, fast, overlapping, conversational telephone speech, including accents, dialectal variation, and imperfect audio quality.
Hinglish conventions — Strong command of typing Hindi in Roman script (Hinglish) and evaluating others' work against our romanization conventions.
Review judgment — Meticulous and accuracy-first, with the consistency to apply guidelines uniformly and the discernment to handle edge cases fairly.
Communication — Ability to give clear, constructive, respectful feedback that helps contributors improve.
Nice to Have
Prior experience in QA review, linguistic QA, transcription, data annotation, or subtitling.
Familiarity with telephony/call-center audio or code-mixed (Hinglish) datasets.
Experience owning or refining style guides / SOPs.
Experience running calibration sessions or managing quality metrics for an annotation team.

Work arrangement
No