Python Engineer - WFH

About Turing
Turing is one of the world's leading AGI infrastructure companies. It works with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent.
About the Role
Turing is seeking a detail-oriented engineer with strong judgment, hands-on experience with preference data, and a solid understanding of rubric creation and evaluation criteria. This role combines technical implementation with careful data review, helping ensure that training and evaluation examples meet a high standard of quality.
You will work in a fast-moving environment where requirements may be ambiguous and priorities can evolve quickly. The role calls for someone who can distinguish strong examples from weaker ones, identify subtle quality issues, and explain their decisions clearly. You will also help turn qualitative judgments into repeatable workflows that support AI model development at scale.
Clear communication and practical execution are central to the position. You should be comfortable synthesizing complex technical work into concise, structured updates and recommendations that researchers and engineers can act on.
Key Responsibilities
• Design, refine, and iterate on rubrics and evaluation criteria used for preference data.
• Review and label data carefully, identifying subtle quality issues and maintaining high standards for accuracy and consistency.
• Build and maintain pipelines and infrastructure that support data generation, collection, and evaluation workflows.
• Analyze findings from data-related work and communicate results through clear write-ups, updates, and recommendations.
• Collaborate with researchers and engineers to translate qualitative judgments into scalable, repeatable processes.
• Contribute to improving the quality and reliability of data workflows supporting AI model development and evaluation.
• Work efficiently in an evolving environment, balancing careful judgment with timely execution.
Required Qualifications
• Proficiency in Python, particularly for building and maintaining pipelines and infrastructure, or proficiency in TypeScript.
• For TypeScript-focused candidates, experience contributing to or navigating large codebases, such as VSCode, is an advantage.
• Hands-on experience with preference data collection, rubric creation, or both.
• Strong written and verbal communication skills, with the ability to turn complex technical work into concise, structured, actionable summaries.
• Strong evaluative judgment and the ability to explain why an example or result meets a quality standard, rather than simply labeling it as good or bad.
• Attention to detail when reviewing data, assessing examples, and identifying quality issues.
• Ability to work independently in a fast-moving environment and make progress when requirements are not fully defined.
Freelance Opportunity and Benefits
• Fully remote work arrangement.
• Opportunity to contribute to cutting-edge AI projects with leading large language model (LLM) companies.
• Independent contractor engagement; medical coverage and paid leave benefits are not included.
Engagement Details
The initial contract is for three months, with an expected start as soon as possible. Turing prefers candidates who can commit to 40 hours per week and maintain at least six hours of overlap with Pacific Time. Candidates who cannot commit to full-time availability should specify their available weekly hours and preferred overlap window.
Compensation is at market rate. Candidates should provide a specific rate expectation rather than a range so both parties can assess fit efficiently.
Evaluation Process
The selection process consists of one interview lasting approximately 30 minutes, covering technical skills and cultural fit.

Work arrangement
Yes