Software, ML & Data Engineers – AI Code Evaluation (Remote, US · Contract)

About the opportunity
We’re partnering with a leading AI training company that works with frontier AI labs to build and evaluate the next generation of large language models. They’re looking for experienced software, machine learning and data engineers to review, test and improve AI-generated code. Your engineering judgment becomes the standard these models are measured against.
This is a remote, part-time contract role for professionals based in the United States.
What you’ll do
Review and evaluate AI-generated code for correctness, quality, design and security
Audit coding benchmark tasks: reference solutions, test suites, Docker environments and grading integrity
Evaluate end-to-end coding sessions produced by AI coding agents and assess their reasoning and workflow
Design challenging, realistic engineering problems from real-world repositories, with reference solutions and test cases
Critique ML experiments and data pipelines for leakage, flawed metrics and weak evaluation methodology
Write clear, rubric-based feedback that AI researchers use to improve model performance
What we’re looking for
3+ years of professional experience as a software engineer, ML engineer, data scientist or data engineer
Strong proficiency in Python, plus at least one of: TypeScript/JavaScript, Java, Go, Rust, C++ or C#
Hands-on experience with Git, Docker and running and debugging real-world codebases
Strong code-review and debugging skills, and the ability to spot subtle bugs and bad practices
Excellent written English and the ability to explain technical decisions clearly
Based in the United States and authorized to work in the US
Nice to have
Open-source contributions or maintainer experience (merged PRs, committer roles)
Daily use of AI coding tools such as Cursor, GitHub Copilot or Claude Code
Experience with cloud and infrastructure (AWS, Kubernetes, Terraform/IaC) or GPU/kernel programming
Applied ML experience (PyTorch, scikit-learn, XGBoost), competitive programming or Kaggle
Engineering experience at a top-tier technology company
Prior experience grading code, reviewing technical work or evaluating AI output
Details
📍 Remote – United States only
📝 Independent contract, part-time (typically 15–40 hours/week, flexible schedule)
💵 Competitive hourly rates
🛂 Visa sponsorship is not available
⚡ Fast process: short application, a brief AI-led interview and, for some projects, a technical assessment
Why join
Work on the cutting edge of AI from anywhere in the US, on your own schedule. You’ll get hands-on exposure to how frontier models are trained and evaluated, alongside a community of top engineers.
👉 Apply here, and we’ll match you with the project that best fits your background.

Work arrangement
Yes