Live opening · Posted 1 day ago
The key details from the original listing.
Live timing from JobBeeper.
Description supplied by the original job listing.
About the Opportunity
We're building one of the most rigorous STEM AI training datasets in the industry through the SciCode initiative - a collection of high quality scientific coding tasks used to train and evaluate frontier AI models. As a SciCode Trainer specializing in Physics, you'll directly shape cutting-edge AI research by authoring, implementing, and reviewing complex scientific problems in your field of expertise.
What You'll Do
Write scientific problem specifications, one main problem plus at least three sub-problems that logically build toward the main solution
Implement verified "golden" solutions in Python with complete unit test coverage
Design discriminative test cases that clearly distinguish correct from incorrect model outputs
Run QC validation on the Central Task Platform (CTP), covering both structural checks and quality rubrics
Iterate on tasks based on QC feedback to meet evaluation criteria across multiple LLM judges
Join sync calls for reviews, feedback sessions, and standups during overlap hours
Who We're Looking For
Required
Master's or PhD in Physics, with strong Python programming
skills and hands-on experience in scientific computing
Ability to write rigorous, well-posed scientific problems with
clear constraints and expected outputs
Sharp attention to detail — your work needs to meet strict
rubrics for well-posedness, test-case discriminativeness,
scientific correctness, and determinism
Preferred
Prior experience in AI data annotation, research, or scientific writing
Familiarity with LLM evaluation frameworks or coding benchmarks
Experience with libraries such as NumPy, SciPy, SymPy, or other domain-specific scientific tools
Published research or academic project experience in a STEM domain
Key Skills:
Physics & Scientific Computing | Python | NumPy | SciPy | SymPy | Numerical Modeling & Simulation | Scientific Problem Design | Algorithm Development | Unit Testing | Test Case Design | Scientific Validation & QC | LLM Evaluation | AI Training Data | Technical Writing | Research & Data Analysis | Critical Thinking | Attention to Detail
$180 / approved task
Work arrangement
No
Recently tracked roles with full details and direct application links.