Live opening · Posted 11 days ago
At a glance
The key details from the original listing.
Your early-applicant advantage
Live timing from JobBeeper.
About the role
Description supplied by the original job listing.
Requirements
Core Skills: Strong analytical, research, and problem-solving skills with excellent English comprehension.
Communication & Feedback: Exceptional structured written communication, with the ability to provide constructive feedback and detailed annotations in a remote environment.
Analytical & Creative Thinking: Strong lateral thinking capabilities to construct novel scenarios and evaluate complex reasoning pathways.
Independence: Self-motivated and capable of operating independently in a fast-paced, remote-first setup.
Technical Infrastructure: Personal desktop/laptop equipped with a stable, high-speed internet connection.
Responsibilities
In this role, you will help set the benchmark for AI capabilities in advanced physical sciences. Your day-to-day responsibilities will include:
Problem Creation & Solutioning: Designing and solving challenging physics problems that test the boundaries of large language models.
Authoring Gold-Standard Data: Creating clear, high-quality, step-by-step solutions with detailed and articulated reasoning.
Research Collaboration: Working with LLM researchers to align task designs with evaluation goals, targeting key areas where models struggle (e. g., symbolic manipulation, abstraction, multi-step reasoning).
Benchmark Definition: Helping define and build new evaluation benchmarks across physics curricula ranging from early undergraduate to PhD-level topics.
Education & Experience
Educational background or Doctorate in Mathematics, or an equivalent technical field.
Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required.
Skills
PhD, mathematics, maths, research
Experience
0-4 yrs
More openings worth a look
Recently tracked roles with full details and direct application links.