Live opening · Posted 7 hours ago
At a glance
The key details from the original listing.
Your early-applicant advantage
Live timing from JobBeeper.
About the role
Description supplied by the original job listing.
𝗔𝗯𝗼𝘂𝘁 𝘁𝗵𝗲 𝗷𝗼𝗯
This role is for one of our client companies — a VC-backed Software Development, AI Infrastructure, Automotive, and Telecommunications startup that has raised $2M USD in funding.
𝗦𝗮𝗹𝗮𝗿𝘆: Up to 35LPA
Apply once and, if selected, get access to up to 20 remote and onsite interview opportunities.
🚀 𝗪𝗵𝗮𝘁 𝗪𝗲'𝗿𝗲 𝗕𝘂𝗶𝗹𝗱𝗶𝗻𝗴
CodeRound AI matches the top 5% tech talent with the fastest-growing, VC-funded AI startups across Silicon Valley and India.
Top-tier product startups across the US, UK, EU, UAE, and India have hired top engineers through CodeRound.
🚀 𝗔𝗜 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿 (3+ 𝗬𝗲𝗮𝗿𝘀 𝗼𝗳 𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲)
We’re seeking an AI Research Engineer to own model evaluations end-to-end, turning ambiguous capabilities into rigorous, reproducible benchmarks. Working closely with researchers, you will design datasets, analyze model behavior at scale, and directly shape the training lifecycle.
🧩 𝗪𝗵𝗮𝘁 𝗬𝗼𝘂'𝗹𝗹 𝗗𝗼
Design rigorous benchmarks for reasoning, coding, and agentic capabilities across C/C++, Rust, embedded systems, hardware specifications, and engineering tasks.
Develop deterministic evaluators using compilers, emulators, simulators, static analysis, formal verification, and hardware-in-the-loop systems.
Build distributed infrastructure to run evaluations reliably against models and live training checkpoints.
Diagnose regressions and anomalous results, separating model failures from issues in prompts, data, evaluators, or infrastructure.
Design robust metrics, difficulty curricula, contamination-resistant tasks, and experiments around prompting, sampling, and scaffolding.
Turn evaluation failures into targeted datasets, reward signals, and new training objectives in collaboration with RL researchers.
Create dashboards, experiment tracking, and evaluation libraries that make model performance easy to understand and trust.
✅ 𝗬𝗼𝘂'𝗿𝗲 𝗮 𝗚𝗿𝗲𝗮𝘁 𝗙𝗶𝘁 𝗜𝗳 𝗬𝗼𝘂
Strong Python programming and software engineering fundamentals.
Experience building benchmarks, evaluation systems, automated graders, research infrastructure, or similar testbeds.
Strong understanding of LLMs and modern evaluation methodologies.
Strong analytical and experimental thinking; you care deeply about whether a metric actually measures the intended capability.
Experience debugging complex systems and investigating unexpected experimental results.
Strong written and verbal communication.
✨ 𝗪𝗵𝘆 𝗝𝗼𝗶𝗻 𝗨𝘀?
Own the development of cutting-edge infrastructure from day one.
Solve complex engineering challenges that directly shape our product roadmap.
Accelerate your career alongside elite researchers in a fast-paced environment.
Work closely with a brilliant, collaborative team of industry pioneers.
Work arrangement
Yes
More openings worth a look
Recently tracked roles with full details and direct application links.