Software Engineer Coding Benchmarks

About the Company
Our partner, Terac, is looking for senior Software Engineers and AI Engineers with experience building evaluation harnesses and coding tasks to help train and evaluate advanced AI systems.
About the Role
We are seeking senior Software Engineers and AI Engineers to build and verify programming tasks for AI agents. The work involves applying experience authoring coding tasks and benchmarks used to train or evaluate software-engineering agents in reinforcement learning or agentic environments.
Responsibilities
Build programming tasks for AI agents.
Verify programming tasks using issue descriptions and test suites.
Apply coding-task and benchmark authoring experience to AI training and evaluation in reinforcement learning or agentic environments.
Qualifications
Must be 18 years or older and fluent in English.
Current primary work must be software engineering (backend, full-stack, or frontend), ML / AI engineering, or authoring coding tasks or environments for AI training or evaluation.
Must have more than 5 years of paid, full-time-equivalent experience writing production software.
Must have personally authored coding tasks with issue descriptions and test suites for AI training or evaluation.
Must have experience authoring coding tasks or benchmarks used to train or evaluate software-engineering agents in a reinforcement learning or agentic environment.
Must be able to commit 10–20 hours or more than 20 hours per week.
Required Skills
Professional software engineering or ML / AI engineering experience.
Production software development.
Coding task authoring.
Coding benchmark development.
Evaluation harnesses.
Issue descriptions and test suites.
Reinforcement learning or agentic environments.
AI agent training and evaluation.
Pay range and compensation package
Position: SWE Coding Benchmarks & RL Environments
Compensation: Paid project work; specific rate not provided in the supplied listing
Employment Type: Contract
Location: Remote
Country Eligibility: Not specified
Time Commitment: At least 10 hours per week; 10–20 hours or more than 20 hours per week
Start Date: Availability requested from the following week in the supplied September 21, 2026 listing
Equal Opportunity Statement
Terac and its partners are committed to providing equal employment opportunities to all candidates and fostering an inclusive, diverse work environment. All qualified applicants will receive consideration without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status, or other characteristics protected by applicable law.

Work arrangement
No