Live opening · Posted 7 days ago
Software Engineers: Paid Interview on AI Evaluation Tasks
jobgether · US
You are 7 days behind. JobBeeper subscribers saw this role while it was still new.
At a glance
The key details from the original listing.
Companyjobgether
LocationUS
Job typeContract
Work modeYes
Source
Lever
Listed7 days ago
Your early-applicant advantage
Live timing from JobBeeper.
0 min
from Lever publishing this role to us finding it
5 min
median time from a role going live to a subscriber being told
6 hours
subscribers had this role before this page existed
71,800
roles found in the last 24 hours — the newest are not on this site yet
About the role
Description supplied by the original job listing.
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for Software Engineers: Paid Interview on AI Evaluation Tasks based in the United States.
This is a remote, paid research opportunity for software engineers with hands-on experience evaluating realistic programming tasks and technical systems.
You will review coding challenges and the evaluation environments used to assess the performance of AI agents.
Your expertise will help determine whether these tasks are technically accurate, appropriately challenging, verifiable, and representative of real-world engineering standards.
You will examine evaluation harnesses, walk through their logic, and identify potential technical or structural issues.
Your feedback will contribute to improving how AI systems are tested and benchmarked against practical software engineering expectations.
The session is designed for experienced technical professionals who can clearly explain their reasoning and assess code quality objectively.
This is a flexible opportunity to apply your engineering expertise to the development of more rigorous and realistic AI evaluations.
Employment type
Contract
Work arrangement
Yes
More openings worth a look
Recently tracked roles with full details and direct application links.
Good roles move before most people even see them.
Tell JobBeeper what you want and get fresh matches delivered in minutes.
Start your free trial →