Live opening · Posted 10 hours ago
At a glance
The key details from the original listing.
About the role
Description supplied by the original job listing.
Position: Domain Contributor - Evaluation Specialist
Type: Contract
Compensation: $30 - $60/hour
Location: Remote
Commitment: 10-40 hrs/week
Role Responsibilities
Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
Apply detailed task guidelines and evaluation rubrics consistently to each submission.
Requirements
Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
Deep expertise in a core domain: history, archival or library science, law, finance, journalism, or technology/industry history.
Advanced research skills with a track record of verifying complex claims against authoritative sources.
Exceptional written and verbal communication skills to articulate findings and feedback.
Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
Application Process
Easy Apply on LinkedIn
Check email for next steps
Participate in resume evaluation & interview stage
Work arrangement
Yes
Your early-applicant advantage
Live timing from JobBeeper.
More openings worth a look
Recently tracked roles with full details and direct application links.