Live opening · Posted 1 day ago
At a glance
The key details from the original listing.
About the role
Description supplied by the original job listing.
Position: Research Evaluation Specialist
Type: Contract
Compensation: $30 - $60/hour
Location: Remote
Commitment: 10-40 hrs/week
Role Responsibilities
Create original, high-difficulty question-and-answer pairs to assess AI model capabilities.
Source, verify, and document answers using primary sources and authoritative references.
Design questions demanding advanced reasoning and synthesis across multiple sources.
Test questions against AI systems and iteratively increase complexity while maintaining accuracy.
Write questions and answers with precision and clarity, eliminating ambiguity.
Integrate reviewer feedback and uphold project guidelines and quality standards.
Requirements
Masters or PhD completed, active candidacy, or equivalent research experience.
Demonstrated track record of scholarly research and subject matter expertise.
Exceptional analytical thinking and strong written communication skills in English.
Experience sourcing and triangulating information from authoritative references.
Proven self-direction and reliability in delivering expert-level work independently.
Prior experience in AI training, data labeling, or model evaluation is required.
Application Process
Easy Apply on LinkedIn
Check email for next steps
Participate in resume evaluation & interview stage
Work arrangement
Yes
Your early-applicant advantage
Live timing from JobBeeper.
More openings worth a look
Recently tracked roles with full details and direct application links.