Bioinformatics AI Expert – Advanced Benchmark Data Annotator

Click Here to Apply
Join our global AI Community as a Bioinformatics AI Expert specializing in advanced benchmark dataset creation and AI model evaluation.
In this role, you will design complex, reasoning-intensive, "information-reversal" evaluation tasks to measure the autonomous tool-use and data analysis capabilities of Agent-style Large Language Models (LLMs) on real "wet lab / dry lab" biological data (e.g., RNA-seq, FASTQ, BAM, mzML).
Key Responsibilities
Information-Reversal Problem Creation: Construct complex scientific scenario questions where AI models receive anonymized raw/processed biological datasets and must deduce hidden identities, experimental conditions, variant locations, or functional pathways.
Data Workspace Packaging: Build clean, self-contained zip workspace archives containing real or synthesized biological datasets (e.g., expression tables, sequence files, metadata).
Multi-Step Tool Orchestration: Design tasks that strictly require multi-step external tool execution (e.g., BLAST, genomic interval tools, variant annotators, phylogenetic software, differential expression pipelines) rather than simple code execution or direct text lookups.
Chain of Thought (CoT) & Rubric Engineering: Author step-by-step resolution paths and rigid all-or-nothing grading rubrics featuring canonical answers and explicitly accepted variants for automated LLM evaluation.
Quality Assurance & Verification: Ensure all benchmark deliverables pass automated validation checks, eliminating answer leakage in metadata or filenames, and guaranteeing single, deterministic correct answers.
Qualification path
What We're Looking For
Academic background or degree in Bioinformatics, Computational Biology, Genomics, Systems Biology, Molecular Biology, or Biomedical Data Science.
3+ years of practical bioinformatics experience working with real biological data types (WGS/WES, RNA-seq, single-cell, ChIP/ATAC-seq, mass spectrometry, metagenomics).
Hands-on proficiency with standard bioinformatics command-line tools and software suites (e.g., samtools, bedtools, BLAST, DESeq2, snpEff, Bioconductor, GATK).
Proficiency with Python/R scripting for data anonymization, filtering, and workspace packaging.
Deep understanding of benchmark validation, prompt engineering, RLHF, or LLM agent evaluations.
C1+ / Native English proficiency for precise prompt wording, error-free documentation, and rubric authoring.
Assessment & Onboarding
Successful applicants will complete a Bioinformatics Technical Sandbox Assessment, creating one sample information-reversal task (with dataset, rubrics, and CoT) and completing identity verification (IDV) before joining the active project pool.
Why Join Our AI Community?
Community Connection: Work remotely as part of a 1M+ global network of domain contributors and scientific experts.
Cutting-Edge Impact: Directly influence the reasoning capabilities, safety, and tool-use precision of leading scientific AI models.
Flexible Engagement: Enjoy total flexibility to manage your workload on a project-by-project freelance basis.
Independent Contractor Relationship
This opportunity is offered on an independent contractor basis. Contributors have full flexibility to choose when and how much they work, subject to project availability and quality requirements. This opportunity does not create an employment relationship with the organization.

Work arrangement
Yes