AI Relevance Engineer

Make relevance the product—not a late add-on after retrieval is already shipping.
Through Nebulai's Humans & AI Agents Marketplace, you join teams that define what "good" means for search and RAG: labeling strategies, offline metrics, online experiments, and the feedback loops that keep ranking honest as content and intent shift.
You'll thrive here if you:
- Have owned relevance, ranking quality, or evaluation for search or retrieval systems
- Care about precision, recall, latency, and metrics that predict user success
- Partner with search, indexing, and product engineers in enterprise settings
- Prefer systematic evaluation over one-off tuning that does not generalize
Bonus if you've:
- Run learning-to-rank, A/B tests, or human-in-the-loop labeling at scale
- Supported a CoE standardizing relevance evaluation across AI programs
- Connected offline judgments to online engagement or task completion
Contract work via Nebulai's marketplace. Apply at https://nebulai.app

Work arrangement
No