Live opening · Posted 8 days ago

LLM Language Evaluation Specialist - Slovenian

Thoth AI · Slovenia (Remote)
Linkedin No
You are 8 days behind. JobBeeper subscribers saw this role while it was still new.

At a glance

The key details from the original listing.

Posted 8 days ago
CompanyThoth AI
LocationSlovenia (Remote)
Work modeNo
SourceLinkedin
Listed8 days ago

Your early-applicant advantage

Live timing from JobBeeper.

Live data
13 min from Linkedin publishing this role to us finding it
1 min median time from a role going live to a subscriber being told
6 hours subscribers had this role before this page existed
72,740 roles found in the last 24 hours — the newest are not on this site yet
Start your free trial →

About the role

Description supplied by the original job listing.

LLM Language Evaluation Specialist – Estonia
Project-based | Slovenia | Remote
We are looking for Slovenian language specialists to participate in a long-term LLM Language Evaluation Project focused on evaluating the quality and accuracy of AI-generated content.
The project is expected to continue for 3+ months, with selected candidates first completing a trial evaluation before joining the production stage.
🔍 What You Will Do
Evaluate AI/LLM-generated content in Slovenian according to detailed project guidelines.
Assess whether the content is accurate, natural, and linguistically appropriate.
Identify and classify language-related issues, including:
Mistranslation or inaccurate translation
Missing or omitted content
Incorrect terminology or word usage
Spelling, grammar, punctuation, and spacing errors
Word- or phrase-level issues
Other issues affecting the quality and readability of the content
Identify abnormal cases, such as non-Slovak content, language identification errors, duplicate content, or content requiring rejection.
Apply evaluation criteria consistently and provide structured evaluation results.
Maintain high accuracy and attention to detail throughout the project.
🎯 Requirements
High proficiency in Slovenian.
Previous experience with Large Language Model (LLM), AI evaluation, AI training, data annotation, localization, translation, or related projects is required.
Strong understanding of Slovak grammar, vocabulary, terminology, and natural language usage.
Strong ability to identify subtle language errors and distinguish between acceptable and incorrect expressions.
Ability to understand and follow detailed evaluation guidelines.
Strong attention to detail and execution ability.
Comfortable working with structured digital documents and online tools.
Relevant professional or industry experience is a plus, but not mandatory.
📋 Project Information
Project: LLM Language Evaluation
Target Language: Slovenian
Duration: 3+ months
Work Mode: Remote / Project-based
Start: September 24, 2026.
Before starting project work, all selected candidates will go through a 1–5 day trial and training period to familiarize themselves with the project guidelines and evaluation process.
The trial and training period is paid at the normal project rate, so candidates will be compensated for their time and completed work during this period.
Recruitment Notice
We never charge candidates any fees at any stage of the recruitment or onboarding process.

Work arrangement
No

Get JobBeeper Mobile App

Never miss a job opening! Get instant job alerts on your phone.

Subscribers see fresh openings within minutes. Download the JobBeeper App on Google Play to get real-time push notifications and apply before anyone else.

⚡ Instant Push Alerts 🎯 Tailored Filters 🚀 Direct Employer Links
GET IT ON Google Play

More openings worth a look

Recently tracked roles with full details and direct application links.

6 roles
Good roles move before most people even see them. Tell JobBeeper what you want and get fresh matches delivered in minutes.
Start your free trial →
⚡ Get fresh job alerts 📱 Get App