ML Engineer (Model Distillation/Knowledge Distillation)

Location: Noida or Bengaluru
About the Role
We believe small, well-distilled models can match much larger systems at a fraction of the cost — and that belief is only as good as the distillation pipeline behind it. As a Distillation Engineer, you'll build and run that pipeline.
What You'll Do
Design and run teacher-student distillation pipelines to produce small, efficient models
Implement quantization-aware training and model compression techniques
Manage student-model refresh cycles as teacher models and training data improve
Evaluate distilled-model quality against both public benchmarks and real production tasks
Collaborate with our evaluation and data teams on synthetic data generation for distillation
What You'll Bring
5+ years of relevant experience in machine learning engineering or applied research
Hands-on experience with knowledge distillation and teacher-student training
Experience with quantization-aware training and model compression techniques
Proficiency in PyTorch and Python
Comfort iterating quickly on model quality tradeoffs under compute constraints
Education
Master's or PhD in Machine Learning, Computer Science, or a related quantitative field.
Nice to Have
A master's or PhD in Machine Learning, ideally with a publication record in model compression or efficient inference
Experience building small, production-quality language models

Work arrangement
No