Data Scientist

Job Description: Data Scientist
Job Title: Data Scientist
Locations: Bangalore / Pune
Experience: 5-12 Years
Employment Type: Full-Time
Job Summary
We are looking for an experienced Data Scientist with strong expertise in classical Machine Learning, AI/ML evaluation, and Large Language Models (LLMs). The ideal candidate should be skilled in problem framing, defining evaluation metrics, conducting experiments, and developing AI/ML solutions, with foundational knowledge of prompt engineering and Retrieval-Augmented Generation (RAG).
Key Responsibilities
Translate business requirements into data science problems and define measurable success criteria.
Develop, train, evaluate, and optimize classical machine learning models.
Define and track AI/ML performance metrics, including accuracy, precision, recall, F1-score, and business-specific KPIs.
Contribute to LLM development and evaluation, including response quality, relevance, groundedness, and hallucination assessment.
Apply prompt engineering techniques and understand basic RAG architectures and workflows.
Design and execute experiments, including hypothesis testing, A/B testing, and model comparisons.
Perform feature engineering, data preprocessing, model validation, and error analysis.
Document model assumptions, limitations, evaluation results, risks, and intended use through model cards.
Collaborate with data engineers, ML engineers, product teams, and business stakeholders to deliver scalable AI solutions.
Required Skills
Strong understanding of problem framing and analytical thinking.
Hands-on experience with classical ML algorithms and model development.
Knowledge of AI/ML evaluation metrics and model validation techniques.
Experience with LLM development and evaluation.
Basic understanding of prompt engineering and RAG.
Experience in experiment design, hypothesis testing, and statistical analysis.
Familiarity with model documentation, model cards, and responsible AI principles.
Strong Python and SQL programming skills.
Experience with libraries such as Pandas, NumPy, Scikit-learn, and relevant ML/LLM frameworks.
Preferred Qualifications
Experience evaluating generative AI applications and LLM outputs.
Familiarity with frameworks such as LangChain or LlamaIndex.
Exposure to ML experiment tracking and model lifecycle tools.
Understanding of bias, explainability, reproducibility, and responsible AI practices.

Work arrangement
No