Live opening · Posted 10 hours ago
At a glance
The key details from the original listing.
About the role
Description supplied by the original job listing.
Role : LLMOps Engineer
Location : Bangalore
Experience : 6- 12 Years
Key Responsibilities :
• Deploy and manage LLM-based applications across cloud and hybrid environments.
• Build and maintain production-grade inference pipelines for LLM workloads.
• Design and implement LLMOps pipelines for model, prompt, and configuration lifecycle management.
• Implement monitoring for latency, throughput, cost, errors, drift, and hallucinations.
• Build dashboards and alerts to ensure SLA and reliability targets.
• Optimize inference cost and performance using caching, batching, routing, and autoscaling strategies.
• Enforce security, access control, audit logging, and governance controls for LLM usage.
• Collaborate with Responsible AI teams to operationalize safety and compliance guardrails.
• Enable AI Engineers and Fullstack teams through reusable LLMOps frameworks and platforms.
Work arrangement
Hybrid
Your early-applicant advantage
Live timing from JobBeeper.
More openings worth a look
Recently tracked roles with full details and direct application links.