Senior Software Engineer - AI Platform

We are looking for a Senior Software Engineer to lead the production systems for our Context Services team. You will serve as the bridge between our applied scientists/AI engineers and the central platform engineering team. In this role, you will focus on turning complex analytical solutions, ranging from traditional ML/DL models to modern LLM agents, into highly reliable, production-grade software services.
Responsibilities:
Architecture and Scale: Design robust system architectures and develop low-latency APIs/services capable of supporting thousands of concurrent users with sub-second response times.
Cross-Functional Problem Solving: Collaborate closely with product, architecture, and AI teams to translate complex industrial data problems into scalable solutions.
AI and LLM Orchestration: Architect frameworks for model serving, vector databases, and agentic workflows (LLM agents), ensuring reliable state management and prompt tracking.
Platform Integration: Act as the technical liaison with the central platform team, leveraging core infrastructure to build reliable AI pipelines and workflows.
Innovation: Drive technical innovation through research, prototyping, and potential contributions to open-source initiatives.
Requirements:
Experience: 6-10 years of industry experience in software engineering, backend engineering, or systems engineering, with exposure to AI, ML, or LLM-based production systems.
Programming: Strong proficiency in Python and experience building high-concurrency applications, asynchronous programming, or REST/gRPC APIs.
Systems: Solid understanding of containerization (Docker) and modern deployment environments (such as Kubernetes or cloud platforms).
AI Knowledge: Familiarity with the broader AI lifecycle, including traditional model registries, vector databases, or LLM evaluation frameworks, is a major plus, but a strong ability to learn new paradigms is essential.

Experience
6-10 yrs