Senior Backend Developer, AI Pods

We are seeking a Senior Backend Developer to join our AI Pods team, building robust AI-powered API services and agentic workflows. This role focuses on language model interaction with internal systems, vector databases, and external tools via orchestration frameworks, treating LLMs as components in a secure, scalable distributed system.
Responsibilities
Design and build backend API services and LLM orchestration layers
Own API contracts and service reliability end-to-end, ensuring AI edge cases fail gracefully
Integrate LLMs using rigorous systems engineering, bake in evaluation, observability, fallback handling, and cost awareness
Implement and maintain complex RAG pipelines, including document ingestion, chunking, embedding, and retrieval optimization
Develop and connect agent tools using LangChain, LangGraph, and potentially MCP (Model Context Protocol)
Build reliable, reusable orchestration frameworks and logic for downstream developer consumption
Ensure security, privacy, enterprise-grade observability, and test coverage across all backend workflows
Contribute to architecture decisions and engineering standards within the pod
Collaborate with frontend engineers, data engineers, and infrastructure teams
Requirements
3+ years of backend engineering experience, focused on microservices and distributed systems
Proficiency in Python for high-performance backend services and cloud-native APIs
Familiarity with AWS, Docker, and ECS/EKS
Knowledge of RESTful APIs
Understanding of secure coding practices and strong auth/authz fundamentals
English proficiency at B2 level or higher
Nice to have
1+ years of hands-on experience with AI SDKs (OpenAI, Anthropic/Claude, AWS Bedrock, or equivalent) in production
Practical experience with vector databases (Amazon Kendra, OpenSearch), embedding strategies, and retrieval systems
Hands-on experience with LangChain, LlamaIndex, or LangGraph
Familiarity with AI evaluation tooling or real-time APM (LangSmith, Langfuse, Arize)
Skills in React and TypeScript
Experience deploying to EKS environments at scale
Understanding of agent interoperability patterns (MCP)
Knowledge of identity/security domain (IAM, CIAM)
Flexibility to use secondary languages such as Java, Node.js, or Go
We offer
International projects with top brands
Work with global teams of highly skilled, diverse peers
Healthcare benefits
Employee financial programs
Paid time off and sick leave
Upskilling, reskilling and certification courses
Unlimited access to the LinkedIn Learning library and 22,000+ courses
Global career opportunities
Volunteer and community involvement opportunities
EPAM Employee Groups
Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn

Work arrangement
Yes