Staff/ Principal Software Engineer (L6/L7): AI Platform Model Serving

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Staff/Principal Software Engineer (L6/L7): AI Platform Model Serving based in the United States, with remote work flexibility.
In this highly strategic engineering role, you will shape the next generation of AI and machine learning model-serving infrastructure at global scale. You will lead the architecture and development of a unified platform supporting predictive AI, generative AI, foundation models, and agentic workloads across real-time and asynchronous environments. Working at the intersection of distributed systems, GPU optimization, and advanced inference technologies, you will tackle complex challenges in performance, reliability, scalability, and cost efficiency. You will help establish technical standards, influence long-term engineering strategy, and guide multiple teams through architectural decisions. The role offers substantial research and development opportunities in emerging AI infrastructure, including intelligent model routing, speculative decoding, and multi-GPU inference. You will collaborate with senior technical leaders and cross-functional partners to build durable, high-performance systems that enable innovative AI-powered experiences.

Skills
Machine Learning, Generative AI

Experience
8+ yrs

Employment type
Full-time

Work arrangement
Yes