Senior Deep Learning Software Engineer, Inference and Model Optimization

For our client, we are seeking a Senior Deep Learning Software Engineer, Inference and Model Optimization to join the team of a leader in the Telecommunications & Hardware space.
This role will focus on advancing deep learning inference capabilities for generative AI workloads, with an emphasis on large language models and diffusion models. You will work on optimizing model deployment, improving GPU performance, and enabling scalable software solutions that support high-throughput, low-latency AI applications. The position also partners closely with cross-functional engineering teams to integrate kernel-level innovations into a modular platform that strengthens model support and user experience.
Location: Remote - US based candidates only, no visa sponsorship available
Compensation: $184,000 – $356,500 annually
Responsibilities
Train, develop, and deploy state-of-the-art generative AI models, including LLMs and diffusion models
Leverage the torch 2.0 ecosystem to analyze and extract standardized model graph representations for automated deployment
Develop high-performance optimization techniques for inference, including automated model sharding and efficient attention kernels
Collaborate with cross-functional teams to integrate performant kernel implementations into the deployment solution
Analyze and profile GPU kernel-level performance to identify optimization opportunities
Continuously innovate on inference performance to maintain market leadership in inference software solutions
Architect and design a modular and scalable software platform to enhance user experience and model support
Qualifications
Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or a related field
8+ years of relevant work or research experience in Deep Learning
Excellent software design skills, including debugging, performance analysis, and test design
Strong proficiency in Python, PyTorch, and related ML tools, including Hugging Face
Strong algorithms and programming fundamentals
Good written and verbal communication skills, with the ability to work independently and collaboratively
Benefits
Comprehensive benefits package including health, dental, and vision insurance
Opportunities for professional development and growth
Access to cutting-edge technology and resources
Collaborative and innovative work environment
Equity options available
Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.

Work arrangement
Yes