Software Engineer

We're hiring on behalf of a Haystack partner!
The Role
• Lead the design and implementation of ML infrastructure platforms, including systems for capacity management, workload scheduling, and fleet orchestration across ML accelerators.
• Develop machine learning tools to optimize and analyze ML workloads, from architecture through multiple delivery generations.
• Collaborate with ML scientists, training infrastructure engineers, hardware teams, and internal customers to ensure seamless ML accelerator access.
• Build high-impact solutions to deliver to a large customer base, focusing on efficiency, automation, and defect resolution.
• Work in a startup-like development environment on critical projects with significant design ownership.
What You'll Need
• 3+ years of professional software development experience.
• 2+ years of experience in designing or architecting new and existing systems, including design patterns, reliability, and scaling.
• Experience leading machine learning tool projects, from architecture to delivery.
• Deep knowledge of profiling, optimization, resource management, scheduling, and code generation.
• Experience working on new instruction set architectures (CPU, NPU, GPU, etc.).
• Proficiency in programming languages such as Go/Java, Python, and Javascript/Typescript.
What's On Offer
• Competitive annual salary ($143,700 - $194,400) plus potential for sign-on bonuses and stock units.
• Opportunity to work on cutting-edge AI infrastructure at the intersection of Kubernetes, custom silicon, and large-scale ML workloads.
• High-impact, high-visibility role that directly accelerates the output of numerous engineers.
• Comprehensive benefits package including health insurance, 401(k) matching, paid time off, and parental leave.
Apply via Haystack today!

Work arrangement
Yes