Live opening · Posted 1 day ago

MLOps Engineer

Evlo AI · Boston, MA (Remote)
Linkedin Yes
JobBeeper subscribers received an alert for this role.

At a glance

The key details from the original listing.

Posted 1 day ago
CompanyEvlo AI
LocationBoston, MA (Remote)
Work modeYes
SkillsPython, AWS, Azure, GCP, Docker, Kubernetes, Terraform
SourceLinkedin
ListedPosted 1 day ago

About the role

Description supplied by the original job listing.

About The Role
The role owns the infrastructure that turns experimental ML work into reliable production systems - CI/CD for models, scalable training infrastructure, real-time and batch serving, and the observability tooling that keeps it all running.
You will work directly with ML engineers and data scientists to eliminate the friction between 'it works in a notebook' and 'it works at scale', owning the platform decisions that determine how fast models ship and how reliably they perform.
Key Responsibilities
Design and maintain CI/CD pipelines for ML workflows using tools like Kubeflow, MLflow, or Argo Workflows, from model versioning through automated deployment
Build and operate model serving infrastructure on Kubernetes, including GPU scheduling, autoscaling, canary deployments, and rollback strategies
Implement monitoring and observability for production models: latency, throughput, data drift detection, and automated alerting with tools like Prometheus, Grafana, and Evidently
Develop feature stores and data pipeline integrations (Airflow, dbt, Spark) ensuring consistency between training and serving environments
Optimize training and inference costs across cloud providers (AWS, GCP, or Azure), including GPU utilization, spot instance strategies, and model quantization where appropriate
Establish MLOps best practices across teams: model registries, experiment tracking, reproducibility standards, and infrastructure-as-code with Terraform
Partner with ML engineers and data scientists to debug production incidents, profile performance bottlenecks, and improve deployment velocity
What We Are Looking For
3-6 years of experience in MLOps, DevOps, or platform engineering, with at least 2 years supporting ML systems in production
Strong proficiency with Kubernetes, Docker, and cloud infrastructure (AWS, GCP, or Azure) in production environments
Hands-on experience with ML tooling: MLflow, Kubeflow, SageMaker, Vertex AI, or equivalent model deployment and tracking platforms
Solid software engineering skills in Python and/or Go, including infrastructure-as-code experience with Terraform or Pulumi
Experience building observability for distributed systems: metrics, logging, tracing, and drift monitoring for ML workloads
Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
Bonus: Experience with GPU scheduling (NVIDIA device plugins, Slurm), LLM inference optimization (vLLM, TensorRT), or building internal ML platforms used by multiple teams

Work arrangement
Yes

Your early-applicant advantage

Live timing from JobBeeper.

Live data
11 min from Linkedin publishing this role to us finding it
10 min median time from a role going live to a subscriber being told
6 hours subscribers had this role before this page existed
134,858 roles found in the last 24 hours — the newest are not on this site yet
See available plans →

More openings worth a look

Recently tracked roles with full details and direct application links.

6 roles
Good roles move before most people even see them. Tell JobBeeper what you want and get fresh matches delivered in minutes.
Create free account →
⚡ Get fresh job alerts 📱 Get App