Live opening · Posted 21 days ago

MLOps Engineer

Evlo AI · Boston, MA (Remote)
Linkedin Yes
JobBeeper subscribers received an alert for this role.

At a glance

The key details from the original listing.

Posted 21 days ago
CompanyEvlo AI
LocationBoston, MA (Remote)
Work modeYes
SkillsPython, AWS, Azure, GCP, Docker, Kubernetes, Terraform
SourceLinkedin
ListedPosted 21 days ago

About the role

Description supplied by the original job listing.

About The Role
The role sits at the intersection of machine learning and infrastructure — owning the CI/CD pipelines, serving infrastructure, and observability tooling that get models from notebooks into production reliably. This includes GPU resource orchestration, model registries, feature stores, and automated retraining workflows.
As ML adoption grows across the engineering organization, this role directly determines how fast teams can ship models and how confidently they can run them at scale. You will work closely with ML engineers and data scientists who expect deployment to be boring, and platform leadership who expect infrastructure costs to be defensible.
Key Responsibilities
Build and maintain CI/CD pipelines for ML workflows using GitHub Actions, Argo Workflows, or Kubeflow, covering training, evaluation, and deployment stages
Deploy and scale model serving infrastructure on Kubernetes (KServe, Seldon, or Triton Inference Server), including autoscaling, canary rollouts, and rollback strategies
Implement model monitoring and observability using tools like Prometheus, Grafana, Evidently, or Arize — tracking latency, drift, and data quality with automated alerting
Design and operate feature pipelines with Feast or Tecton, ensuring consistency between offline training and online serving paths
Manage model versioning and lineage through MLflow or SageMaker Model Registry, with reproducible training runs and audit trails
Optimize GPU utilization and cloud costs across training and inference workloads on AWS, GCP, or Azure
Partner with data science and ML engineering teams to productionize new models, defining deployment standards and platform guardrails
What We Are Looking For
3–6 years of experience in MLOps, platform engineering, or DevOps with a strong ML focus
Deep hands-on experience with Kubernetes, Docker, and Terraform (or equivalent IaC) in production environments
Proficiency in Python for tooling and pipeline development; comfort reading and debugging PyTorch or TensorFlow training code
Experience operating ML platforms or components in production: MLflow, Kubeflow, SageMaker, Vertex AI, or Databricks
Solid understanding of model serving patterns (batch vs. real-time inference), monitoring for drift, and retraining automation
BS/MS in Computer Science, Engineering, or equivalent practical experience
Bonus: Experience with distributed training (Ray, Horovod), LLM inference optimization (vLLM, TensorRT-LLM), or building internal ML platform products used by multiple teams

Work arrangement
Yes

Your early-applicant advantage

Live timing from JobBeeper.

Live data
13 min from Linkedin publishing this role to us finding it
11 min median time from a role going live to a subscriber being told
6 hours subscribers had this role before this page existed
141,485 roles found in the last 24 hours — the newest are not on this site yet
See available plans →

More openings worth a look

Recently tracked roles with full details and direct application links.

6 roles
Good roles move before most people even see them. Tell JobBeeper what you want and get fresh matches delivered in minutes.
Create free account →
⚡ Get fresh job alerts 📱 Get App