Profile cover
A

AI Rollback Automation Engineer

Rolvex Solutions

Remote · $80k – $100k / year · Full-time · Posted 4 months ago

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

Model deployments fail in ways that aren't obvious. A model ships to 10% of traffic, looks fine on standard metrics, but two hours later a specific user segment is getting worse predictions. By the time someone notices and escalates, the full rollout has happened. A manual rollback takes 40 minutes, and every minute of bad predictions erodes user trust. Our rollback automation system reduces that window to under 3 minutes — automated anomaly detection, decision logic for triggering rollback, rollback execution, and a post-incident report generated before the incident bridge even ends. We serve 65 platform engineering teams at enterprise tech companies. You'll own the detection-to-rollback pipeline: improving the statistical models that distinguish real regressions from natural variance, building the decision rules that balance false positive risk against rollback latency, and designing the rollback execution path that works across Kubernetes, SageMaker, and Vertex AI deployment targets.

Fully remote.

Responsibilities

  • Improve statistical models for distinguishing real regressions from metric variance
  • Build decision logic for automated rollback trigger conditions
  • Design rollback execution paths for Kubernetes, SageMaker, and Vertex AI
  • Implement automated post-incident reports generated on rollback completion
  • Create shadow-mode testing for rollback system changes before production
  • Monitor rollback system reliability and false positive/negative rates

Requirements

  • 3+ years in MLOps or platform engineering with ML deployment experience
  • Experience with Kubernetes, Docker, and cloud ML deployment services
  • Strong Python skills and statistical reasoning for anomaly detection
  • Understanding of ML serving infrastructure and deployment patterns
  • Systematic debugging mindset for complex distributed system failures

Benefits

  • Fully remote
  • Health and dental from day one
  • $3,000 annual learning budget
  • Home office stipend
  • Quarterly bonus tied to system reliability metrics

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$80k – $100k / year

AI Expertise

MLOps & AI Infrastructure Automation & AI Workflows

Skills

python kubernetes docker aws mlflow fastapi

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile