Profile cover
Z

AI Regression Detection Engineer

Joltura Labs

Remote · $130k – $160k / year · Full-time · Posted 5 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

Model performance degrades silently. A retrained model scores well on validation but produces subtly worse predictions in production because the data distribution shifted, a feature pipeline broke, or a labeling standard changed. By the time someone notices, the damage is done. Our regression detection platform catches these problems before deployment. You'll build the automated testing infrastructure: statistical comparison between model versions across stratified evaluation slices, data drift detection between training and serving distributions, and the alerting system that blocks deployments when quality regressions are detected. This is defensive ML engineering — the unglamorous work that prevents expensive production failures. Every model deployment at our clients passes through your regression gates. When the system works, nothing bad happens. When it catches a regression, it saves weeks of debugging and customer trust.

Fully remote.

Responsibilities

  • Build automated regression testing for model version comparisons
  • Design stratified evaluation across demographic and behavioral slices
  • Implement data drift detection between training and serving distributions
  • Create deployment gates that block models with detected quality regressions
  • Define regression severity thresholds calibrated to business impact

Requirements

  • 5+ years in ML engineering with model evaluation expertise
  • Strong statistical skills for distribution comparison and hypothesis testing
  • MLflow and Airflow experience for pipeline orchestration
  • Deep understanding of data drift, concept drift, and model degradation
  • Docker and infrastructure skills for testing automation

Benefits

  • Fully remote — European time zones
  • 30 days PTO
  • Senior compensation with equity
  • Preventing production ML failures at scale

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure Data Science & Analytics

Skills

python scikit-learn mlflow docker airflow

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Revenue Operations Manager

Handshake

Full-time

AI Security Engineer Intern (Summer 2027)

Brainco

Full-time Intern

Software Engineering Manager, AI Migrations

Snowflake

Full-time

Software Engineer - AI Tooling Infrastructure

Supabase

Full-time

AI Platform Engineer Intern (Summer 2027)

Brainco

Full-time Intern

Software Engineer, Infrastructure

Niantic Spatial

Full-time

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

MLOps & AI Infrastructure Data Science & Analytics

Skills

python scikit-learn mlflow docker airflow sql statistics

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free account & apply Log in

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile