Profile cover
B

AI ETL Failure Alerting Engineer

Benjamin Leclerc

Full-time · Job · Los_Angeles

About the role

Airflow, Spark, and Kafka are the backbone of every data pipeline we run at Infera Cloud. If you've ever debugged a silent pipeline failure at 2am because nobody got paged, you know exactly why this role exists. You'll be the third infrastructure engineer on a team of nine, working directly with the data platform lead to design an alerting layer that catches pipeline failures before they cascade into bad data reaching downstream ML models. Right now failures get discovered by customers, not by us. You'll build failure classification models that distinguish transient issues from real breakages, wire up smart paging that reduces alert fatigue, and give the team confidence that a red dashboard means something is actually wrong.

Responsibilities

  • Design failure classification models to distinguish transient from critical pipeline errors
  • Build alerting infrastructure integrated with Airflow and Kafka pipelines
  • Reduce false-positive pages through smarter alert routing
  • Partner with the data platform lead on pipeline reliability roadmap
  • Document runbooks for common failure patterns

Requirements

  • Deep experience with Airflow and Spark in production
  • Kafka experience for streaming pipeline monitoring
  • AWS infrastructure experience at scale
  • Track record of reducing on-call alert fatigue
  • Comfort working directly with senior infrastructure leadership

Benefits

  • Fully remote
  • Equity
  • Health and dental insurance
  • Unlimited PTO
  • Home office setup budget

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$160k – $200k / year

AI Expertise

MLOps & AI Infrastructure

Skills

python airflow spark kafka aws

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile