Profile cover
H

AI Data Quality Firewall Developer

Harper Adeyemi

Full-time · Job · New_York

About the role

Bad data is the silent killer of ML models. A corrupted data feed that introduces null values, a schema change that shifts column meanings, or a third-party source that starts returning stale data — any of these can silently degrade model performance for weeks before someone notices. Our data quality firewall catches these issues at the pipeline boundary, before bad data reaches models. The firewall evaluates every data batch against learned expectations: distribution profiles, completeness requirements, freshness thresholds, and cross-field consistency rules. When a batch violates expectations, it gets quarantined for review instead of flowing downstream. You'll build the expectation learning system that automatically configures quality rules from historical data patterns. The data governance team is five engineers. You'll own the expectation engine — the component that learns what "normal" looks like for each data source and flags deviations. It's the core intelligence of the firewall, and getting it right means the difference between catching real issues and flooding teams with false alarms.

Responsibilities

  • Build the expectation learning engine for automated data quality rule configuration
  • Design distribution profiling and anomaly detection for streaming data batches
  • Implement quarantine workflows for data batches failing quality checks
  • Balance detection sensitivity against false alarm rates
  • Support onboarding of new data sources with expectation bootstrapping
  • Create dashboards tracking data quality trends across pipeline boundaries

Requirements

  • 5+ years in data engineering with quality or validation focus
  • Experience with data profiling, anomaly detection, or statistical monitoring
  • Strong Python, SQL, and distributed computing skills
  • Understanding of data pipeline architecture and failure modes
  • Ability to design systems that learn patterns from historical data

Benefits

  • Fully remote with flexible schedule
  • Health, dental, and vision insurance
  • $3,000 annual learning budget
  • Stock options
  • Build infrastructure protecting downstream ML models

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

data science & analytics MLOps & AI Infrastructure

Skills

python sql spark airflow docker

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Drone Platform Integration & Network Support Engineer

RemoteAI company

Full-time

Technical Writer

RemoteAI company

Part-time

Staff Application Security Engineer

RemoteAI company

Full-time Staff

AI Resident UK/EMEA

RemoteAI company

Full-time

Devops Engineer, US

RemoteAI company

Full-time

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$100k – $130k / year

AI Expertise

data science & analytics MLOps & AI Infrastructure

Skills

python sql spark airflow docker aws

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile