Profile cover
G

AI Data Contract Enforcement Engine Developer

Grayson Martins

Full-time · Job · Chicago

About the role

Data contracts define what upstream producers promise and downstream consumers expect: column names, data types, freshness SLAs, value ranges, and null policies. The contracts exist on paper. Our enforcement engine makes them real — automatically validating every data batch against its contract and blocking non-compliant data before it corrupts downstream systems. The engineering challenge is enforcement at streaming scale. Contracts must be evaluated on 2 billion records per day across 400 pipelines with less than 5 seconds of added latency. You'll build the contract evaluation engine that handles this throughput, the schema registry that manages contract versions, and the breach response system that quarantines, alerts, or transforms non-compliant data based on severity. The data infrastructure team is six engineers. You'll be the senior engineer who designs the enforcement architecture, balancing thoroughness against performance. Over-strict enforcement blocks legitimate data evolution; under-strict enforcement lets quality issues through. Finding that balance is the core design challenge.

Responsibilities

  • Design the contract enforcement engine for streaming data validation
  • Build schema registry managing contract versions and evolution rules
  • Implement breach response: quarantine, alerting, and auto-remediation
  • Optimize enforcement for 2B records/day with sub-5-second latency
  • Define contract specification language balancing expressiveness with simplicity
  • Mentor junior engineers on data quality architecture patterns

Requirements

  • 5+ years in data engineering with streaming systems experience
  • Deep expertise with Kafka, Spark Streaming, or similar frameworks
  • Experience building data validation or quality enforcement systems
  • Strong Python and distributed systems skills
  • Understanding of schema evolution and backward compatibility

Benefits

  • Fully remote with flexible schedule
  • Competitive salary plus annual bonus
  • Health, dental, and vision insurance
  • 401(k) with employer match
  • $4,000 annual conference and learning budget

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

data science & analytics MLOps & AI Infrastructure

Skills

python spark kafka sql docker

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Drone Platform Integration & Network Support Engineer

RemoteAI company

Full-time

Backend Engineer, Platform

RemoteAI company

Full-time

Technical Writer

RemoteAI company

Part-time

Principal Engineer

RemoteAI company

Full-time Principal

Staff Application Security Engineer

RemoteAI company

Full-time Staff

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

data science & analytics MLOps & AI Infrastructure

Skills

python spark kafka sql docker aws

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile