Profile cover
G

AI Data Contract Enforcement Engine Developer

Unvix Works

Remote · $130k – $160k / year · Full-time · Posted 5 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

Data contracts define what upstream producers promise and downstream consumers expect: column names, data types, freshness SLAs, value ranges, and null policies. The contracts exist on paper. Our enforcement engine makes them real — automatically validating every data batch against its contract and blocking non-compliant data before it corrupts downstream systems. The engineering challenge is enforcement at streaming scale. Contracts must be evaluated on 2 billion records per day across 400 pipelines with less than 5 seconds of added latency. You'll build the contract evaluation engine that handles this throughput, the schema registry that manages contract versions, and the breach response system that quarantines, alerts, or transforms non-compliant data based on severity. The data infrastructure team is six engineers. You'll be the senior engineer who designs the enforcement architecture, balancing thoroughness against performance. Over-strict enforcement blocks legitimate data evolution; under-strict enforcement lets quality issues through. Finding that balance is the core design challenge.

Fully remote.

Responsibilities

  • Design the contract enforcement engine for streaming data validation
  • Build schema registry managing contract versions and evolution rules
  • Implement breach response: quarantine, alerting, and auto-remediation
  • Optimize enforcement for 2B records/day with sub-5-second latency
  • Define contract specification language balancing expressiveness with simplicity
  • Mentor junior engineers on data quality architecture patterns

Requirements

  • 5+ years in data engineering with streaming systems experience
  • Deep expertise with Kafka, Spark Streaming, or similar frameworks
  • Experience building data validation or quality enforcement systems
  • Strong Python and distributed systems skills
  • Understanding of schema evolution and backward compatibility

Benefits

  • Fully remote with flexible schedule
  • Competitive salary plus annual bonus
  • Health, dental, and vision insurance
  • 401(k) with employer match
  • $4,000 annual conference and learning budget

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

Data Science & Analytics MLOps & AI Infrastructure

Skills

python spark kafka sql docker

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Sr. Solutions Architect - Travel and Hospitality

Databricks

Full-time Senior

Senior Data Engineer, Data Analytics

Agility Robotics

Full-time Senior

Senior Security Engineer - Detection & Response

Lambda

Full-time Senior

Solutions Engineer, Canada

Glean

Full-time

Materials Lead

Lambda

Full-time Lead

Software Engineer, Federal

Factory

Full-time

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

Data Science & Analytics MLOps & AI Infrastructure

Skills

python spark kafka sql docker aws

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free account & apply Log in

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile