Profile cover
C

AI Data Versioning Infrastructure Engineer

Connor Leclerc

Full-time · Job · Berlin

About the role

"Which version of the training data produced this model?" It's a simple question that most ML teams can't answer. Our data versioning platform tracks every change to every dataset — additions, deletions, schema changes, quality fixes — and links data versions to the models trained on them. When a model misbehaves, teams can trace back to the exact data it saw. As a junior engineer, you'll work on the core versioning infrastructure: the diff engine that efficiently computes changes between dataset versions, the storage layer that deduplicates unchanged data, and the API that data scientists use to check out specific versions for training. Think of it as Git for datasets, but optimized for terabyte-scale tabular and image data. The data infrastructure team is four engineers. You'll pair with the senior engineer who designed the storage layer, starting with the API endpoints that serve version metadata. The work requires careful thinking about data structures and storage efficiency — a poorly designed diff format can make versioning cost more than just keeping full copies.

Responsibilities

  • Build API endpoints for dataset version management and checkout
  • Implement diff computation between dataset versions
  • Optimize storage through deduplication of unchanged data
  • Write integration tests for versioning operations
  • Monitor storage costs and identify optimization opportunities
  • Maintain documentation for the versioning API and data model

Requirements

  • 1+ year of Python development with database experience
  • Understanding of data structures and storage efficiency concepts
  • Familiarity with REST API design and Docker
  • Interest in data infrastructure and MLOps
  • Ability to write clean, well-tested code

Benefits

  • Fully remote across EU time zones
  • 28 days PTO
  • €1,500 learning budget
  • Mentorship from senior data infrastructure engineers
  • Work on a foundational MLOps problem

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure data science & analytics

Skills

python sql docker aws mlflow

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Drone Platform Integration & Network Support Engineer

RemoteAI company

Full-time

Technical Writer

RemoteAI company

Part-time

Staff Application Security Engineer

RemoteAI company

Full-time Staff

AI Resident UK/EMEA

RemoteAI company

Full-time

Devops Engineer, US

RemoteAI company

Full-time

Job Type

Full-time

Level

Junior

Language

English

Salary Range

Under $60k / year

AI Expertise

MLOps & AI Infrastructure data science & analytics

Skills

python sql docker aws mlflow fastapi

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile