Profile cover
B

AI Cross-System Data Reconciliation Engineer

Benjamin Leclerc

Freelance · Job · London

About the role

You'd join a team of 6 data engineers who've spent three years building streaming data pipelines for cloud-native companies. The infrastructure is solid. The new problem: as our clients connect more data sources, reconciling the same business entity across systems (CRM, ERP, data warehouse, event stream) is becoming a full-time job for their analysts. This freelance role is focused on building an AI-assisted reconciliation layer. The system ingests entity records from multiple source systems, applies fuzzy matching and ML-based deduplication, and surfaces conflicts for human review when confidence is low. It's an excellent first data engineering project with a meaningful technical challenge — cross-system entity resolution is genuinely hard — and a great team to learn from. You'll have structured weekly check-ins, clear deliverables, and full access to the data engineering stack.

Responsibilities

  • Implement ML-based fuzzy matching for cross-system entity deduplication
  • Build the reconciliation pipeline to surface conflicting entity records for review
  • Design confidence scoring for automated vs. human-review routing
  • Maintain Airflow DAGs for scheduled reconciliation runs
  • Produce documentation for handoff to client data teams

Requirements

  • 1–2 years of data engineering or data science experience
  • Python and SQL proficiency
  • Familiarity with fuzzy matching techniques (Levenshtein, blocking, ML-based dedup)
  • Comfortable working in async, documentation-driven environments

Benefits

  • Negotiable rate (competitive with junior contractor market)
  • Fully remote, flexible hours
  • Mentorship from senior data engineers
  • Option to convert to full-time at end of engagement

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure data science & analytics

Skills

python sql airflow spark snowflake

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Backend Engineer, Platform

RemoteAI company

Full-time

Technical Writer

RemoteAI company

Part-time

Business Operations Lead

RemoteAI company

Full-time Lead

Principal Engineer

RemoteAI company

Full-time Principal

AI Resident UK/EMEA

RemoteAI company

Full-time

Job Type

Freelance

Level

Junior

Language

English

Salary Range

Negotiable / Competitive

AI Expertise

MLOps & AI Infrastructure data science & analytics

Skills

python sql airflow spark snowflake docker statistics

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile