Profile cover
J

Senior Data Engineer — Commerce Platform

Julien Moreau

Full-time · Senior · London

This role is no longer accepting applications

Similar open roles you can apply to now:

See all open AI jobs

About the role

We are an e-commerce platform for independent retailers in the UK and Ireland. We have 8,400 active merchant stores, 1.2 million registered buyers, and we processed £340 million in gross merchandise volume last year. We are not Amazon. We are not Shopify. We are a mid-size platform built around independent retail, and the data problems we deal with reflect the diversity of our merchant base — thousands of different product catalogues, pricing strategies, fulfilment configurations, and promotional mechanics that all have to be represented cleanly in our data layer. Our current data infrastructure was built by a team that is no longer with us. It works. Parts of it are genuinely well-built. Parts of it are held together by bash scripts and undocumented assumptions that exist only in the memory of people who wrote them three years ago and have since left. We are rebuilding those parts deliberately and carefully, and we are looking for a Senior Data Engineer to lead that work — specifically the migration of our order and transaction pipeline from a fragile custom ETL layer to a properly orchestrated, monitored, and documented dbt-based transformation stack on Snowflake.

Responsibilities

  • Lead the migration of the order and transaction pipeline from the legacy ETL layer to a dbt-based transformation stack on Snowflake
  • Build data quality monitoring and alerting that the analytics and finance teams can rely on for daily reporting
  • Document the full data architecture: source systems, transformation logic, output schemas, and operational runbooks
  • Define and enforce data engineering standards for the team: pipeline structure, testing requirements, and documentation process
  • Mentor one mid-level data engineer through the migration work

Requirements

  • 6+ years of data engineering with production ownership of complex pipelines serving high-transaction-volume e-commerce or marketplace data
  • Python for pipeline development, data quality automation, and tooling — clean, version-controlled, tested
  • SQL at expert level: complex transformations, query performance tuning, and the discipline to write SQL that reviewers can follow
  • Snowflake for cloud data warehousing — schema design, clustering, cost governance, and time travel for audit support
  • Airflow for orchestrating multi-step pipelines with dependency management, retry logic, and SLA alerting
  • ETL/ELT pipeline design: idempotency, incremental loading, and failure recovery in high-volume transaction data contexts
  • Familiarity with e-commerce data concepts: order lifecycle, returns, promotions, and inventory position is a genuine practical advantage

Benefits

  • $118,000 – $146,000 base salary
  • Full remote — our engineering team is distributed across the UK and Ireland
  • 25 days annual leave plus public holidays
  • $1,500 annual learning and conference budget
  • Employee discount on all merchant stores — which is more useful than it sounds given the range of what our merchants sell

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$118,000 – $146,000

AI Expertise

MLOps & AI Infrastructure

Skills

python sql snowflake airflow etl

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile