Profile cover
F

Big Data Engineer — Hadoop & Spark Migration

Finn Larsen

Freelance · Senior

No longer accepting applications

About the role

We run a large Hadoop cluster that's expensive, slow to maintain, and blocking our data team. We want to migrate our batch processing workloads to Databricks (Spark on Azure) over 4 months. We need a senior data engineer to lead the migration. You'll inventory our current jobs, rewrite the critical ones in PySpark, set up Databricks workflows, and validate output parity. You won't be working alone — we have two internal engineers supporting you — but you'll drive the technical decisions.

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & Industrialisation MLOps & AI Infrastructure

Skills

hadoop spark kafka python sql

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Backend Engineer, Platform

RemoteAI company

Full-time

Staff Data Scientist - Product Analytics

RemoteAI company

Full-time Staff

Data Engineer

RemoteAI company

Full-time

Drone Platform Integration & Network Support Engineer

RemoteAI company

Full-time

Senior Autonomy Engineer, Data Curation

RemoteAI company

Full-time Senior

Technical Writer

RemoteAI company

Part-time

Contract Type

Hourly rate

Level

Senior

Budget Range

$70 – $100 / hour

Duration

4 months

AI Expertise

MLOps & Industrialisation MLOps & AI Infrastructure

Skills

hadoop spark kafka python sql etl databricks

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile