F

Big Data Engineer — Hadoop & Spark Migration

Nordic NLP

Remote · $70 – $100 / hour · Freelance · Posted 6 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

We run a large Hadoop cluster that's expensive, slow to maintain, and blocking our data team. We want to migrate our batch processing workloads to Databricks (Spark on Azure) over 4 months. We need a senior data engineer to lead the migration. You'll inventory our current jobs, rewrite the critical ones in PySpark, set up Databricks workflows, and validate output parity. You won't be working alone — we have two internal engineers supporting you — but you'll drive the technical decisions.

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure

Skills

hadoop spark kafka python sql

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Revenue Operations Manager

RemoteAI company

AI Platform Engineer Intern (Summer 2027)

RemoteAI company

Full-time Intern

AI Security Engineer Intern (Summer 2027)

RemoteAI company

Full-time Intern

Software Engineer, Infrastructure

RemoteAI company

Senior Infrastructure Engineer

RemoteAI company

Full-time Senior

Senior Infrastructure Engineer

RemoteAI company

Full-time Senior

Contract Type

Hourly rate

Level

Senior

Budget Range

$70 – $100 / hour

Duration

4 months

AI Expertise

MLOps & Industrialisation MLOps & AI Infrastructure

Skills

hadoop spark kafka python sql etl databricks

Ready to apply for this role?

Create a free talent account.

Find AI roles in one place
Get AI-matched job recommendations
Reply to companies that message you
Build your public AI talent profile

Create free account & apply Log in

About Nordic NLP

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile

Big Data Engineer — Hadoop & Spark Migration is closed. Create your free profile to apply to similar open roles.

Big Data Engineer — Hadoop & Spark Migration is closed. Get matched to the next roles like it, and let companies contact you.

Log in Create free profile