Profile cover
L

AI Data Platform Engineer

Lyrex Data

Remote · $200k+ / year · Full-time · Posted 2 months ago

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

Have you ever wanted to build the platform other data teams build on top of, instead of shipping one more one-off pipeline? Our data mesh architecture depends on a small platform team getting the foundations right. You'll extend our Databricks and Spark-based platform to support real-time ingestion through Kafka, giving domain teams a self-service way to publish and consume data products without waiting on a central team for every change. You'll join a cross-functional squad with defined sprints, clear ownership boundaries between domains, and weekly syncs with the data mesh architecture lead to keep platform decisions aligned.

Fully remote.

Responsibilities

  • Extend the data platform to support real-time Kafka ingestion
  • Build self-service tooling for domain teams to publish data products
  • Maintain platform reliability across Databricks and Spark workloads
  • Align platform decisions with the data mesh architecture lead

Requirements

  • 6+ years of experience building data platforms at scale
  • Deep Databricks, Spark, and Kafka expertise
  • Strong AWS background
  • Experience supporting a data mesh or domain-oriented architecture

Benefits

  • Fully remote position
  • Top-of-market compensation
  • Equity package
  • Unlimited PTO

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$200k+ / year

AI Expertise

MLOps & AI Infrastructure Data Science & Analytics

Skills

python spark databricks kafka aws

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile