Profile cover
R

Senior Data Engineer

Ruby Santos

Full-time · Job · Los_Angeles

About the role

The pipelines you build will move the training data behind labeling workflows used by hundreds of annotators every day. We publish internally on data quality methodology and encourage engineers to bring in ideas from outside research. What we have already: a working annotation platform with real throughput. What's missing: a senior engineer to rebuild our batch processing layer so it can scale without falling over during peak labeling windows. Your role covers both the pipelines and the standards other engineers will follow.

Responsibilities

  • Rebuild batch processing layers for large-scale annotation data
  • Design ETL workflows that scale with labeling throughput
  • Set data engineering standards followed across the team
  • Optimize Spark jobs handling high annotation volumes
  • Partner with the ML team on data format requirements

Requirements

  • 6+ years building large-scale data pipelines
  • Strong SQL and Python skills
  • Deep experience with Spark and Hadoop ecosystems
  • Track record of designing ETL systems at scale
  • Comfortable owning technical standards for a team

Benefits

  • Fully remote position
  • Competitive salary + equity
  • Health and dental insurance
  • Unlimited PTO
  • Annual learning stipend

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

data science & analytics

Skills

python sql spark hadoop etl

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Autonomy Engineer, Data Curation

RemoteAI company

Full-time Senior

Backend Engineer, Platform

RemoteAI company

Full-time

Technical Writer

RemoteAI company

Part-time

Software Engineer, Applications (Scientific Development Solutions) (High Seniority)

RemoteAI company

Full-time Senior

PhD Autonomy Engineer Intern - Computer Vision / Deep Learning Summer 2027

RemoteAI company

Full-time Intern

Drone Platform Integration & Network Support Engineer

RemoteAI company

Full-time

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

data science & analytics

Skills

python sql spark hadoop etl

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile