Profile cover
P

AI Genomics Data Engineer

Paisley Suzuki

Full-time · Job · Los_Angeles

About the role

Genomic datasets are massive, messy, and growing exponentially. A single whole-genome sequencing run produces 200GB of raw data, and we process 400 runs per week across our pharma partners. The pipelines that transform raw reads into analysis-ready variant calls need to be bulletproof, because downstream ML models for drug target identification depend entirely on data quality. You'll join a data engineering team of five, responsible for ingestion, transformation, and quality assurance of multi-omics data. The stack is primarily Python and Spark on AWS, orchestrated with Airflow. Your immediate priority is migrating our variant annotation pipeline from a batch process that takes 14 hours to a streaming architecture that delivers results in under 2 hours. No genomics background required — we'll teach you the biology. What we need is someone who knows how to build data pipelines that don't break at 3 AM.

Responsibilities

  • Build and maintain data pipelines for genomic and multi-omics datasets
  • Migrate batch processing workflows to streaming architectures
  • Implement data quality checks and automated validation frameworks
  • Optimize Spark jobs for cost and performance on AWS EMR
  • Design data models that support downstream ML feature engineering
  • On-call rotation for pipeline monitoring — one week per month

Requirements

  • 3+ years building data pipelines with Python, Spark, and SQL
  • Experience with workflow orchestration tools like Airflow or Prefect
  • Solid understanding of AWS services: S3, EMR, Glue, Lambda
  • Comfort working with large datasets in the terabyte range
  • Ability to write clean, tested, documented code

Benefits

  • Fully remote with flexible hours
  • Health, dental, and vision coverage
  • 401(k) with 4% match
  • $3,000 annual professional development budget
  • Quarterly team retreats in different cities

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$100k – $130k / year

AI Expertise

data science & analytics MLOps & AI Infrastructure

Skills

python spark sql aws airflow pandas

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile