Profile cover
D

AI Kubernetes Multi-Tenant Cost Attribution Developer

David Dubois

Full-time · Job · Los_Angeles

About the role

Our platform runs 14,000 ML training jobs per month across a Kubernetes cluster shared by 38 product teams. Every job burns GPU hours that cost real money, but right now nobody can tell you exactly which team, product, or engineer is responsible for which charge. We have cost totals. We don't have cost ownership. You'll build the attribution system: instrumenting job schedulers with team-level tagging, building the aggregation pipeline that maps resource consumption back to cost centers, and creating dashboards that let engineering managers see their team's spend in real time. When a data scientist accidentally submits a 96-GPU job for a 30-minute experiment, your system will make that visible before it becomes a $4,000 surprise on the monthly bill. The infrastructure team is six engineers. You'll own this project end-to-end: design, build, instrument, and ship. The target is reducing unattributed compute spend from 31% to under 5%.

Responsibilities

  • Design and implement resource cost attribution for Kubernetes ML workloads
  • Instrument job schedulers with team-level metadata tagging
  • Build aggregation pipelines mapping GPU/CPU consumption to cost centers
  • Create real-time cost dashboards for engineering managers
  • Set up alerting for runaway jobs that exceed budget thresholds
  • Work with finance to align attribution model with chargeback requirements

Requirements

  • 3+ years working with Kubernetes in a production environment
  • Experience with cloud cost management and FinOps tooling
  • Proficiency in Python and SQL for data pipeline development
  • Familiarity with resource tagging strategies and cluster observability
  • Ability to translate infrastructure data into actionable business insights

Benefits

  • Fully remote with async-first culture
  • $4,000 annual cloud certification budget
  • Health, dental, and vision insurance
  • Flexible PTO with 3-week minimum
  • Annual team offsite

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure data science & analytics

Skills

python kubernetes docker aws sql

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

AI Resident UK/EMEA

RemoteAI company

Full-time

Devops Engineer, US

RemoteAI company

Full-time

Infrastructure Engineer

RemoteAI company

Full-time

Senior AI R&D Engineer – Model Training (f/m/d)

RemoteAI company

Full-time Senior

Software Engineer, Infrastructure

RemoteAI company

Full-time

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$100k – $130k / year

AI Expertise

MLOps & AI Infrastructure data science & analytics

Skills

python kubernetes docker aws sql airflow

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile