Profile cover
E

AI Model Serving Cost Attribution Developer

Ellie Petrov

Full-time · Job · Los_Angeles

About the role

Xivio Solutions manages GPU cluster infrastructure for enterprise ML teams, and one of the most common questions our clients ask is: which team, product, or model is actually responsible for our inference bill? Right now, cost attribution for model serving is either nonexistent or entirely manual. We're building the automated layer. In this mid-level role, you'll build the cost attribution pipeline that tracks compute consumption at the model, endpoint, and request level, then allocates those costs back to business units and ML product teams. You'll instrument model serving endpoints, build the aggregation and allocation logic, and deliver the cost reporting outputs that engineering leaders use for FinOps decisions. You'll join a cross-functional squad with MLOps engineers and finance analysts who will help you understand the business requirements behind cost attribution. Clear sprint cadence, structured code reviews, and a 12-month path to senior ML infrastructure engineer are all part of the package.

Responsibilities

  • Instrument model serving endpoints for compute consumption tracking at request level
  • Build cost aggregation and business-unit allocation logic
  • Develop cost reporting dashboards for FinOps and engineering leadership
  • Own the Airflow-based pipeline that generates daily cost attribution reports
  • Collaborate with finance team to define allocation methodologies

Requirements

  • 3+ years data or ML infrastructure engineering experience
  • Strong Python, SQL, and Kubernetes skills
  • Familiarity with cloud cost concepts and FinOps principles
  • Experience with MLflow or similar experiment tracking platforms
  • Ability to translate technical metrics into business-legible cost reports

Benefits

  • Fully remote
  • Health, dental, and vision insurance
  • Clear promotion path to senior engineer
  • $1,500 annual learning budget
  • Equity in a growing ML infrastructure company

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$80k – $100k / year

AI Expertise

MLOps & AI Infrastructure data science & analytics

Skills

python sql airflow mlflow kubernetes

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile