Profile cover
E

AI Model Serving Cost Attribution Developer

Xivio Solutions

Remote · $80k – $100k / year · Full-time · Posted 4 months ago

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

Xivio Solutions manages GPU cluster infrastructure for enterprise ML teams, and one of the most common questions our clients ask is: which team, product, or model is actually responsible for our inference bill? Right now, cost attribution for model serving is either nonexistent or entirely manual. We're building the automated layer. In this mid-level role, you'll build the cost attribution pipeline that tracks compute consumption at the model, endpoint, and request level, then allocates those costs back to business units and ML product teams. You'll instrument model serving endpoints, build the aggregation and allocation logic, and deliver the cost reporting outputs that engineering leaders use for FinOps decisions. You'll join a cross-functional squad with MLOps engineers and finance analysts who will help you understand the business requirements behind cost attribution. Clear sprint cadence, structured code reviews, and a 12-month path to senior ML infrastructure engineer are all part of the package.

Fully remote.

Responsibilities

  • Instrument model serving endpoints for compute consumption tracking at request level
  • Build cost aggregation and business-unit allocation logic
  • Develop cost reporting dashboards for FinOps and engineering leadership
  • Own the Airflow-based pipeline that generates daily cost attribution reports
  • Collaborate with finance team to define allocation methodologies

Requirements

  • 3+ years data or ML infrastructure engineering experience
  • Strong Python, SQL, and Kubernetes skills
  • Familiarity with cloud cost concepts and FinOps principles
  • Experience with MLflow or similar experiment tracking platforms
  • Ability to translate technical metrics into business-legible cost reports

Benefits

  • Fully remote
  • Health, dental, and vision insurance
  • Clear promotion path to senior engineer
  • $1,500 annual learning budget
  • Equity in a growing ML infrastructure company

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$80k – $100k / year

AI Expertise

MLOps & AI Infrastructure Data Science & Analytics

Skills

python sql airflow mlflow kubernetes

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile