Profile cover
P

ML Infrastructure Engineer — GPU Cost Optimisation

Paul Nguyen

Freelance · Senior

This role is no longer accepting applications

Similar open roles you can apply to now:

See all open AI jobs

About the role

Our ML training and inference costs went from $40k/month to $180k/month in 8 months. Nobody knows exactly why. We need an ML infra engineer to audit our GPU usage — what's running, what's idle, what's overprovisioned — and implement a cost reduction plan. Currently: mixed AWS (SageMaker training) and GCP (GKE serving). Training jobs run for weeks with no visibility into whether they're actually using the GPUs efficiently. Expected output: usage audit report, 3-month savings roadmap, and implementation of the top 5 quick wins.

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Contract Type

Hourly rate

Level

Senior

Budget Range

$100 – $150 / hour

Duration

2 months

AI Expertise

MLOps & AI Infrastructure

Skills

python kubernetes docker aws gcp

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile