Profile cover
E

AI Model Optimization Engineer

Evan Ferrari

Freelance · Job · New_York

About the role

Our clients' models work. They're just too expensive to run. A single inference call costs $0.12 when it should cost $0.003. Latency is 800ms when the product needs 200ms. GPU utilization is 30% when it should be 85%. That's the gap you'll close. We're a consulting firm that specializes in ML model optimization. Each engagement is scoped: audit the model and serving infrastructure, identify the biggest optimization levers, implement changes, and measure the impact. Typical engagements produce 5-10x cost reduction and 3-5x latency improvement. This is freelance work with a steady engagement pipeline. We need someone who can quantize models without destroying accuracy, optimize batch processing for GPU throughput, and redesign serving architectures for cost efficiency. If you've ever looked at an AWS bill for GPU instances and thought 'I can fix that,' we want you.

Responsibilities

  • Audit client model serving infrastructure for cost and performance optimization
  • Implement model quantization and pruning without accuracy degradation
  • Redesign serving architectures for cost efficiency and lower latency
  • Optimize GPU utilization through batching and scheduling improvements
  • Deliver measurable cost and latency improvements per engagement

Requirements

  • 5+ years in ML engineering with model optimization experience
  • Deep PyTorch and TensorFlow skills including quantization techniques
  • Experience with ONNX, TensorRT, or similar optimization frameworks
  • Kubernetes and AWS expertise for serving infrastructure
  • Track record of measurable cost or latency improvements

Benefits

  • Freelance with steady engagement pipeline
  • Fully remote
  • Premium consulting rates
  • Diverse client exposure across industries

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI & Machine Learning Engineers MLOps & AI Infrastructure

Skills

python pytorch tensorflow docker aws

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

AI Resident UK/EMEA

RemoteAI company

Full-time

Senior AI Researcher- Pre-training (f/m/d)

RemoteAI company

Full-time Senior

Senior AI R&D Engineer – Model Training (f/m/d)

RemoteAI company

Full-time Senior

Devops Engineer, US

RemoteAI company

Full-time

AI Engineer

RemoteAI company

Full-time

Job Type

Freelance

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

AI & Machine Learning Engineers MLOps & AI Infrastructure

Skills

python pytorch tensorflow docker aws kubernetes

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile