Profile cover
E

AI Spot Instance Bidding Strategist

Evan Ferrari

Freelance · Job · New_York

About the role

Spot instances save 70-90% on GPU costs, but they get terminated with 2 minutes notice. For batch training jobs that run for hours, a termination at 95% completion wastes everything. Our bidding system predicts spot availability windows, schedules checkpointing around likely interruptions, and automatically migrates workloads across instance types and availability zones. The prediction models use historical spot pricing data, capacity signals from cloud provider APIs, and temporal patterns (spot availability follows surprisingly predictable daily and weekly cycles). Your job is making these predictions accurate enough that our clients save 65%+ versus on-demand pricing while experiencing fewer than 3% job failures from spot terminations. This is a 6-month freelance engagement. You'll have access to 18 months of historical spot pricing data across 40 GPU instance types, plus real-time API feeds. The infrastructure team will handle deployment; you focus on the prediction and bidding strategy models.

Responsibilities

  • Build spot instance availability prediction models from historical pricing data
  • Design bidding strategies that balance cost savings against termination risk
  • Implement checkpointing schedulers triggered by termination probability
  • Create workload migration logic across instance types and availability zones
  • Evaluate strategy performance against cost savings and failure rate targets
  • Document model architecture for knowledge transfer at engagement end

Requirements

  • 5+ years in cloud infrastructure or ML with AWS cost optimization experience
  • Strong statistical modeling skills for time series prediction
  • Deep understanding of AWS spot instance mechanics and pricing
  • Proficiency in Python for data analysis and model development
  • Experience with GPU workload management and scheduling

Benefits

  • Fully remote freelance engagement
  • Competitive hourly rate
  • Access to proprietary historical pricing dataset
  • Flexible schedule
  • Potential for ongoing advisory relationship

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure data science & analytics

Skills

python aws statistics sql docker

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Drone Platform Integration & Network Support Engineer

RemoteAI company

Full-time

Technical Writer

RemoteAI company

Part-time

Principal Engineer

RemoteAI company

Full-time Principal

Staff Application Security Engineer

RemoteAI company

Full-time Staff

AI Resident UK/EMEA

RemoteAI company

Full-time

Job Type

Freelance

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

MLOps & AI Infrastructure data science & analytics

Skills

python aws statistics sql docker pandas

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile