Profile cover
E

AI Workload Scheduling Optimization Engineer

Xivio Solutions

Remote · $80k – $100k / year · Freelance · Posted 5 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

GPU clusters are expensive. Idle GPUs are money on fire. Our workload scheduler decides which training jobs run on which GPUs, when to preempt low-priority work for urgent experiments, and how to bin-pack inference workloads to maximize utilization. The current scheduler uses heuristics that work at 200 jobs per day; we need an ML-based approach that works at 2,000. You'll build the prediction models that feed the scheduler: job runtime estimation, resource utilization forecasting, and priority scoring based on business impact. The scheduler itself is a constraint optimization system — your models provide the inputs that make its decisions intelligent rather than arbitrary. This is a 5-month freelance engagement, 30 hours per week. You'll work with the platform team who maintains the scheduler and the data science teams who submit the training jobs. Every scheduling improvement gets measured by cluster utilization rate and job queue wait time.

Fully remote.

Responsibilities

  • Build prediction models for job runtime and resource utilization
  • Design priority scoring algorithms based on business impact signals
  • Integrate ML predictions into the existing constraint-based scheduler
  • Evaluate scheduling quality through utilization and wait time metrics
  • Profile GPU cluster usage patterns to identify optimization opportunities
  • Document model architecture and training procedures for handoff

Requirements

  • 3+ years in ML or systems engineering with resource optimization experience
  • Understanding of GPU scheduling and cluster management concepts
  • Strong Python skills with experience in optimization or prediction tasks
  • Familiarity with Kubernetes resource management
  • Ability to work independently within a defined engagement scope

Benefits

  • Fully remote freelance role
  • Competitive hourly rate
  • Flexible hours within US West Coast overlap
  • Access to GPU cluster for development and testing
  • Potential follow-on engagement

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure AI & Machine Learning Engineers

Skills

python kubernetes docker aws sql

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Engineer, Exposure & Vulnerability Management

Recursion

Full-time Senior

Software Engineer

Turing

Full-time

Principal AI Security Engineer

Cerebras

Full-time Principal

Senior Product Analyst / Data Scientist

Nebius

Full-time Senior

Member of Technical Staff, ML Workload Platform

Cohere

Full-time Staff

Member of Technical Staff, ML Ops

Cohere

Full-time Staff

Job Type

Freelance

Level

Mid-Level

Language

English

Salary Range

$80k – $100k / year

AI Expertise

MLOps & AI Infrastructure AI & Machine Learning Engineers

Skills

python kubernetes docker aws sql statistics

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free profile and apply Log in

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile