Profile cover
Y

ML Engineer — Distributed Training Setup (Multi-GPU)

Yemi Adeyemi

Contract · Senior

No longer accepting applications

This role is no longer accepting applications

Similar open roles you can apply to now:

See all open AI jobs

About the role

We're training large transformer models (7B–30B parameters) and our training setup is inefficient. Single-machine multi-GPU only. No FSDP, no ZeRO optimisation, no gradient checkpointing. We need an ML engineer to set up proper distributed training across our cluster (16 × H100 on GKE). Deliverables: working distributed training config using PyTorch FSDP, training speed benchmarks before and after, runbook for our research team. Bonus if you can also set up experiment tracking integration (we use Weights & Biases).

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure

Skills

pytorch python kubernetes docker gcp

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

AI Platform Engineer Co-Op Intern, Winter 2027

RemoteAI company

Full-time Intern

Platform Engineer - Compute

RemoteAI company

Full-time

Senior Software Engineer - Infrastructure - ClickPipes Platform

RemoteAI company

Full-time Senior

Solution Architect

RemoteAI company

Full-time

Site Reliability Engineer

RemoteAI company

Full-time

Sr. Staff Security Software Engineer - Agentic Security Engineering

RemoteAI company

Full-time Staff

Contract Type

Hourly rate

Level

Senior

Budget Range

$90 – $140 / hour

Duration

3 months

AI Expertise

MLOps & AI Infrastructure

Skills

pytorch python kubernetes docker gcp

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile