Y

ML Engineer — Distributed Training Setup (Multi-GPU)

FinGrow AI

Remote · $90 – $140 / hour · Contract · Posted 6 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

We're training large transformer models (7B–30B parameters) and our training setup is inefficient. Single-machine multi-GPU only. No FSDP, no ZeRO optimisation, no gradient checkpointing. We need an ML engineer to set up proper distributed training across our cluster (16 × H100 on GKE). Deliverables: working distributed training config using PyTorch FSDP, training speed benchmarks before and after, runbook for our research team. Bonus if you can also set up experiment tracking integration (we use Weights & Biases).

Fully remote.

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure

Skills

pytorch python kubernetes docker gcp

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Research Engineer / Scientist, Pre-training

Anthropic

Senior Software Engineer - Full Stack - Portal Platform

Abnormal Security

Full-time Senior

Manager Security Engineer, Operations

Fivetran

Senior Security Engineer - Detection & Response

Lambda

Full-time Senior

Solutions Engineer, Canada

Glean

AI Researcher - Pre-training (f/m/d)

Aleph Alpha

Contract Type

Hourly rate

Level

Senior

Budget Range

$90 – $140 / hour

Duration

3 months

AI Expertise

MLOps & AI Infrastructure

Skills

pytorch python kubernetes docker gcp

Ready to apply for this role?

Create a free talent account.

Find AI roles in one place
Get AI-matched job recommendations
Reply to companies that message you
Build your public AI talent profile

Create free account & apply Log in

About FinGrow AI

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile

ML Engineer — Distributed Training Setup (Multi-GPU) is closed. Create your free profile to apply to similar open roles.

ML Engineer — Distributed Training Setup (Multi-GPU) is closed. Get matched to the next roles like it, and let companies contact you.

Log in Create free profile