AI Model Serving Cold Start Latency Engineer
David Dubois
Full-time · Job · Los_Angeles
Trust & safety
Report this job
Help us review suspicious or misleading job posts. Your report goes directly to RemoteAI.
Report submitted
Thanks for flagging this. RemoteAI can review suspicious job posts and take action when needed.
One step away
Apply for
AI Model Serving Cold Start Latency Engineer
at David Dubois
Create your free profile in under 2 minutes.
Create your free profile
Less than 2 minutes — no credit card, no commitment.
AI matches you to the role
Your skills are automatically matched against the job requirements.
Apply in one click
Submit your application instantly. The company is notified right away.
About the role
Responsibilities
- Redesign container pre-warming strategy to reduce model serving cold start latency
- Build scheduling logic that balances latency targets against GPU cost
- Benchmark cold start performance across AWS and GCP GPU instance types
- Partner with customer-facing teams to align latency targets with SLAs
Requirements
- 5+ years of experience with Kubernetes-based infrastructure at scale
- Deep understanding of container scheduling and GPU resource management
- Experience with multi-cloud deployments across AWS and GCP
- Track record of reducing latency in production ML serving systems
Benefits
- Fully remote position
- Meaningful equity post-Series B
- Health, dental, and vision coverage
- Annual infrastructure conference budget
- 401k matching
Keep exploring related roles
Use these topic pages to discover more roles in the same hiring cluster.
Skills
Related remote AI jobs
Nearby roles that share similar skills, categories, or hiring intent.
Senior Product Security Engineer
RemoteAI company
Staff Application Security Engineer
RemoteAI company
AI Resident UK/EMEA
RemoteAI company
Principal Engineer
RemoteAI company
Senior AI R&D Engineer – Model Training (f/m/d)
RemoteAI company
Drone Platform Integration & Network Support Engineer
RemoteAI company
Job Type
Full-time
Level
Senior
Language
English
Salary Range
$160k – $200k / year
AI Expertise
Skills
Ready to apply for this role?
Create a free talent account in under 2 minutes.
- Apply to verified AI companies
- Get AI-matched job recommendations
- Message hiring managers directly
- Build your public AI talent profile
Interested in this role? Create your free profile to apply.
Apply — create free profile