Profile cover
A

AI Multi-Tenant Serverless Isolation Engineer

Covex Cloud

Remote · $200k+ / year · Freelance · Posted 3 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

You'll be the second infrastructure specialist on a lean four-person platform team, working directly with our CTO to solve a problem that's been quietly getting worse as we onboard bigger clients. Covex Cloud runs serverless ML inference for multiple enterprise tenants on shared infrastructure, and as tenant count has grown, resource contention between tenants has started causing latency spikes that shouldn't be possible with proper isolation. This is a freelance engagement to design and implement stronger tenant isolation at the container and scheduling level, across both GCP and AWS deployments, with a clear scope and defined deliverable rather than an open-ended retainer.

Fully remote.

Responsibilities

  • Design stronger multi-tenant isolation at the container and scheduling level
  • Implement isolation improvements across GCP and AWS deployments
  • Diagnose and resolve current cross-tenant latency contention issues
  • Document isolation architecture for the platform team
  • Hand off implementation with clear operational runbooks

Requirements

  • Deep Kubernetes and Docker expertise, especially around multi-tenancy
  • Experience with both GCP and AWS serverless infrastructure
  • Track record diagnosing resource contention in shared systems
  • Available for a defined-scope freelance engagement
  • Comfort working directly with executive stakeholders

Benefits

  • Freelance engagement with clear defined scope
  • Competitive project-based rate
  • Fully remote
  • Direct access to CTO and platform team
  • Potential for follow-on engagements

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure

Skills

python docker kubernetes gcp aws

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Security Engineer - Detection & Response

Lambda

Full-time Senior

Solutions Engineer, Canada

Glean

Full-time

Senior Data Engineer, Data Analytics

Agility Robotics

Full-time Senior

Sr. Solutions Architect - Travel and Hospitality

Databricks

Full-time Senior

Research Engineer / Scientist, Pre-training

Anthropic

Full-time

Principal Engineer, Data Platform

AlphaSense

Full-time Principal

Job Type

Freelance

Level

Senior

Language

English

Salary Range

$200k+ / year

AI Expertise

MLOps & AI Infrastructure

Skills

python docker kubernetes gcp aws

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free account & apply Log in

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile