Site Reliability Engineer — ML Workloads

NordBot AI

Remote · $130k – $170k / year · Full-time · Posted 9 months ago

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

We serve 10M+ ML predictions per day and our on-call rotation is a disaster. Right now when something goes wrong at 2am, the engineer on call has no runbooks, no clear SLOs, and ends up pinging Slack until they find someone who knows what the thing does. We need an SRE who has worked on ML inference systems and knows the specific failure modes — model staleness, latency spikes from queue buildup, GPU memory pressure, etc. The first 90 days would be: define SLOs that actually mean something, get alerting out of 'alert on everything' mode, and write runbooks so the on-call engineer isn't flying blind. This is less about keeping servers alive and more about building the processes and tooling that let us sleep at night.

Fully remote.