Profile cover
N

Junior AI Deployment Health Scoring Developer

Yalvex AI

Remote · Under $60k / year · Freelance · Posted 4 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

After a model deployment completes, something important happens: the deployment either stabilizes successfully or it starts showing signs of trouble. Error rate climbs slightly. Latency p99 drifts upward. Throughput drops. Memory footprint grows. None of these signals alone triggers an alert threshold, but together they describe a deployment that is going wrong slowly. Deployment health scoring — aggregating multiple post-deployment health signals into a composite score that reflects overall deployment stability — is how SRE teams catch slow failures before they become incidents. This is a freelance role — 20 hours per week. Our deployment platform manages 350 active model deployments. We have individual metric alerts. What we don't have is the composite health score that synthesizes them: a single number per deployment that reflects overall health and trends in the right direction — going down means something is getting worse, even if no individual metric has breached its alert threshold yet. As a junior developer, you'll build the deployment health scoring pipeline under senior SRE engineer supervision: collecting post-deployment metrics, computing composite health scores, and building the health score monitoring dashboard that deployment engineers use to spot slow degradation.

Fully remote.

Responsibilities

  • Build post-deployment metric collection pipeline ingesting error rates, latency distributions, and throughput signals
  • Implement composite health score computation weighting and aggregating multi-metric deployment signals
  • Develop health score trend analysis detecting gradual degradation before individual metric alerts fire
  • Create health score monitoring dashboard showing score history per deployment with drill-down to contributing signals
  • Build health score alerting when composite score drops below healthy threshold or declines sharply
  • Maintain scoring pipeline as new deployment types and metric sources are added

Requirements

  • 1+ year of Python and SQL development experience
  • Basic familiarity with metrics, monitoring systems, or Kubernetes
  • Interest in MLOps, SRE, or deployment platform engineering
  • Attention to signal weighting accuracy and composite score interpretability
  • Reliable async communication for a freelance engagement

Benefits

  • Fully remote freelance — 20 hours per week
  • Flexible schedule
  • Competitive hourly rate
  • Mentorship from senior SRE engineers
  • Potential to expand scope

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure Automation & AI Workflows

Skills

python sql pandas docker fastapi

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Principal Engineer Team Lead, Behavior Safety & Metrics

Motional

Full-time Principal

Materials Lead

Lambda

Full-time Lead

Sr. Solutions Architect - Travel and Hospitality

Databricks

Full-time Senior

Software Engineering Manager, AI Migrations

Snowflake

Full-time

Senior Software Engineer - Full Stack - Portal Platform

Abnormal Security

Full-time Senior

Product Manager, Store

Apify

Full-time

Job Type

Freelance

Level

Junior

Language

English

Salary Range

Under $60k / year

AI Expertise

MLOps & AI Infrastructure Automation & AI Workflows

Skills

python sql pandas docker fastapi statistics

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free account & apply Log in

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile