Profile cover
M

AI Human-in-the-Loop Orchestration Engineer

Quelva Works

Remote · $130k – $160k / year · Full-time · Posted 4 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

Quelva Works builds workflow automation tools used by enterprise operations teams in insurance, financial services, and healthcare. In these industries, full automation isn't always safe — some decisions need a human in the loop. But manual review bottlenecks are exactly what kills automation ROI. As the AI Human-in-the-Loop Orchestration Engineer, you'll build the orchestration layer that intelligently routes tasks between automated AI decisions and human reviewers. You'll design confidence thresholds, escalation logic, reviewer queue management, and the audit trail infrastructure that regulators require. You'll also build feedback mechanisms that let human decisions improve model confidence over time. This is a senior role with significant system design responsibility. You'll collaborate with ML engineers who own the underlying models and with enterprise clients who define the compliance requirements. We run a mature engineering process with strong code review culture and documented architecture decision records.

Fully remote.

Responsibilities

  • Design and implement task routing logic between automated AI decisions and human review queues
  • Build confidence threshold and escalation frameworks
  • Develop reviewer queue management and SLA enforcement systems
  • Own the audit trail and decision logging infrastructure
  • Build feedback loops that surface human decision signals back to model training pipelines

Requirements

  • 5+ years software or ML infrastructure engineering
  • Experience designing workflow orchestration systems
  • Strong Python skills with FastAPI and Airflow
  • Familiarity with audit and compliance requirements in regulated industries
  • System design experience with a focus on reliability and explainability

Benefits

  • Fully remote
  • Equity in a profitable, growing company
  • Health, dental, and vision
  • $4,000 annual professional development budget
  • Flexible PTO policy

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

Automation & AI Workflows MLOps & AI Infrastructure

Skills

python airflow fastapi docker kubernetes

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

AI Security Engineer Intern (Summer 2027)

Brainco

Full-time Intern

Software Engineer, Infrastructure

Niantic Spatial

Full-time

Research Engineer / Scientist, Pre-training

Anthropic

Full-time

Software Engineer - AI Tooling Infrastructure

Supabase

Full-time

AI Platform Engineer Intern (Summer 2027)

Brainco

Full-time Intern

Senior Infrastructure Engineer

Harvey

Full-time Senior

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

Automation & AI Workflows MLOps & AI Infrastructure

Skills

python airflow fastapi docker kubernetes

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free account & apply Log in

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile