Profile cover
R

AI Annotator Skill-to-Task Matching Engine Developer

Jaltrix Data

Remote · $100k – $130k / year · Full-time · Posted 3 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

Our active learning sampling and consensus algorithms pick the right examples to label, but right now any available annotator can be assigned any task, even when their historical accuracy on that task type is poor. You will build a matching engine that routes labeling tasks to annotators based on demonstrated skill per task category, improving label quality without adding review overhead. You'll work closely with our labeler fatigue detection team, since task routing needs to balance skill matching against workload distribution to avoid burning out your best annotators.

Responsibilities

  • Build a task routing engine matching labeling tasks to annotator skill profiles
  • Maintain Airflow pipelines that keep skill profiles updated from recent labeling outcomes
  • Coordinate with the fatigue detection team to balance skill matching against workload
  • Validate routing improvements against downstream label quality metrics
  • Document routing logic for the annotation operations team

Requirements

  • 3+ years building workflow or task-routing systems
  • Strong Python skills and experience with ETL pipelines
  • Comfortable orchestrating jobs with Airflow
  • Experience with human-in-the-loop or crowdsourced labeling systems a plus

Benefits

  • Fully remote position
  • Health insurance
  • Equity package
  • Flexible working hours across time zones

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

Automation & AI Workflows

Skills

python etl airflow

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Research Engineer / Scientist, Pre-training

RemoteAI company

Full-time

Senior Flight Test Engineer - Software Automation

RemoteAI company

Full-time Senior

Revenue Operations Manager

RemoteAI company

Full-time

AI Security Engineer Intern (Summer 2027)

RemoteAI company

Full-time Intern

AI Product Engineer Intern (Summer 2027)

RemoteAI company

Full-time Intern

AI Platform Engineer Intern (Summer 2027)

RemoteAI company

Full-time Intern

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$100k – $130k / year

AI Expertise

Automation & AI Workflows

Skills

python etl airflow

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free account & apply Log in

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile