Profile cover
R

AI Labeler Fatigue Detection Engineer

Jaltrix Data

Remote · Under $60k / year · Full-time · Posted 3 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

Our annotation consensus and active learning tools already catch when labelers disagree with each other, but nobody catches when a single labeler's own quality quietly drops three hours into a long shift. Consensus agreement between two tired labelers can look fine even when both are making more mistakes than usual. This role builds a detection layer that watches individual labeler accuracy trends over the course of a shift and flags fatigue before it shows up in delivered data quality.

Fully remote.

Responsibilities

  • Track individual labeler accuracy trends across shift duration
  • Build statistical models flagging likely fatigue-driven quality drops
  • Work with workforce operations to validate flagged fatigue patterns
  • Support rollout of break recommendations based on model output

Requirements

  • Some experience with SQL and time-series data analysis
  • Basic statistics background for trend detection
  • Interest in data quality and workforce operations problems
  • Comfortable working with sensitive workforce performance data

Benefits

  • Fully remote entry-level role
  • Structured mentorship program
  • Health insurance included
  • Clear growth path to mid-level analyst

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

Data Science & Analytics Automation & AI Workflows

Skills

python sql statistics pandas

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Revenue Operations Manager

Handshake

Full-time

Materials Lead

Lambda

Full-time Lead

Sr. Solutions Architect - Travel and Hospitality

Databricks

Full-time Senior

Senior Security Engineer - Detection & Response

Lambda

Full-time Senior

Lead/ Senior Machine Learning Scientist, Integrative Phenotyping

insitro

Full-time Lead

Solutions Engineer, Canada

Glean

Full-time

Job Type

Full-time

Level

Junior

Language

English

Salary Range

Under $60k / year

AI Expertise

Data Science & Analytics Automation & AI Workflows

Skills

python sql statistics pandas

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free account & apply Log in

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile