Profile cover
R

Junior AI Label Disagreement Review Analyst

Ruby Santos

Part-time · Job · Sao_Paulo

About the role

As a fully async team spread across seven countries, we hire for clear writing and careful thinking before anything else. Jaltrix Data runs annotation programs for companies training vision and language models, and when annotators disagree, someone has to work out why. This part-time role (around 20 hours a week) is that someone. You'll review items with low agreement, decide whether the guideline is unclear or the item is genuinely ambiguous, and write up patterns that help our project leads fix instructions before errors spread. You'll also run simple agreement statistics in Python. Great for a student or early-career analyst who wants hands-on exposure to how training data is really made.

Responsibilities

  • Review low-agreement annotation batches and classify the root cause of each disagreement
  • Compute inter-annotator agreement metrics and track them per project
  • Write short, clear notes proposing guideline changes to project leads
  • Flag items that should be removed from training sets entirely

Requirements

  • Basic Python and pandas; some SQL is helpful
  • Understanding of simple statistics such as Cohen's kappa or percentage agreement
  • Excellent written English and attention to detail
  • Available around 20 hours a week with flexible scheduling

Benefits

  • Part-time, flexible hours
  • Fully remote
  • Paid training during your first two weeks
  • Path to full-time analyst roles

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

data science & analytics

Skills

python pandas statistics sql

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Principal Software Engineer, Team Lead - Perception Platforms

RemoteAI company

Full-time Principal

Senior Software Enginer, Data and Integrations

RemoteAI company

Full-time Senior

Senior AI/ML Architect, Applied Field Engineering

RemoteAI company

Full-time Senior

Research Engineer, Post-Training

RemoteAI company

Full-time

Research Staff, Applied Voice AI

RemoteAI company

Full-time Staff

Lead Site Reliability engineer - Network infrastructure - APAC

RemoteAI company

Full-time Lead

Job Type

Part-time

Level

Junior

Language

English

Salary Range

Under $60k / year

AI Expertise

data science & analytics

Skills

python pandas statistics sql

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to AI roles in one place
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile