Profile cover
A

AI Model Self-Assessment Calibration Researcher

Aria Watanabe

Full-time · Job · London

About the role

As a fully async research team spread across multiple continents, we believe rigorous calibration work doesn't require anyone to be in the same building — just the same evidence bar. You'll research and build methods that improve how accurately models report their own confidence, closing the gap between stated certainty and actual correctness across a range of reasoning tasks. Your findings will directly inform safety evaluation standards used across our model releases.

Responsibilities

  • Design experiments measuring model confidence calibration across tasks
  • Own calibration methodology from research to internal tooling
  • Partner with evaluation teams to integrate findings into release checks
  • Publish internal reports and contribute to external research where relevant

Requirements

  • PhD or equivalent research experience in ML or a related field
  • Strong background in statistics and model evaluation methodology
  • Experience with calibration, uncertainty quantification, or related research
  • Comfortable working async across time zones

Benefits

  • Fully remote, fully async
  • Top-of-market salary + equity
  • Health and dental insurance
  • Conference travel and publication support

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$200k+ / year

AI Expertise

AI & Machine Learning Engineers

Skills

python pytorch statistics reinforcement learning

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile