Profile cover
A

AI Model Self-Assessment Calibration Researcher

Velvix Labs

Remote · $200k+ / year · Full-time · Posted 1 month ago

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

As a fully async research team spread across multiple continents, we believe rigorous calibration work doesn't require anyone to be in the same building — just the same evidence bar. You'll research and build methods that improve how accurately models report their own confidence, closing the gap between stated certainty and actual correctness across a range of reasoning tasks. Your findings will directly inform safety evaluation standards used across our model releases.

Fully remote.

Responsibilities

  • Design experiments measuring model confidence calibration across tasks
  • Own calibration methodology from research to internal tooling
  • Partner with evaluation teams to integrate findings into release checks
  • Publish internal reports and contribute to external research where relevant

Requirements

  • PhD or equivalent research experience in ML or a related field
  • Strong background in statistics and model evaluation methodology
  • Experience with calibration, uncertainty quantification, or related research
  • Comfortable working async across time zones

Benefits

  • Fully remote, fully async
  • Top-of-market salary + equity
  • Health and dental insurance
  • Conference travel and publication support

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$200k+ / year

AI Expertise

AI & Machine Learning Engineers

Skills

python pytorch statistics reinforcement learning

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile