Profile cover
N

AI Fairness Metrics Engineer

Noah Kovacs

Full-time · Job · London

About the role

Fairness means different things in different contexts. Demographic parity matters for hiring. Calibration matters for risk scoring. Equal opportunity matters for lending. Our fairness metrics platform helps clients choose the right fairness criteria for their use case and measure their models against those criteria continuously. You'll build the metrics engine: implementing 15+ fairness metrics with proper statistical testing, designing the dashboard that visualizes fairness across protected attributes and model versions, creating automated alerts when fairness metrics degrade, and building the recommendation system that suggests remediation strategies based on the specific type of unfairness detected. Fairness metrics involve deep statistical subtleties. Some metrics are mathematically incompatible — you can't achieve demographic parity and calibration simultaneously except in trivial cases. You'll need to help clients understand these tradeoffs and choose metrics that align with their ethical and regulatory obligations.

Responsibilities

  • Implement 15+ fairness metrics with proper statistical significance testing
  • Design fairness visualization dashboards across protected attributes and model versions
  • Create automated alerts for fairness metric degradation in production
  • Build remediation recommendation systems based on detected unfairness types
  • Educate clients on fairness metric tradeoffs and selection criteria

Requirements

  • 5+ years in ML fairness, responsible AI, or statistical auditing
  • Strong scikit-learn and Python skills for metric implementation
  • Deep statistical expertise for significance testing and bias analysis
  • Experience explaining fairness concepts to non-technical stakeholders
  • Understanding of regulatory fairness requirements across industries

Benefits

  • Hybrid — London office 2 days/week
  • Senior compensation with equity
  • $3,500 ethics and fairness conference budget
  • Defining how organizations measure and achieve AI fairness

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI & Machine Learning Engineers data science & analytics

Skills

python scikit-learn pytorch statistics sql

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior AI Researcher- Pre-training (f/m/d)

RemoteAI company

Full-time Senior

Technical Writer

RemoteAI company

Part-time

AI Resident UK/EMEA

RemoteAI company

Full-time

Senior AI R&D Engineer – Model Training (f/m/d)

RemoteAI company

Full-time Senior

Senior Machine Learning Engineer (Clinical Team)

RemoteAI company

Full-time Senior

Conversational Modelling Research Engineer

RemoteAI company

Full-time

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

AI & Machine Learning Engineers data science & analytics

Skills

python scikit-learn pytorch statistics sql pandas

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile