Profile cover
N

AI Fairness Metrics Engineer

Elara Intelligence

Hybrid · $130k – $160k / year · Full-time · Posted 5 months ago

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

Fairness means different things in different contexts. Demographic parity matters for hiring. Calibration matters for risk scoring. Equal opportunity matters for lending. Our fairness metrics platform helps clients choose the right fairness criteria for their use case and measure their models against those criteria continuously. You'll build the metrics engine: implementing 15+ fairness metrics with proper statistical testing, designing the dashboard that visualizes fairness across protected attributes and model versions, creating automated alerts when fairness metrics degrade, and building the recommendation system that suggests remediation strategies based on the specific type of unfairness detected. Fairness metrics involve deep statistical subtleties. Some metrics are mathematically incompatible — you can't achieve demographic parity and calibration simultaneously except in trivial cases. You'll need to help clients understand these tradeoffs and choose metrics that align with their ethical and regulatory obligations.

Responsibilities

  • Implement 15+ fairness metrics with proper statistical significance testing
  • Design fairness visualization dashboards across protected attributes and model versions
  • Create automated alerts for fairness metric degradation in production
  • Build remediation recommendation systems based on detected unfairness types
  • Educate clients on fairness metric tradeoffs and selection criteria

Requirements

  • 5+ years in ML fairness, responsible AI, or statistical auditing
  • Strong scikit-learn and Python skills for metric implementation
  • Deep statistical expertise for significance testing and bias analysis
  • Experience explaining fairness concepts to non-technical stakeholders
  • Understanding of regulatory fairness requirements across industries

Benefits

  • Hybrid — London office 2 days/week
  • Senior compensation with equity
  • $3,500 ethics and fairness conference budget
  • Defining how organizations measure and achieve AI fairness

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

AI & Machine Learning Engineers Data Science & Analytics

Skills

python scikit-learn pytorch statistics sql pandas

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile