Profile cover
S

AI Bias Auditing Engineer

Sebastian Carvalho

Contract · Job · New_York

About the role

Every model we deploy goes through a bias audit before it reaches production. That's not aspirational — it's contractual. Our enterprise clients in financial services require documented fairness assessments, and regulators are starting to ask for them too. Right now, our auditing process takes 3 weeks per model. We need to cut that to 3 days without sacrificing rigor. The role is equal parts engineering and methodology. You'll build automated testing pipelines that evaluate models across protected attributes, generate audit reports that satisfy compliance teams, and flag issues before they become PR incidents. You'll also define the standards: which fairness metrics matter for which use case, what thresholds trigger a block, and how to remediate without destroying model performance. This is a 12-month contract with strong potential for conversion. You'll report to our Head of Responsible AI and work alongside two policy analysts and one ML engineer.

Responsibilities

  • Build automated bias testing pipelines for pre-deployment model evaluation
  • Define fairness metrics and thresholds appropriate to each use case
  • Generate audit reports that meet regulatory and client compliance requirements
  • Create remediation playbooks for common bias patterns
  • Train engineering teams on bias-aware development practices
  • Monitor deployed models for fairness drift over time

Requirements

  • 5+ years in ML engineering with focus on fairness, accountability, or explainability
  • Deep knowledge of fairness metrics: demographic parity, equalized odds, calibration
  • Experience building automated testing and evaluation pipelines
  • Strong statistical background with ability to communicate findings to non-technical audiences
  • Familiarity with regulatory frameworks like EU AI Act or NYC Local Law 144

Benefits

  • Fully remote contract role
  • Competitive daily rate
  • Access to internal tools and research resources
  • Conference attendance covered
  • Potential conversion to permanent after 12 months

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI Product & Strategy data science & analytics

Skills

python scikit-learn pandas statistics sql

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Product Manager, Developer Experience

RemoteAI company

Full-time

PhD Autonomy Engineer Intern - Computer Vision / Deep Learning Summer 2027

RemoteAI company

Full-time Intern

Backend Engineer, Platform

RemoteAI company

Full-time

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Data Scientist/Data Engineer (Mid to Sr Levels)

RemoteAI company

Full-time Senior

Business Operations Lead

RemoteAI company

Full-time Lead

Job Type

Contract

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

AI Product & Strategy data science & analytics

Skills

python scikit-learn pandas statistics sql

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile