Profile cover
K

AI Search Result Diversity Optimization Engineer

Kyle Park

Full-time · Job · London

About the role

You'll be the fourth search relevance engineer on a team of eleven, working directly with our Head of Search and two applied scientists who obsess over ranking quality metrics. Our relevance scores are strong, but user research keeps surfacing the same complaint: results feel repetitive, dominated by a handful of near-identical documents. Your job is to fix that without tanking precision. You will design re-ranking layers that balance relevance against result diversity, run large-scale A/B tests on live traffic, and own the metrics dashboard that keeps the rest of the team honest about tradeoffs.

Responsibilities

  • Design and ship diversity-aware re-ranking layers on top of existing relevance models
  • Run large-scale A/B tests measuring the relevance/diversity tradeoff on live search traffic
  • Own streaming feature pipelines built on Kafka and Spark that feed the ranking layer
  • Partner with the applied science team to formalize diversity as a measurable objective
  • Build dashboards that make ranking tradeoffs visible to product stakeholders

Requirements

  • 6+ years in search or recommendation ranking systems
  • Strong Python and TensorFlow experience at production scale
  • Hands-on experience with Spark and Kafka based pipelines
  • Track record running and interpreting large-scale online experiments

Benefits

  • Fully remote with quarterly team offsites
  • Competitive salary and equity
  • Health insurance covering dependents
  • Dedicated learning and conference budget

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

AI & Machine Learning Engineers AI Product & Strategy

Skills

python spark kafka tensorflow

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile