Profile cover
E

AI Seller Matching Quality Engineer

Eli Sato

Full-time · Job · New_York

About the role

In a two-sided marketplace, matching quality determines everything. Show a buyer the wrong sellers and you lose the buyer. Show a seller the wrong buyers and you waste their time. Our matching system connects 2.8 million buyers with 400,000 sellers, and the quality of those matches drives $340M in annual transaction volume. Matching quality sounds simple to measure until you realize there's no single metric. Relevance, diversity, freshness, seller capacity, buyer intent strength, and geographic compatibility all matter — and they often conflict. A highly relevant seller who's already overloaded with inquiries is a worse match than a slightly less relevant one who can respond in 2 hours. You'll build the quality measurement and monitoring infrastructure: offline metrics that evaluate match relevance against conversion data, online metrics that track match quality in real time, and A/B testing frameworks that handle the complexity of two-sided experiments where changing one side's experience affects the other.

Responsibilities

  • Design matching quality metrics capturing relevance, diversity, and seller capacity
  • Build offline evaluation pipelines comparing match quality against conversion outcomes
  • Implement real-time quality monitoring for production matching
  • Create A/B testing frameworks for two-sided marketplace experiments
  • Analyze matching failures to identify systematic quality issues
  • Collaborate with the ranking team to translate quality insights into model improvements

Requirements

  • 5+ years in marketplace, search, or recommendation quality engineering
  • Experience with evaluation metrics for ranking and matching systems
  • Strong Python, SQL, and statistical analysis skills
  • Understanding of two-sided marketplace dynamics
  • Ability to design experiments that account for network effects

Benefits

  • Fully remote with flexible hours
  • Competitive salary plus performance bonus
  • Health, dental, and vision insurance
  • $3,500 annual learning budget
  • High-impact role on core marketplace metric

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI & Machine Learning Engineers data science & analytics

Skills

python pytorch sql statistics pandas

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior AI Researcher- Pre-training (f/m/d)

RemoteAI company

Full-time Senior

Technical Writer

RemoteAI company

Part-time

Senior Product Security Engineer

RemoteAI company

Full-time Senior

AI Resident UK/EMEA

RemoteAI company

Full-time

Senior AI R&D Engineer – Model Training (f/m/d)

RemoteAI company

Full-time Senior

Senior Machine Learning Engineer (Clinical Team)

RemoteAI company

Full-time Senior

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$100k – $130k / year

AI Expertise

AI & Machine Learning Engineers data science & analytics

Skills

python pytorch sql statistics pandas docker

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile