Profile cover
H

AI Data Catalog Search Intelligence Developer

Harper Adeyemi

Full-time · Job · Los_Angeles

About the role

We're building the search layer for modern data catalogs — not keyword lookup, but semantic retrieval that understands what a data asset actually contains and what questions it can answer. The problem is that most catalog metadata is incomplete, inconsistent, and written for the person who created the table, not the person who needs to find it. We already have a data governance platform with 2,000+ enterprise clients and 150M+ cataloged assets. The search experience is where we're falling short. Your role is to build the AI layer that makes catalog search feel like talking to a data steward who knows where everything is. This means RAG pipelines over metadata, semantic query understanding, and result ranking. You'll work with our platform infrastructure team and coordinate with customer success on the 10 design-partner clients who will test early versions.

Responsibilities

  • Build semantic search pipelines over data catalog metadata using RAG and vector retrieval
  • Design query understanding components that interpret natural language data requests
  • Implement result ranking that surfaces the most relevant assets for a given query context
  • Build evaluation benchmarks using real customer search queries
  • Integrate the search layer into the existing catalog API infrastructure

Requirements

  • 3+ years in ML engineering or data platform development
  • Strong RAG implementation experience with LangChain or LlamaIndex
  • Python and FastAPI proficiency
  • Familiarity with data catalogs, metadata standards, or data mesh concepts
  • Ability to evaluate and iterate on search quality using real-world queries

Benefits

  • $100k–$130k base + equity
  • Fully remote
  • Access to production-scale dataset for development
  • Health and dental coverage
  • Annual learning and conference stipend

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$100k – $130k / year

AI Expertise

MLOps & AI Infrastructure Automation & AI Workflows

Skills

python sql langchain rag fastapi snowflake docker

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile