Profile cover
H

AI Metadata Enrichment Pipeline Developer

Relvix Data

Remote · $80k – $100k / year · Full-time · Posted 4 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

We have 400 million data assets in our catalog — tables, columns, models, dashboards, pipelines — and about 15% of them have meaningful metadata: descriptions, owners, domain tags, quality scores, lineage. The other 85% are orphaned assets that data teams can't evaluate without opening the underlying data, which defeats the purpose of having a catalog. You'll build the metadata enrichment pipeline that automatically populates descriptions, infers domain tags, assigns likely owners based on access patterns, and computes quality signals for unannotated assets. This involves a mix of NLP for description generation from column names and sample data, classification models for domain tagging, and graph analysis for lineage inference. The data governance team is four engineers. You'll own the enrichment pipeline end-to-end: design, build, schedule with Airflow, and monitor output quality. The KPI is increasing the percentage of meaningfully documented assets from 15% to 60% within 12 months.

Fully remote.

Responsibilities

  • Build automated description generation for undocumented tables and columns
  • Develop domain classification models for asset tagging
  • Implement owner inference from access patterns and historical edits
  • Create data quality scoring for unannotated datasets
  • Schedule and monitor enrichment pipelines with Airflow
  • Build quality dashboards tracking documentation coverage over time

Requirements

  • 3+ years in data engineering or analytics engineering
  • Strong Python and SQL skills with pipeline development experience
  • Familiarity with NLP techniques for text generation or classification
  • Experience with Airflow or similar workflow orchestration
  • Understanding of data catalog and governance concepts

Benefits

  • Fully remote with flexible schedule
  • Health, dental, and vision insurance
  • 401(k) with match
  • $2,500 professional development fund
  • Regular performance reviews with transparent salary progression

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

Data Science & Analytics MLOps & AI Infrastructure

Skills

python sql spark airflow aws

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Data Engineer, Data Analytics

Agility Robotics

Full-time Senior

Sr. Solutions Architect - Travel and Hospitality

Databricks

Full-time Senior

Revenue Operations Manager

Handshake

Full-time

AI Security Engineer Intern (Summer 2027)

Brainco

Full-time Intern

Materials Lead

Lambda

Full-time Lead

AI Platform Engineer Intern (Summer 2027)

Brainco

Full-time Intern

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$80k – $100k / year

AI Expertise

Data Science & Analytics MLOps & AI Infrastructure

Skills

python sql spark airflow aws pandas

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free account & apply Log in

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile