Profile cover
S

AI Tabular Data Synthesis Benchmark Engineer

Telvion Labs

Remote · $80k – $100k / year · Contract · Posted 5 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

Everyone claims their synthetic data generator is the best, but there's no standard benchmark for comparing them. Utility metrics (does a model trained on synthetic data perform as well as one trained on real data?) conflict with privacy metrics (can an attacker re-identify individuals from the synthetic output?), and different generators excel on different data types. We're building the definitive benchmark. You'll design the evaluation framework: selecting reference datasets that cover the diversity of real-world tabular data (sparse, imbalanced, high-dimensional, multi-table), defining utility and privacy metrics with clear mathematical specifications, implementing evaluation pipelines that produce reproducible results, and creating the leaderboard that our clients use to select the right generator for their use case. This is an 8-month contract. You'll work with our research team who develop the generators and our product team who need clear, defensible quality claims for enterprise sales.

Fully remote.

Responsibilities

  • Design comprehensive benchmark datasets covering diverse tabular data characteristics
  • Define utility and privacy metrics with rigorous mathematical specifications
  • Build reproducible evaluation pipelines for generator comparison
  • Create leaderboard infrastructure for public and private benchmarking
  • Analyze generator performance across data types and use cases
  • Document benchmark methodology for academic and commercial credibility

Requirements

  • 3+ years in data science with evaluation methodology experience
  • Strong statistical background for metric design and analysis
  • Experience with synthetic data, privacy, or generative model evaluation
  • Proficiency in Python and pandas for benchmark implementation
  • Ability to write clear methodology documentation

Benefits

  • Fully remote contract position
  • Competitive monthly rate
  • Contribute to industry-standard benchmarking
  • Work with cutting-edge synthetic data research
  • Potential for publication of benchmark results

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

Data Science & Analytics MLOps & AI Infrastructure

Skills

python statistics pandas scikit-learn docker

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Site Reliability Engineer - (Canada-Remote)

ClickHouse

Full-time Senior

Senior Machine Learning Engineer

Faculty

Full-time Senior

Senior Solution Engineer

Snowflake

Full-time Senior

Machine Learning Engineer, Core Experimentation

OpenAI

Full-time

Staff Validation Systems Engineer, AI Validation

Wayve

Full-time Staff

GTM Systems Administrator, EMEA

Harvey

Full-time

Job Type

Contract

Level

Mid-Level

Language

English

Salary Range

$80k – $100k / year

AI Expertise

Data Science & Analytics MLOps & AI Infrastructure

Skills

python statistics pandas scikit-learn docker sql

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free profile and apply Log in

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile