Profile cover
E

AI Noise-Robust ASR Fine-tuning Engineer

Elena Cohen

Full-time · Job · Los_Angeles

About the role

Whisper, wav2vec, and other foundation ASR models achieve stunning accuracy on clean speech — and fall apart in real-world conditions. Restaurant background noise, overlapping speakers, phone-quality audio, accented speech over a poor connection: these are the conditions our customers actually operate in, and the word error rate doubles or triples compared to benchmarks. We fine-tune foundation models for noise-robust speech recognition, specializing them for our clients' specific acoustic environments and vocabularies. A model tuned for contact center audio sounds different than one tuned for field service recordings. You'll build the fine-tuning pipeline: data preparation from client audio, noise augmentation strategies, domain vocabulary integration, and the evaluation framework that measures accuracy across noise conditions, accents, and speaking styles. The speech team is six engineers. You'll be the senior fine-tuning specialist who decides which foundation model to start from, how to augment training data, and when a fine-tuned model is ready for production.

Responsibilities

  • Build fine-tuning pipelines for noise-robust ASR from foundation models
  • Design noise augmentation and data preparation strategies per client domain
  • Integrate domain-specific vocabularies and language models
  • Create evaluation frameworks covering noise conditions, accents, and speaking styles
  • Benchmark fine-tuned models against foundation model baselines
  • Guide model selection and training strategy decisions

Requirements

  • 5+ years in speech recognition or audio ML
  • Experience fine-tuning Whisper, wav2vec, or similar foundation ASR models
  • Strong PyTorch skills with audio data processing expertise
  • Understanding of acoustic modeling, language modeling, and decoding
  • Track record of improving ASR accuracy in challenging acoustic conditions

Benefits

  • Fully remote with flexible schedule
  • Competitive salary plus equity
  • Health, dental, and vision insurance
  • $4,000 annual conference and learning budget
  • Work with cutting-edge speech foundation models

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI & Machine Learning Engineers data science & analytics

Skills

python pytorch hugging face docker aws

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Senior AI Researcher- Pre-training (f/m/d)

RemoteAI company

Full-time Senior

Drone Platform Integration & Network Support Engineer

RemoteAI company

Full-time

AI Resident UK/EMEA

RemoteAI company

Full-time

Senior AI R&D Engineer – Model Training (f/m/d)

RemoteAI company

Full-time Senior

Senior Machine Learning Engineer (Clinical Team)

RemoteAI company

Full-time Senior

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

AI & Machine Learning Engineers data science & analytics

Skills

python pytorch hugging face docker aws statistics

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile