Profile cover
A

AI Lyrics-to-Melody Alignment Engineer

Audrey Fischer

Full-time · Job · Los_Angeles

About the role

Text-to-song generation can produce melodies. It can produce lyrics. What it consistently fails to do is produce melodies that feel natural to sing with specific lyrics — where the natural stress patterns of the words align with musical accents, where phrase lengths match lyric line lengths, and where the melodic contour feels expressive rather than arbitrary relative to the emotional content of the words. This alignment problem sits at the intersection of music cognition, linguistics, and generative modeling. Natural language has prosodic structure: syllables have stress, phrases have rhythm, and emotional content correlates with prosodic contour. Music has an analogous structure. Lyrics-to-melody alignment is the problem of generating music that resonates with the prosodic structure of specific text. Our music generation platform serves 4,000 independent artists and music supervision clients. You'll lead the lyrics-to-melody alignment research: designing models that extract prosodic structure from lyrics, training alignment models that generate melodically appropriate settings, and building the evaluation framework that measures alignment quality perceptually, not just statistically. Prior publications in music information retrieval or generative audio ML are a strong plus.

Responsibilities

  • Design lyrics-to-melody alignment models incorporating syllable stress and prosodic contour
  • Build lyric prosody extraction pipeline identifying stress patterns, phrase boundaries, and emotional valence
  • Train alignment models conditioned on lyric prosodic features to generate appropriate melodic contours
  • Develop perceptual evaluation framework using listening tests and expert musician feedback
  • Build alignment quality metrics correlating with human naturalness judgments
  • Publish methodology and contribute to music information retrieval research community

Requirements

  • 6+ years in ML research with audio, music information retrieval, or generative modeling experience
  • Understanding of music theory, prosody, and text-to-speech prosodic modeling
  • Strong Python and PyTorch skills with audio signal processing experience
  • Familiarity with music generation models and evaluation approaches
  • Research publication record in music AI, audio ML, or adjacent NLP fields preferred

Benefits

  • Fully remote with flexible schedule
  • Top-of-market compensation for generative audio expertise
  • Research conference and publication budget
  • Comprehensive health benefits
  • Equity participation

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI & Machine Learning Engineers NLP & Prompt Engineering

Skills

python pytorch hugging face docker gcp

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

AI Resident UK/EMEA

RemoteAI company

Full-time

Senior AI Researcher- Pre-training (f/m/d)

RemoteAI company

Full-time Senior

Senior AI R&D Engineer – Model Training (f/m/d)

RemoteAI company

Full-time Senior

Senior Machine Learning Engineer (Clinical Team)

RemoteAI company

Full-time Senior

Multimodal AI Model Optimization Research Engineer

RemoteAI company

Full-time

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$160k – $200k / year

AI Expertise

AI & Machine Learning Engineers NLP & Prompt Engineering

Skills

python pytorch hugging face docker gcp statistics

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile