Profile cover
D

AI Voice Emotion Recognition Developer

Daniel Sokolov

Full-time · Job · New_York

About the role

Words carry meaning. Tone carries intent. When a customer says "that's fine" in a flat voice, it means the opposite of "that's fine" said with enthusiasm. Our voice emotion recognition system detects frustration, satisfaction, confusion, and urgency in real-time during customer calls — giving contact center agents live coaching signals before a call escalates. The current model handles clear emotional signals well but misses subtle cues: the slight tension before frustration peaks, the polite dissatisfaction that precedes churn, the confusion masked by agreeable responses. You'll improve detection of these early signals by combining prosodic features (pitch, rhythm, energy) with linguistic analysis of what's being said and how it's being said. The speech AI team is five engineers. You'll work closest with the real-time serving engineer who handles the streaming pipeline and the product manager who translates emotion signals into actionable coaching prompts for agents.

Responsibilities

  • Improve emotion recognition accuracy for subtle and mixed emotional states
  • Combine prosodic and linguistic features for multi-modal emotion detection
  • Build evaluation datasets for nuanced emotional expressions
  • Optimize models for real-time inference on streaming audio
  • Design calibration methods for consistent scoring across demographics
  • Collaborate with product on translating emotion signals into agent coaching

Requirements

  • 3+ years in speech or audio ML with emotion or sentiment focus
  • Experience with prosodic feature extraction and audio processing
  • Strong PyTorch skills for model development and experimentation
  • Understanding of evaluation challenges in subjective classification tasks
  • Awareness of ethical considerations in emotion detection technology

Benefits

  • Fully remote with flexible hours
  • Health and dental insurance
  • $2,500 annual learning budget
  • Quarterly team events
  • Impact-driven role improving customer experiences

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI & Machine Learning Engineers data science & analytics

Skills

python pytorch hugging face docker aws

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Senior AI Researcher- Pre-training (f/m/d)

RemoteAI company

Full-time Senior

Drone Platform Integration & Network Support Engineer

RemoteAI company

Full-time

AI Resident UK/EMEA

RemoteAI company

Full-time

Senior AI R&D Engineer – Model Training (f/m/d)

RemoteAI company

Full-time Senior

Senior Machine Learning Engineer (Clinical Team)

RemoteAI company

Full-time Senior

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$80k – $100k / year

AI Expertise

AI & Machine Learning Engineers data science & analytics

Skills

python pytorch hugging face docker aws statistics

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile