Profile cover
J

AI Toxic Content Detection Researcher

Jackson Li

Full-time · Job · Los_Angeles

About the role

We don't care where you work from. We care about the quality of your thinking, your ability to read papers critically, and whether you can ship models that make online spaces safer. Yovex Intelligence builds trust and safety infrastructure for social platforms and AI products, and toxic content detection is one of our core research tracks. In this junior research role, you'll work alongside our senior safety researchers to build, evaluate, and improve toxic content classifiers across categories including hate speech, harassment, and self-harm promotion. You'll implement recent published methods, run comparative evaluations across datasets with different demographic distributions, and help maintain the annotation guidelines used for training data labeling. This is a research-leaning role accessible to a strong junior candidate. We expect familiarity with Hugging Face, a solid grasp of classification evaluation metrics, and the intellectual honesty to surface when a model underperforms on a specific demographic group. Safety research requires rigor, not just accuracy.

Responsibilities

  • Implement and evaluate toxic content classifiers across multiple harm categories
  • Run comparative evaluations across datasets with different demographic distributions
  • Maintain annotation guidelines used for training data labeling
  • Assist in literature reviews of recent content moderation and safety research
  • Document model limitations and demographic performance gaps clearly

Requirements

  • Basic Python and PyTorch skills
  • Familiarity with Hugging Face transformers
  • Understanding of classification evaluation metrics (F1, AUC, demographic parity)
  • Interest in AI safety, content moderation, or trust and safety research
  • Strong analytical thinking and intellectual honesty about model failures

Benefits

  • Fully remote, async-first culture
  • Health and dental insurance
  • Research mentorship from senior safety researchers
  • Annual learning budget ($700)
  • Flexible hours within PST timezone

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

NLP & Prompt Engineering AI & Machine Learning Engineers

Skills

python pytorch hugging face scikit-learn statistics

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior AI Researcher- Pre-training (f/m/d)

RemoteAI company

Full-time Senior

AI Resident UK/EMEA

RemoteAI company

Full-time

Senior AI R&D Engineer – Model Training (f/m/d)

RemoteAI company

Full-time Senior

Senior Machine Learning Engineer (Clinical Team)

RemoteAI company

Full-time Senior

Conversational Modelling Research Engineer

RemoteAI company

Full-time

Multimodal AI Model Optimization Research Engineer

RemoteAI company

Full-time

Job Type

Full-time

Level

Junior

Language

English

Salary Range

$80k – $100k / year

AI Expertise

NLP & Prompt Engineering AI & Machine Learning Engineers

Skills

python pytorch hugging face scikit-learn statistics

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile