Profile cover
A

AI Constitutional Constraint Training Engineer

Aria Watanabe

Full-time · Job · Los_Angeles

About the role

Constitutional AI promises models that follow rules without needing thousands of hand-labeled examples for every policy. Define the principle — "don't generate medical advice without disclaimers" — and the model learns to comply through self-critique and revision. The theory works beautifully in papers. Making it work reliably at scale, across hundreds of client-specific policies, is an engineering challenge nobody has fully solved. Our platform lets enterprises define custom behavioral constraints for their LLM deployments: tone policies, factuality requirements, topic boundaries, and output format rules. You'll build the training pipeline that takes these constraints and produces fine-tuned models that comply consistently — not just on the test cases the client provides, but on the adversarial inputs that real users will inevitably try. The AI safety team is six researchers and three engineers. You'll be the senior engineer who bridges safety research and production deployment, turning theoretical alignment techniques into reliable software that enterprises trust with their brand.

Responsibilities

  • Build training pipelines for constitutional constraint compliance at scale
  • Implement self-critique and revision workflows for policy adherence
  • Design adversarial evaluation testing constraint robustness
  • Handle hundreds of client-specific policies with efficient fine-tuning
  • Measure and report compliance rates across policy categories
  • Bridge safety research innovations into production deployment

Requirements

  • 6+ years in ML with RLHF, constitutional AI, or alignment experience
  • Deep expertise in fine-tuning and preference optimization techniques
  • Strong PyTorch and Hugging Face skills for training pipeline development
  • Understanding of adversarial robustness and red-teaming methodology
  • Track record of shipping safety features in production LLM systems

Benefits

  • Fully remote with flexible schedule
  • $200K+ total compensation plus equity
  • Comprehensive health coverage
  • Unlimited conference and research budget
  • Shape how enterprises deploy safe AI systems

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI & Machine Learning Engineers AI Product & Strategy

Skills

python pytorch hugging face docker aws

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Senior AI Researcher- Pre-training (f/m/d)

RemoteAI company

Full-time Senior

AI Resident UK/EMEA

RemoteAI company

Full-time

Senior AI R&D Engineer – Model Training (f/m/d)

RemoteAI company

Full-time Senior

Senior Machine Learning Engineer (Clinical Team)

RemoteAI company

Full-time Senior

Multimodal AI Model Optimization Research Engineer

RemoteAI company

Full-time

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$200k+ / year

AI Expertise

AI & Machine Learning Engineers AI Product & Strategy

Skills

python pytorch hugging face docker aws

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile