Profile cover
J

AI LLM Output Guardrail Framework Developer

Jackson Li

Full-time · Job · New_York

About the role

Prompt injection is the input side of LLM security. Output guardrails are the other half — ensuring that model responses don't leak private training data, generate harmful content, produce hallucinated citations, or violate enterprise content policies. Our guardrail framework evaluates every LLM response in real time and blocks or modifies non-compliant outputs before they reach the user. The framework runs a battery of classifiers on each response: PII detection, hallucination scoring, toxicity filtering, brand safety assessment, and custom policy checks defined by each enterprise client. The latency budget is 100ms total — all checks must complete before the response streams to the user. You'll build the classifier ensemble, the policy engine that orchestrates them, and the response modification pipeline that fixes minor violations without blocking the entire response. The LLM security team is five engineers. You'll be the senior engineer who designs the guardrail architecture, balancing safety thoroughness against the latency constraints of real-time response streaming.

Responsibilities

  • Design the output guardrail classifier ensemble for real-time evaluation
  • Build PII detection, hallucination scoring, and toxicity filtering classifiers
  • Implement custom policy engines for enterprise-specific content rules
  • Create response modification pipeline fixing minor violations inline
  • Optimize ensemble latency to stay within 100ms total budget
  • Evaluate guardrail effectiveness against adversarial test suites

Requirements

  • 5+ years in NLP or ML security with production classification experience
  • Experience building real-time classifier pipelines with strict latency constraints
  • Strong Python and PyTorch skills for model development
  • Understanding of LLM security threats: data leakage, hallucination, toxicity
  • Track record of shipping content safety features

Benefits

  • Fully remote with flexible schedule
  • Competitive salary plus equity
  • Health, dental, and vision insurance
  • $4,000 annual conference and learning budget
  • Define the standard for LLM output safety

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI & Machine Learning Engineers AI Product & Strategy

Skills

python pytorch openai api langchain docker

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior AI Researcher- Pre-training (f/m/d)

RemoteAI company

Full-time Senior

Senior Product Security Engineer

RemoteAI company

Full-time Senior

AI Resident UK/EMEA

RemoteAI company

Full-time

Senior AI R&D Engineer – Model Training (f/m/d)

RemoteAI company

Full-time Senior

Senior Machine Learning Engineer (Clinical Team)

RemoteAI company

Full-time Senior

Conversational Modelling Research Engineer

RemoteAI company

Full-time

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$130k – $160k / year

AI Expertise

AI & Machine Learning Engineers AI Product & Strategy

Skills

python pytorch openai api langchain docker fastapi

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile