Profile cover
J

AI Privilege Escalation Prompt Attack Researcher

Jackson Li

Full-time · Job · New_York

About the role

LLM-based systems increasingly operate with access to tools, APIs, databases, and external services. A customer service bot connected to a CRM can look up order history. A code assistant connected to a development environment can read and write files. These privileged access contexts create a new attack surface: prompt injection attacks that attempt to make the model perform actions beyond its intended authorization scope — privilege escalation through the language model as the attack vector. We do AI security research for enterprise LLM deployments. Privilege escalation prompt attacks are one of the most serious and least understood threats in agentic AI systems. The attack surface includes system prompt extraction to understand available tools, tool parameter injection to perform unauthorized operations, multi-turn manipulation to incrementally escalate permissions, and indirect prompt injection through retrieved content that overrides operator instructions. This is a principal research role. You'll characterize the attack surface, develop novel attack methodologies, build evaluation benchmarks for privilege escalation resistance, and advise enterprise clients on architectural defenses. The output includes published research, open-source attack evaluation frameworks, and direct client engagement on their specific deployment security posture.

Responsibilities

  • Characterize privilege escalation attack surface for LLM systems with tool access and external integrations
  • Develop novel attack methodologies: system prompt extraction, tool parameter injection, multi-turn manipulation
  • Build evaluation benchmarks measuring LLM system resistance to privilege escalation attempts
  • Investigate indirect prompt injection through retrieved context overriding operator instruction
  • Develop architectural defense recommendations for enterprise LLM deployment security
  • Publish research findings and open-source evaluation frameworks for community adoption

Requirements

  • 6+ years in AI security research, red team operations, or adversarial ML with LLM security focus
  • Deep expertise in prompt injection taxonomy, LLM tool use architectures, and agentic system design
  • Strong Python and LLM API skills with adversarial attack implementation and evaluation
  • Research track record with publications or significant contributions in AI security or adversarial ML
  • Ability to work with enterprise clients translating research findings into actionable deployment security posture

Benefits

  • Hybrid: 2 days NYC, 3 days remote
  • Top-of-market compensation for AI security research expertise
  • Comprehensive health benefits
  • Significant research and conference budget
  • Equity participation

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$200k+ / year

AI Expertise

NLP & Prompt Engineering AI Product & Strategy

Skills

python pytorch openai api hugging face statistics sql

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile