Profile cover
J

AI Prompt Injection Regression Test Suite Engineer

Jackson Li

Full-time · Job · New_York

About the role

Every time we patch a prompt injection vulnerability, there's no guarantee the fix stays fixed the next time someone updates a system prompt. We're looking for someone to close that gap. You'll build a regression test suite that runs known injection attack patterns against client LLM deployments on every prompt or model change, catching regressions before they reach production instead of after a client reports them. This plugs directly into our existing red-team attack library. Our clients include Fortune 500 companies deploying customer-facing LLM applications, so a regression that slips through isn't just an internal embarrassment — it's a real exposure for someone else's product.

Responsibilities

  • Build a regression test suite covering known prompt injection attack patterns
  • Integrate the suite into client CI pipelines for prompt and model changes
  • Maintain and expand the attack pattern library from red-team findings
  • Triage and report regressions to client security teams
  • Document test coverage gaps for the research team to address

Requirements

  • Experience with prompt engineering and LLM application security
  • LangChain experience for building test harnesses
  • OpenAI API experience across model versions
  • Comfort working with CI/CD integration for test suites
  • Prior red-teaming or security testing experience a plus

Benefits

  • Fully remote
  • Health and dental insurance
  • 401k matching
  • Annual security conference budget
  • Flexible PTO

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

NLP & Prompt Engineering Automation & AI Workflows

Skills

python langchain prompt engineering openai api

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Software Engineer, Full Stack - UK

RemoteAI company

Full-time

Team Lead, Actors

RemoteAI company

Full-time Lead

Software Engineer, Applications (Scientific Development Solutions) (High Seniority)

RemoteAI company

Full-time Senior

Senior Autonomy Engineer, Data Curation

RemoteAI company

Full-time Senior

Drone Platform Integration & Network Support Engineer

RemoteAI company

Full-time

PhD Autonomy Engineer Intern - Computer Vision / Deep Learning Summer 2027

RemoteAI company

Full-time Intern

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$100k – $130k / year

AI Expertise

NLP & Prompt Engineering Automation & AI Workflows

Skills

python langchain prompt engineering openai api

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile