Profile cover
J

AI Prompt Version Changelog Generator

Jackson Li

Full-time · Job · Los_Angeles

About the role

LangChain, prompt versioning, and Docker-based eval pipelines are the core of what we build. If you have ever shipped a prompt change and had no idea which downstream behavior it silently broke, this role exists for you. We are building the tooling that automatically diffs prompt versions, summarizes the behavioral impact of each change, and generates human-readable changelogs that get attached to every deploy. You will design the diffing logic, the summarization model, and the changelog format our customers actually read. You will work closely with our platform team to hook this into the existing prompt registry and CI system, and with design to make the output genuinely useful rather than noisy.

Responsibilities

  • Build the diffing engine that compares prompt versions at a semantic level, not just text diff
  • Design a summarization pipeline that explains behavioral changes in plain language
  • Ship the changelog generator as a CI step integrated with our prompt registry
  • Partner with product to define what information matters most to reviewers
  • Run controlled evaluations to validate that generated changelogs match real behavior shifts

Requirements

  • 3+ years building LLM-powered developer tooling
  • Hands-on experience with LangChain or a comparable orchestration framework
  • Solid Python skills and comfort containerizing services with Docker
  • Ability to reason about prompt behavior empirically, not just anecdotally

Benefits

  • Fully remote, async-friendly schedule
  • Competitive equity grant
  • Home office stipend
  • Flexible PTO

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

NLP & Prompt Engineering MLOps & AI Infrastructure

Skills

prompt engineering langchain python docker

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Software Engineer, Full Stack - UK

RemoteAI company

Full-time

Principal Engineer

RemoteAI company

Full-time Principal

AI Resident UK/EMEA

RemoteAI company

Full-time

Software Engineer, Applications (Scientific Development Solutions) (High Seniority)

RemoteAI company

Full-time Senior

PhD Autonomy Engineer Intern - Computer Vision / Deep Learning Summer 2027

RemoteAI company

Full-time Intern

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$100k – $130k / year

AI Expertise

NLP & Prompt Engineering MLOps & AI Infrastructure

Skills

prompt engineering langchain python docker

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile