Profile cover
Z

AI Prompt Optimization Analyst

Zoey Chen

Part-time · Job · Berlin

About the role

Our clients spend thousands per month on LLM API calls, and most of their prompts are inefficient — too long, poorly structured, or using expensive models for tasks that cheaper ones handle fine. We audit prompt libraries and optimize them for cost, quality, and latency. A typical engagement reduces API costs by 40% without sacrificing output quality. This part-time role (20h/week) focuses on the analytical side: benchmarking prompt variants across different models, measuring output quality with automated evaluation metrics, tracking cost-per-query across prompt versions, and building the reports that show clients exactly where their prompt budget goes. No deep ML experience needed — we'll teach you the evaluation methodology. What we need is someone methodical, comfortable with data, and able to spot patterns in thousands of prompt-response pairs. If you enjoy optimizing systems by measuring everything, this role fits.

Responsibilities

  • Benchmark prompt variants across different LLM models for cost and quality
  • Measure output quality using automated evaluation metrics
  • Track cost-per-query across prompt versions and model tiers
  • Build analytical reports showing clients their prompt cost distribution
  • Identify optimization opportunities in client prompt libraries

Requirements

  • Python proficiency for data analysis and scripting
  • Basic understanding of LLM APIs and prompt structures
  • Strong analytical skills with attention to measurement detail
  • SQL skills for querying usage and cost databases
  • Available for 20 hours/week

Benefits

  • Part-time (20h/week) with flexible scheduling
  • Fully remote — European time zones
  • Learn prompt engineering methodology hands-on
  • Option to transition to full-time

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Part-time

Level

Junior

Language

English

Salary Range

Under $60k / year

AI Expertise

NLP & Prompt Engineering

Skills

python openai api prompt engineering pandas sql

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile