Y
Prompt Engineering Consultant
Yasmine Bouchard
Freelance · Mid-level · Denver
About the role
Fixed-scope project. We have a B2B SaaS product that uses GPT-4o to generate first-draft RFP responses for procurement teams. The current system prompt was written by a non-technical product manager eighteen months ago and hasn't been touched since. We've grown the customer base, the use cases have expanded, and the outputs are inconsistent in ways that are costing us renewals. We need a prompt engineer to audit the current system, redesign the prompt architecture, build an evaluation set with at least 50 annotated examples, and deliver a documented prompt strategy our internal team can maintain. Timeline: 6 weeks. Budget: fixed at $8,500. Deliverables are the prompt system, the evaluation dataset, and a written handover document. You'll work with one product manager and one backend engineer. Weekly check-ins via video. We want someone who has done this before on a production system, not someone who is figuring it out on our dime.
Key Deliverables
List the expected deliverables for this project.
- Audit the existing prompt system and produce a written assessment of failure modes and root causes
- Redesign the system prompt architecture with clear rationale for each structural decision
- Build an annotated evaluation set of 50+ RFP examples with quality rubrics
- Implement automated evaluation tooling to score prompt variants against the evaluation set
- Deliver a documented handover package the internal team can use to maintain and extend the system
Requirements
Technical stack needed for this mission.
- Demonstrable experience redesigning or auditing prompt systems for a production LLM application
- Deep familiarity with OpenAI APIs: system prompt design, tool use, structured outputs, and token budget management
- Experience building evaluation datasets and automated evaluation pipelines for LLM output quality
- LangChain or equivalent for orchestrating multi-step generation flows if needed
- Python for evaluation automation — you don't need to be a backend engineer but you can write scripts
- Strong written English — the handover document is a deliverable, not an afterthought
Contract Type
Fixed-price
Level
Mid-level
Budget Range
$8,500
Duration
6 weeks
AI Expertise
NLP & Prompt Engineering
Ready to apply for this role?
Create a free talent account in under 2 minutes.
- Apply to verified AI companies
- Get AI-matched job recommendations
- Message hiring managers directly
- Build your public AI talent profile