LLM Product Engineer - Internal Knowledge Assistant

About the role

Responsibilities

• Improve answer quality and source grounding in our internal assistant
• Design evaluations around real employee tasks and failure cases
• Tune retrieval, context assembly, and response structure
• Work with security and IT on safe data access patterns
• Ship measurable improvements without overcomplicating the stack

Requirements

• 3+ years in software or AI product engineering
• Python for backend and evaluation workflows
• OpenAI API experience in production
• LangChain for multi-step orchestration
• RAG for grounded enterprise knowledge retrieval
• SQL for usage analytics and experiment measurement

Benefits

• $104,000 - $124,000 base salary
• Hybrid in Toronto with flexible in-office schedule
• RSUs and annual wellness budget
• Direct line to internal users
• A product team that values iteration over theater

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.