Profile cover
O

LLM Systems Engineer

Owen Goldberg

Full-time · Job · Los_Angeles

About the role

Our mission is to make large language models cheap enough to run at massive scale without sacrificing quality. This role sits right at that tension. You'll design and maintain the systems that route requests across multiple models and providers, balancing cost, latency, and output quality in real time. You'll be one of a handful of engineers who understand the full request path end to end, which means real influence over architecture decisions.

Responsibilities

  • Design multi-model routing logic balancing cost and quality
  • Maintain RAG pipelines serving production traffic
  • Optimize latency across model providers
  • Partner with the applied research team on new techniques

Requirements

  • 5+ years building production LLM or NLP systems
  • Deep familiarity with LangChain, RAG, and OpenAI-style APIs
  • Experience optimizing for both cost and latency
  • Comfortable owning critical infrastructure

Benefits

  • Fully remote position
  • Competitive salary + equity
  • Health and dental insurance
  • Unlimited PTO

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

NLP & Prompt Engineering

Skills

python langchain openai api rag docker

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Machine Learning Engineer, Evals

RemoteAI company

Full-time

Software Engineer, Full Stack - UK

RemoteAI company

Full-time

Team Lead, Actors

RemoteAI company

Full-time Lead

Software Engineer, Hermes Cloud

RemoteAI company

Full-time

Forward Deployed Engineer

RemoteAI company

Full-time

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$160k – $200k / year

AI Expertise

NLP & Prompt Engineering

Skills

python langchain openai api rag docker

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile