Profile cover
M

AI Engineer

Nebula AI

Remote · $95K – $125K · Full-time · Posted 6 months ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

Context: we serve 1.2 million users. Our AI features handle 300,000 requests per day. Our P95 latency for LLM calls is currently 4.2 seconds. Our target is 1.8 seconds. We have a hypothesis about where the bottleneck is. We need an AI engineer who can test that hypothesis, implement the fix, and own the performance monitoring layer going forward. Direct impact. Measurable output. Clear success criteria from day one.

Fully remote.

Responsibilities

  • Profile and diagnose current AI feature latency bottlenecks
  • Implement streaming responses and caching strategies
  • Build latency and cost dashboards for the AI features layer
  • Own the LLM API integration layer and keep it efficient
  • Document all performance improvements with before/after benchmarks

Requirements

  • 2–4 years building AI features with LLM APIs in production
  • Experience optimising LLM call latency (streaming, caching, prompt compression)
  • Strong Python with async programming experience
  • Familiarity with observability tools (Datadog, Grafana, or similar)
  • Able to scope and deliver a performance improvement project independently

Benefits

  • Concrete problem with measurable success criteria
  • Full remote
  • $95,000 – $125,000
  • Equity package
  • Engineering-first culture — no endless meetings

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI & Machine Learning Engineers

Skills

python openai api langchain docker

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

AI Security Engineer Intern (Summer 2027)

Brainco

Full-time Intern

Research Engineer / Scientist, Pre-training

Anthropic

Full-time

Research Engineer / Scientist, Reinforcement Learning

Harvey

Full-time

Research Engineer, Infrastructure

Harvey

Full-time

Research Engineer / Scientist, Reinforcement Learning

Harvey

Full-time

Research Engineer, Infrastructure

Harvey

Full-time

Job Type

Full-time

Level

Mid-level

Language

English

Salary Range

$95,000 – $125,000

AI Expertise

AI & Machine Learning Engineers

Skills

python openai api langchain docker

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free account & apply Log in

About Nebula AI

View company

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile