Profile cover
J

AI Incident Postmortem Quality Scorer

Inovex Intelligence

Remote · $100k – $130k / year · Full-time · Posted 1 month ago

No longer accepting applications

This role is no longer accepting applications

Don't miss the next role like this

Create a free profile with your skills. We match you to new AI roles as they open, and companies hiring can contact you directly.

Create free profile, 2 minutes

Similar open roles you can apply to now:

See all open AI jobs

About the role

We're building the next generation of AI-powered developer tooling, and one gap keeps showing up in customer feedback: postmortems that get written and never actually improve anything. You'll build a model that scores incident postmortems against a quality rubric, catching vague root causes and missing action items before the doc gets archived and forgotten. This plugs directly into our existing developer productivity analytics product.

Responsibilities

  • Build a scoring pipeline that evaluates postmortem quality against a defined rubric
  • Own integration with our existing developer analytics product
  • Partner with engineering leads to validate rubric accuracy
  • Iterate on prompts and scoring logic based on real postmortem data

Requirements

  • 3+ years building LLM-powered internal tooling
  • Experience with prompt engineering and structured evaluation
  • Comfortable working with Airflow-based pipelines
  • Familiarity with engineering incident processes a plus

Benefits

  • Fully remote position
  • Competitive salary + equity
  • Health and dental insurance
  • Generous learning budget

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure Automation & AI Workflows

Skills

python langchain prompt engineering docker airflow

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

AI Security Engineer Intern (Summer 2027)

RemoteAI company

Full-time Intern

Software Engineer - AI Tooling Infrastructure

RemoteAI company

Full-time

AI Platform Engineer Intern (Summer 2027)

RemoteAI company

Full-time Intern

Software Engineer, Infrastructure

RemoteAI company

Full-time

Senior Infrastructure Engineer

RemoteAI company

Full-time Senior

Senior Infrastructure Engineer

RemoteAI company

Full-time Senior

Job Type

Full-time

Level

Mid-Level

Language

English

Salary Range

$100k – $130k / year

AI Expertise

MLOps & AI Infrastructure Automation & AI Workflows

Skills

python langchain prompt engineering docker airflow

Ready to apply for this role?

Create a free talent account.

  • Find AI roles in one place
  • Get AI-matched job recommendations
  • Reply to companies that message you
  • Build your public AI talent profile
Create free account & apply Log in

This role is closed. Create your free profile to apply to similar open roles.

Don't miss the next one: get matched to new roles like this.

Create free profile