Profile cover
X

AI Knowledge Gap Diagnostic Tool Developer

Xavier Tanaka

Contract · Job · New_York

About the role

Before a student can learn new material, you need to know what they already know — and specifically, which prerequisite concepts they're missing. A student who struggles with quadratic equations might be missing factoring, or they might be missing the distributive property, or they might be missing negative numbers. The path to understanding depends entirely on where the gap actually is. Our diagnostic tool identifies knowledge gaps through adaptive questioning: starting with a topic, generating targeted questions that probe prerequisite concepts, analyzing responses to pinpoint the specific misconceptions, and producing a learning path that fills gaps in the right order. It's computerized adaptive testing with LLM-powered question generation. This is a 10-month contract. You'll build the question generation, response analysis, and gap inference modules while a psychometrician validates the diagnostic accuracy and a learning designer validates the learning path quality.

Responsibilities

  • Build adaptive question generation for prerequisite concept probing
  • Design response analysis identifying specific misconceptions
  • Implement gap inference mapping responses to missing concepts
  • Generate learning paths filling prerequisite gaps in optimal order
  • Evaluate diagnostic accuracy against expert-assessed knowledge states
  • Support expansion to new subject domains beyond current coverage

Requirements

  • 3+ years in NLP or ML with educational technology or assessment focus
  • Experience with adaptive testing or item response theory
  • Strong Python skills with LLM orchestration frameworks
  • Understanding of learning science and prerequisite concept structures
  • Ability to work with psychometricians and learning designers

Benefits

  • Fully remote contract role
  • Competitive monthly rate
  • Meaningful work improving learning outcomes
  • Access to student response datasets
  • Potential conversion to permanent

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

AI Product & Strategy NLP & Prompt Engineering

Skills

python langchain openai api sql docker

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Technical Writer

RemoteAI company

Part-time

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Product Manager, Developer Experience

RemoteAI company

Full-time

Principal Engineer

RemoteAI company

Full-time Principal

Software Engineer, Applications (Scientific Development Solutions) (High Seniority)

RemoteAI company

Full-time Senior

Senior Autonomy Engineer, Data Curation

RemoteAI company

Full-time Senior

Job Type

Contract

Level

Mid-Level

Language

English

Salary Range

$80k – $100k / year

AI Expertise

AI Product & Strategy NLP & Prompt Engineering

Skills

python langchain openai api sql docker statistics

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile