AI Formative Assessment Item Generator

About the role

Responsibilities

• Design assessment item generation system producing multiple question types calibrated to specific knowledge states
• Implement pedagogical quality filters detecting items with flawed distractors, ambiguous wording, or obvious answers
• Build psychometric calibration pipeline estimating item difficulty and discrimination from learner response data
• Develop concept targeting ensuring generated items probe specific knowledge gaps rather than adjacent competencies
• Create item diversity controls preventing stylistic repetition across items in the same assessment sequence
• Validate item quality with instructional designer review as primary accuracy benchmark

Requirements

• 6+ years in NLP engineering with educational technology, assessment design, or content generation experience
• Understanding of formative assessment pedagogy, item writing best practices, and psychometric principles
• Strong Python and LLM-based text generation skills
• Experience building generation systems with quality filtering and calibration pipelines
• Ability to collaborate with learning scientists and instructional designers on quality standards

Benefits

• Fully remote with flexible schedule
• Comprehensive health benefits
• $4,000 annual professional development budget
• Mission-driven work improving learning outcomes
• Equity participation

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.