Profile cover
Z

AI Test Suite Prioritization Engine Developer

Zoe Levy

Contract · Job · Toronto

About the role

Our mission here is simple: catch a broken build in minutes, not after a two-hour full suite run. You'll join a squad of four working on test infrastructure, alongside the flaky test detection and regression detection teams. Our CI pipeline runs thousands of tests per commit, but most changes only touch a fraction of the codebase that actually needs re-testing. What we expect from you is a prioritization engine that reorders test execution based on what a given change is likely to break. Sprints are two weeks with clear ownership per engineer, and you'll present prioritization accuracy metrics in our bi-weekly infrastructure review alongside the rest of the testing team.

Responsibilities

  • Build a test prioritization engine based on code change impact analysis
  • Integrate prioritization logic into the existing CI pipeline
  • Coordinate with the flaky test detection team to avoid conflicting signals
  • Track time-to-failure-detection improvements across pilot repositories
  • Present prioritization accuracy in bi-weekly infrastructure reviews

Requirements

  • Experience with CI/CD systems and test infrastructure
  • Comfortable with Python and basic statistics for impact modeling
  • Familiarity with Docker-based test environments
  • Junior-friendly role with mentorship from senior test infrastructure engineers

Benefits

  • Remote contract with potential for extension
  • Structured onboarding with a dedicated mentor
  • Access to a mature CI/CD codebase to learn from
  • Bi-weekly syncs with clear, defined deliverables

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Categories

MLOps & AI Infrastructure

Skills

python sql docker airflow statistics

Related remote AI jobs

Nearby roles that share similar skills, categories, or hiring intent.

Browse all jobs

Senior Product Security Engineer

RemoteAI company

Full-time Senior

Technical Writer

RemoteAI company

Part-time

AI Resident UK/EMEA

RemoteAI company

Full-time

Software Engineer, Applications (Scientific Development Solutions) (High Seniority)

RemoteAI company

Full-time Senior

Drone Platform Integration & Network Support Engineer

RemoteAI company

Full-time

PhD Autonomy Engineer Intern - Computer Vision / Deep Learning Summer 2027

RemoteAI company

Full-time Intern

Job Type

Contract

Level

Junior

Language

English

Salary Range

$80k – $100k / year

AI Expertise

MLOps & AI Infrastructure

Skills

python sql docker airflow statistics

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile
Create free account & apply Log in

Interested in this role? Create your free profile to apply.

Apply — create free profile