Profile cover
R

AI Object Pose Estimation for Manipulation Engineer

Riley Magnusson

Full-time · Job · San_Francisco

About the role

A robot arm reaching for an object needs to know not just that the object is a cup — it needs to know the cup's exact 3D position, orientation, and grasp affordances so the gripper can approach from the right angle, close at the right depth, and apply force in the right direction. Object pose estimation for manipulation is the computer vision problem that bridges perception and action in robotic systems. We build robotic manipulation systems for warehouse automation and industrial assembly clients. Pose estimation accuracy is the limiting factor in our grasp success rates: a 5-degree orientation error often means a failed grasp; a 10-degree error means a dropped object and a reset cycle. Our current models achieve 94% grasp success in controlled conditions and 82% in the clutter and partial occlusion environments of real warehouse bins. You'll lead pose estimation model development: designing approaches that handle occlusion, reflective surfaces, and cluttered bin scenarios, implementing category-level pose estimation that generalizes across object instances rather than requiring per-object CAD models, and building the simulation-to-real pipeline that generates synthetic training data efficiently enough to cover new object categories without expensive real-world data collection.

Responsibilities

  • Design pose estimation models handling occlusion, reflective surfaces, and cluttered multi-object scenarios
  • Implement category-level pose estimation generalizing across object instances without per-object CAD models
  • Build simulation-to-real training data pipeline for efficient new object category coverage
  • Develop pose uncertainty estimation enabling the manipulation controller to request re-estimation when needed
  • Validate pose accuracy against robot grasp success rates as the primary production metric
  • Optimize inference for real-time pose estimation on robot perception hardware

Requirements

  • 6+ years in computer vision engineering with 3D perception, pose estimation, or robotic vision experience
  • Deep expertise in 6DoF object pose estimation and the relevant model architectures
  • Strong Python and PyTorch skills with 3D data processing experience
  • Familiarity with sim-to-real transfer techniques and synthetic data generation for robotics
  • Track record improving grasp success rates through perception system improvements

Benefits

  • Fully remote with quarterly visits to robotics lab for physical system testing
  • Top-of-market compensation for robotics perception expertise
  • Comprehensive health benefits
  • $5,000 annual equipment and conference budget
  • Equity participation

Keep exploring related roles

Use these topic pages to discover more roles in the same hiring cluster.

Job Type

Full-time

Level

Senior

Language

English

Salary Range

$160k – $200k / year

AI Expertise

AI & Machine Learning Engineers Automation & AI Workflows

Skills

python pytorch computer vision docker gcp statistics

Ready to apply for this role?

Create a free talent account in under 2 minutes.

  • Apply to verified AI companies
  • Get AI-matched job recommendations
  • Message hiring managers directly
  • Build your public AI talent profile

Interested in this role? Create your free profile to apply.

Apply — create free profile