mlsanityData to 7 Oct 2026

PIXIE: A Zero-Shot texture-invariant 6D pose estimation framework for unseen objects with assembly defects

arXiv 2607.16015 ↗First posted 17 Jul 2026cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

6D pose estimation remains a key challenge in robotics and computer vision, particularly in industrial environments. The deployment of currently available data-driven methods is often limited by resource-intensive data pipelines, reliance on textured 3D models, and sensitivity to geometric deviations caused by damages or assembly defects. We present PIXIE, a zero-shot framework that estimates the 6D pose of an object from an RGB image using only an untextured 3D model. Synthetic depth and normal maps are rendered from sampled reference viewpoints and matched to the query image via a pretrained cross-modality feature matcher. Matched keypoints are back-projected to obtain 2D--3D correspondences for PnP-based pose estimation. Relying exclusively on geometry makes the method inherently robust to lighting and texture variation, while correspondence filtering handles geometric deviations between the model and physical object. We evaluate on widely-used public benchmarks, reporting state-of-the-art results on texture-less objects without object-specific training, and introduce a novel dataset with assembly defects, texture variations, and occlusion to demonstrate real-world applicability.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 29 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

20 of 29 references.

References · 20

  1. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
  2. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  3. 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
  4. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  5. 2023LightGlue: Local Feature Matching at Light Speedcited by 583
  6. 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
  7. 2018Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objectscited by 237
  8. 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
  9. 2019DPOD: 6D Pose Object Detector and Refinercited by 189
  10. 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 155
  11. 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 120
  12. 2023OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Modelscited by 114
8 more
  1. 2023GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondencecited by 113
  2. 2023FoundPose: Unseen Object Pose Estimation with Foundation Featurescited by 109
  3. 2023CNOS: A Strong Baseline for CAD-based Novel Object Segmentationcited by 86
  4. 2023ZS6D: Zero-shot 6D Object Pose Estimation using Vision Transformerscited by 45
  5. 2024MINIMA: Modality Invariant Image Matchingcited by 44
  6. 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 40
  7. 2024GenFlow: Generalizable Recurrent Flow for 6D Pose Refinement of Novel Objectscited by 32
  8. 2024Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondencescited by 25

Built on by

Not cited yet.