Unseen Object 6D Pose Estimation: A Benchmark and Baselines
Not on the map. Why?
Abstract (arXiv)
Estimating the 6D pose for unseen objects is in great demand for many real-world applications. However, current state-of-the-art pose estimation methods can only handle objects that are previously trained. In this paper, we propose a new task that enables and facilitates algorithms to estimate the 6D pose estimation of novel objects during testing. We collect a dataset with both real and synthetic images and up to 48 unseen objects in the test set. In the mean while, we propose a new metric named Infimum ADD (IADD) which is an invariant measurement for objects with different types of pose ambiguity. A two-stage baseline solution for this task is also provided. By training an end-to-end 3D correspondences network, our method finds corresponding points between an unseen object and a partial view RGBD image accurately and efficiently. It then calculates the 6D pose from the correspondences using an algorithm robust to object symmetry. Extensive experiments show that our method outperforms several intuitive baselines and thus verify its effectiveness. All the data, code and models will be made publicly available. Project page: www.graspnet.net/unseen6d
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 31 of its 60 references that are in the map. First posted on arXiv 23 Jun 2022.
Builds on
31 of 60 references.
References · 31
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 355
- 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 336
- 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 321
19 more
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
- 2017BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depthcited by 225
- 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
- 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
- 2018PPFNet: Global Context Aware Local Features for Robust 3D Point Matchingcited by 181
- 2017PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimationcited by 170
- 2020EPOS: Estimating 6D Pose of Objects with Symmetriescited by 148
- 2019PRNet: Self-Supervised Learning for Partial-to-Partial Registrationcited by 146
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2018Scan2CAD: Learning CAD Model Alignment in RGB-D Scanscited by 142
- 2019LatentFusion: End-to-End Differentiable Reconstruction and Rendering for Unseen Object Pose Estimationcited by 89
- 2018Explaining the Ambiguity of Object Detection and 6D Pose From Visual Datacited by 68
- 2021Deep Hough Voting for Robust Global Registrationcited by 53
- 2019Multi-path Learning for Object Pose Estimation Across Domainscited by 52
- 2021OCRTOC: A Cloud-Based Competition and Benchmark for Robotic Grasping and Manipulationcited by 24
- 2020Mapping in a cycle: Sinkhorn regularized unsupervised learning for point cloud shapescited by 11
- 2018Estimating 6D Pose From Localizing Designated Surface Keypointscited by 9
Built on by
Citing papers per year: 2023: 6; 2024: 1; 2025: 3; 2026: 2.
12 papers.
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
- 2023A Survey on Deep Learning-Based Monocular Spacecraft Pose Estimation: Current State, Limitations and Prospectscited by 30
- 2023GAMMA: Graspability-Aware Mobile MAnipulation Policy Learning based on Online Grasping Pose Fusioncited by 22
- 2023Challenges for Monocular 6D Object Pose Estimation in Roboticscited by 21
- 2023One-Shot Imitation Learning: A Pose Estimation Perspectivecited by 21
- 2025Scalable Unseen Objects 6-DoF Absolute Pose Estimation with Robotic Integrationcited by 11
- 2023MFOS: Model-Free & One-Shot Object Pose Estimationcited by 10
- 2023KeyMatchNet: Zero-Shot Pose Estimation in 3D Point Clouds by Generalized Keypoint Matchingcited by 7
- 2025Foundation Feature-Driven Online End-Effector Pose Estimation: A Marker-Free and Learning-Free Approachcited by 1
- 2025SingRef6D: Monocular Novel Object Pose Estimation with a Single RGB Referencecited by 1
- 2026HACMatch Semi-Supervised Rotation Regression with Hardness-Aware Curriculum Pseudo Labelingcited by 0
- 2026Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applicationscited by 0
- 2026Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applications18 Jun 2026
- 2026HACMatch Semi-Supervised Rotation Regression with Hardness-Aware Curriculum Pseudo Labeling23 Mar 2026
- 2025SingRef6D: Monocular Novel Object Pose Estimation with a Single RGB Reference26 Sep 2025
- 2025Foundation Feature-Driven Online End-Effector Pose Estimation: A Marker-Free and Learning-Free Approach18 Mar 2025
- 2025Scalable Unseen Objects 6-DoF Absolute Pose Estimation with Robotic Integration7 Mar 2025
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2023One-Shot Imitation Learning: A Pose Estimation Perspective18 Oct 2023
- 2023MFOS: Model-Free & One-Shot Object Pose Estimation3 Oct 2023
- 2023GAMMA: Graspability-Aware Mobile MAnipulation Policy Learning based on Online Grasping Pose Fusion27 Sep 2023
- 2023Challenges for Monocular 6D Object Pose Estimation in Robotics22 Jul 2023
- 2023A Survey on Deep Learning-Based Monocular Spacecraft Pose Estimation: Current State, Limitations and Prospects12 May 2023
- 2023KeyMatchNet: Zero-Shot Pose Estimation in 3D Point Clouds by Generalized Keypoint Matching28 Mar 2023