Multi-View Keypoints for Reliable 6D Object Pose Estimation
Not on the map. Why?
Abstract (arXiv)
6D Object pose estimation is a fundamental component in robotics enabling efficient interaction with the environment. It is particularly challenging in bin-picking applications, where many objects are low-feature and reflective, and self-occlusion between objects of the same type is common. We propose a novel multi-view approach leveraging known camera transformations from an eye-in-hand setup to combine heatmap and keypoint estimates into a probability density map over 3D space. The result is a robust approach that is scalable in the number of views. It relies on a confidence score composed of keypoint probabilities and point-cloud alignment error, which allows reliable rejection of false positives. We demonstrate an average pose estimation error of approximately 0.5mm and 2 degrees across a variety of difficult low-feature and reflective objects in the ROBI dataset, while also surpassing the state-of-art correct detection rate, measured using the 10% object diameter threshold on ADD error.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 13 of its 20 references that are in the map. First posted on arXiv 29 Mar 2023.
Builds on
13 of 20 references.
References · 13
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
- 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
- 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
- 2017T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objectscited by 210
- 2019KeyPose: Multi-View 3D Labeling and Keypoint Estimation for Transparent Objectscited by 75
- 2020Robust 6D Object Pose Estimation by Learning RGB-D Featurescited by 25
- 2021ROBI: A Multi-View Dataset for Reflective Objects in Robotic Bin-Pickingcited by 22
1 more
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 2.
4 papers.
- 2023Learning Better Keypoints for Multi-Object 6DoF Pose Estimationcited by 3
- 2025ZeroBP: Learning Position-Aware Correspondence for Zero-shot 6D Pose Estimation in Bin-Pickingcited by 2
- 2024Targeted Hard Sample Synthesis Based on Estimated Pose and Occlusion Error for Improved Object Pose Estimationcited by 0
- 2025DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objectscited by 0
- 2025DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objects13 Oct 2025
- 2025ZeroBP: Learning Position-Aware Correspondence for Zero-shot 6D Pose Estimation in Bin-Picking3 Feb 2025
- 2024Targeted Hard Sample Synthesis Based on Estimated Pose and Occlusion Error for Improved Object Pose Estimation5 Dec 2024
- 2023Learning Better Keypoints for Multi-Object 6DoF Pose Estimation15 Aug 2023