mlsanityData to 7 Oct 2026

Multi-View Keypoints for Reliable 6D Object Pose Estimation

arXiv 2303.16833 ↗First posted 29 Mar 2023cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

6D Object pose estimation is a fundamental component in robotics enabling efficient interaction with the environment. It is particularly challenging in bin-picking applications, where many objects are low-feature and reflective, and self-occlusion between objects of the same type is common. We propose a novel multi-view approach leveraging known camera transformations from an eye-in-hand setup to combine heatmap and keypoint estimates into a probability density map over 3D space. The result is a robust approach that is scalable in the number of views. It relies on a confidence score composed of keypoint probabilities and point-cloud alignment error, which allows reliable rejection of false positives. We demonstrate an average pose estimation error of approximately 0.5mm and 2 degrees across a variety of difficult low-feature and reflective objects in the ROBI dataset, while also surpassing the state-of-art correct detection rate, measured using the 10% object diameter threshold on ADD error.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 13 of its 20 references that are in the map. First posted on arXiv 29 Mar 2023.

Builds on

13 of 20 references.

References · 13

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  3. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  4. 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
  5. 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
  6. 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
  7. 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
  8. 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
  9. 2017T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objectscited by 210
  10. 2019KeyPose: Multi-View 3D Labeling and Keypoint Estimation for Transparent Objectscited by 75
  11. 2020Robust 6D Object Pose Estimation by Learning RGB-D Featurescited by 25
  12. 2021ROBI: A Multi-View Dataset for Reflective Objects in Robotic Bin-Pickingcited by 22
1 more
  1. 2018Vehicle Pose and Shape Estimation through Multiple Monocular Visioncited by 13

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1; 2025: 2.

4 papers.