Targeted Hard Sample Synthesis Based on Estimated Pose and Occlusion Error for Improved Object Pose Estimation
Not on the map. Why?
Abstract (arXiv)
6D Object pose estimation is a fundamental component in robotics enabling efficient interaction with the environment. It is particularly challenging in bin-picking applications, where objects may be textureless and in difficult poses, and occlusion between objects of the same type may cause confusion even in well-trained models. We propose a novel method of hard example synthesis that is model-agnostic, using existing simulators and the modeling of pose error in both the camera-to-object viewsphere and occlusion space. Through evaluation of the model performance with respect to the distribution of object poses and occlusions, we discover regions of high error and generate realistic training samples to specifically target these regions. With our training approach, we demonstrate an improvement in correct detection rate of up to 20% across several ROBI-dataset objects using state-of-the-art pose estimation models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 29 references that are in the map. First posted on arXiv 5 Dec 2024.
Builds on
22 of 29 references.
References · 22
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
- 2018Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objectscited by 237
- 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
- 2017T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objectscited by 210
- 2020BOP Challenge 2020 on 6D Object Localizationcited by 192
10 more
- 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 180
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2021ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesiscited by 76
- 2019KeyPose: Multi-View 3D Labeling and Keypoint Estimation for Transparent Objectscited by 75
- 2016Synthesizing Training Images for Boosting Human 3D Pose Estimationcited by 52
- 2019Multi-path Learning for Object Pose Estimation Across Domainscited by 52
- 2020Robust 6D Object Pose Estimation by Learning RGB-D Featurescited by 25
- 2021ROBI: A Multi-View Dataset for Reflective Objects in Robotic Bin-Pickingcited by 22
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Pickingcited by 20
- 2023Multi-View Keypoints for Reliable 6D Object Pose Estimationcited by 4
Built on by
Not cited yet.