Occlusion-Robust Object Pose Estimation with Holistic Representation
Not on the map. Why?
Abstract (arXiv)
Practical object pose estimation demands robustness against occlusions to the target object. State-of-the-art (SOTA) object pose estimators take a two-stage approach, where the first stage predicts 2D landmarks using a deep network and the second stage solves for 6DOF pose from 2D-3D correspondences. Albeit widely adopted, such two-stage approaches could suffer from novel occlusions when generalising and weak landmark coherence due to disrupted features. To address these issues, we develop a novel occlude-and-blackout batch augmentation technique to learn occlusion-robust deep features, and a multi-precision supervision architecture to encourage holistic pose representation learning for accurate and coherent landmark predictions. We perform careful ablation tests to verify the impact of our innovations and compare our method to SOTA pose estimators. Without the need of any post-processing or refinement, our method exhibits superior performance on the LINEMOD dataset. On the YCB-Video dataset our method outperforms all non-refinement methods in terms of the ADD(-S) metric. We also demonstrate the high data-efficiency of our method. Our code is available at http://github.com/BoChenYS/ROPE
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 41 of its 65 references that are in the map. First posted on arXiv 22 Oct 2021.
Builds on
41 of 65 references.
References · 41
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Mask R-CNNcited by 7,277
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2016YOLO9000: Better, Faster, Strongercited by 1,431
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2017Random Erasing Data Augmentationcited by 1,239
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 724
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 355
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
29 more
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
- 2017BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depthcited by 225
- 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
- 2017Real-Time Seamless Single Shot 6D Object Pose Predictioncited by 210
- 2017Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localizationcited by 207
- 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
- 2019DPOD: 6D Pose Object Detector and Refinercited by 189
- 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
- 2017PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimationcited by 170
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2020HybridPose: 6D Object Pose Estimation under Hybrid Representationscited by 107
- 2018Segmentation-driven 6D Object Pose Estimationcited by 104
- 2015Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Viewscited by 94
- 20176-DoF Object Pose from Semantic Keypointscited by 89
- 2019Single-Stage 6D Object Pose Estimationcited by 88
- 2018Making Deep Heatmaps Robust to Partial Occlusions for 3D Object Pose Estimationcited by 74
- 2019End-to-End Learnable Geometric Vision by Backpropagating PnP Optimizationcited by 65
- 2018Deep Model-Based 6D Pose Refinement in RGBcited by 59
- 2019Satellite Pose Estimation with Deep Landmark Regression and Nonlinear Pose Refinementcited by 56
- 2019Multi-path Learning for Object Pose Estimation Across Domainscited by 52
- 2018Pose Estimation for Non-Cooperative Spacecraft Rendezvous Using Convolutional Neural Networkscited by 34
- 2018Deep-6DPose: Recovering 6D Object Pose from a Single RGB Imagecited by 26
- 2016Deep Supervision with Shape Concepts for Occlusion-Aware 3D Object Parsingcited by 19
- 2018CRAVES: Controlling Robotic Arm with a Vision-based Economic Systemcited by 18
- 2016Global Hypothesis Generation for 6D Object Pose Estimationcited by 17
- 2016Fast Single Shot Detection and Pose Estimationcited by 11
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 1; 2025: 2; 2026: 1.
6 papers.
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
- 2024Pose-Aware Self-Supervised Learning with Viewpoint Trajectory Regularizationcited by 7
- 2023Linear-Covariance Loss for End-to-End Learning of 6D Pose Estimationcited by 6
- 2025HccePose(BF): Predicting Front & Back Surfaces to Construct Ultra-Dense 2D-3D Correspondences for Pose Estimationcited by 3
- 2025Linear time small coresets for k-mean clustering of segments with applicationscited by 0
- 2026Robust PnP on a Neuromorphic Processor for Object Pose Estimationcited by 0
- 2026Robust PnP on a Neuromorphic Processor for Object Pose Estimation18 Jul 2026
- 2025Linear time small coresets for k-mean clustering of segments with applications16 Nov 2025
- 2025HccePose(BF): Predicting Front & Back Surfaces to Construct Ultra-Dense 2D-3D Correspondences for Pose Estimation11 Oct 2025
- 2024Pose-Aware Self-Supervised Learning with Viewpoint Trajectory Regularization22 Mar 2024
- 2023Linear-Covariance Loss for End-to-End Learning of 6D Pose Estimation21 Mar 2023
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wild11 Aug 2022