Open Challenges for Monocular Single-shot 6D Object Pose Estimation
Not on the map. Why?
Abstract (arXiv)
Object pose estimation is a non-trivial task that enables robotic manipulation, bin picking, augmented reality, and scene understanding, to name a few use cases. Monocular object pose estimation gained considerable momentum with the rise of high-performing deep learning-based solutions and is particularly interesting for the community since sensors are inexpensive and inference is fast. Prior works establish the comprehensive state of the art for diverse pose estimation problems. Their broad scopes make it difficult to identify promising future directions. We narrow down the scope to the problem of single-shot monocular 6D object pose estimation, which is commonly used in robotics, and thus are able to identify such trends. By reviewing recent publications in robotics and computer vision, the state of the art is established at the union of both fields. Following that, we identify promising research directions in order to help researchers to formulate relevant research ideas and effectively advance the state of the art. Findings include that methods are sophisticated enough to overcome the domain shift and that occlusion handling is a fundamental challenge. We also highlight problems such as novel object pose estimation and challenging materials handling as central challenges to advance robotics.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 86 of its 111 references that are in the map. First posted on arXiv 23 Feb 2023.
Builds on
86 of 111 references.
References · 86
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 352
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
38 more
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
- 2017BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depthcited by 225
- 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
- 2017T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objectscited by 210
- 2017Real-Time Seamless Single Shot 6D Object Pose Predictioncited by 210
- 2019DPOD: 6D Pose Object Detector and Refinercited by 189
- 2019Implicit 3D Orientation Learning for 6D Object Detection from RGB Imagescited by 170
- 2020Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Imagecited by 170
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 155
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2020EPOS: Estimating 6D Pose of Objects with Symmetriescited by 147
- 2018Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulationcited by 140
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 120
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2020SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulationcited by 118
- 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 115
- 2019HomebrewedDB: RGB-D Dataset for 6D Pose Estimation of 3D Objectscited by 110
- 2020HybridPose: 6D Object Pose Estimation under Hybrid Representationscited by 107
- 2018Segmentation-driven 6D Object Pose Estimationcited by 104
- 2020Category Level Object Pose Estimation via Neural Analysis-by-Synthesiscited by 100
- 2021SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation with Learnt Surface Embeddingscited by 95
- 2022FlowBot3D: Learning 3D Articulation Flow to Manipulate Articulated Objectscited by 91
- 2019Single-Stage 6D Object Pose Estimationcited by 88
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Frameworkcited by 81
- 2015Recovering 6D Object Pose and Predicting Next-Best-View in the Crowdcited by 79
- 2020Self6D: Self-Supervised Monocular 6D Object Pose Estimationcited by 79
- 2019KeyPose: Multi-View 3D Labeling and Keypoint Estimation for Transparent Objectscited by 75
- 2018Making Deep Heatmaps Robust to Partial Occlusions for 3D Object Pose Estimationcited by 74
- 2018Explaining the Ambiguity of Object Detection and 6D Pose From Visual Datacited by 68
- 2021RePOSE: Fast 6D Object Pose Refinement via Deep Texture Renderingcited by 63
- 2015Learning Descriptors for Object Recognition and 3D Pose Estimationcited by 60
- 2022NeRF-Pose: A First-Reconstruct-Then-Regress Approach for Weakly-supervised 6D Object Pose Estimationcited by 57
- 2022Zero-Shot Category-Level Object Pose Estimationcited by 57
- 2022Templates for 3D Object Pose Estimation Revisited: Generalization to New Objects and Robustness to Occlusionscited by 54
- 2022Coupled Iterative Refinement for 6D Multi-Object Pose Estimationcited by 48
- 2022ClearPose: Large-scale Transparent Object Dataset and Benchmarkcited by 46
50 most cited of 86 All 86 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.