Deep Model-Based 6D Pose Refinement in RGB
Not on the map. Why?
Abstract (arXiv)
We present a novel approach for model-based 6D pose refinement in color data. Building on the established idea of contour-based pose tracking, we teach a deep neural network to predict a translational and rotational update. At the core, we propose a new visual loss that drives the pose update by aligning object contours, thus avoiding the definition of any explicit appearance model. In contrast to previous work our method is correspondence-free, segmentation-free, can handle occlusion and is agnostic to geometrical symmetry as well as visual ambiguities. Additionally, we observe a strong robustness towards rough initialization. The approach can run in real-time and produces pose accuracies that come close to 3D ICP without the need for depth data. Furthermore, our networks are trained from purely synthetic data and will be published together with the refinement code to ensure reproducibility.
Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 20; 2023: 15; 2024: 6; 2025: 1; 2026: 1.
59 papers.
Sort:
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 115
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Featurescited by 109
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Frameworkcited by 81
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networkscited by 69
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2022SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimationcited by 41
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
38 more
- 2022RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimizationcited by 38
- 2022Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimationcited by 34
- 2021Single-view robot pose and joint angle estimation via render & comparecited by 33
- 2022Perspective Flow Aggregation for Data-Limited 6D Object Pose Estimationcited by 32
- 2022DPODv2: Dense Correspondence-Based 6 DoF Pose Estimationcited by 32
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2022Iterative Corresponding Geometry: Fusing Region and Depth for Highly Efficient 3D Tracking of Textureless Objectscited by 30
- 2024G3R: Gradient Guided Generalizable Reconstructioncited by 29
- 2021Vote from the Center: 6 DoF Pose Estimation in RGB-D Images by Radial Keypoint Votingcited by 25
- 20236D-Diff: A Keypoint Diffusion Framework for 6D Object Pose Estimationcited by 24
- 2022TexPose: Neural Texture Learning for Self-Supervised 6D Object Pose Estimationcited by 23
- 2023Markerless Camera-to-Robot Pose Estimation via Self-supervised Sim-to-Real Transfercited by 23
- 2023Challenges for Monocular 6D Object Pose Estimation in Roboticscited by 21
- 2021ACR-Pose: Adversarial Canonical Representation Reconstruction Network for Category Level 6D Object Pose Estimationcited by 20
- 2021DemoGrasp: Few-Shot Learning for Robotic Grasping with Human Demonstrationcited by 20
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Pickingcited by 20
- 2021PR-GCN: A Deep Graph Convolutional Network with Point Refinement for 6D Pose Estimationcited by 17
- 2022Focal Length and Object Pose Estimation via Render and Comparecited by 17
- 2022YOLOPose: Transformer-based Multi-Object 6D Pose Estimation using Keypoint Regressioncited by 17
- 2023Shape-Constraint Recurrent Flow for 6D Object Pose Estimationcited by 17
- 2021T6D-Direct: Transformers for Multi-Object 6D Pose Direct Regressioncited by 16
- 2021PFRL: Pose-Free Reinforcement Learning for 6D Pose Estimationcited by 14
- 2021DSC-PoseNet: Learning 6DoF Object Pose Estimation via Dual-scale Consistencycited by 14
- 2021Deep Feedback Inverse Problem Solvercited by 11
- 2023Diff-DOPE: Differentiable Deep Object Pose Estimationcited by 11
- 2024MRC-Net: 6-DoF Pose Estimation with MultiScale Residual Correlationcited by 11
- 2025LIFe-GoM: Generalizable Human Rendering with Learned Iterative Feedback Over Multi-Resolution Gaussians-on-Meshcited by 11
- 2022Multi-View Object Pose Refinement With Differentiable Renderercited by 8
- 2023Fusing Visual Appearance and Geometry for Multi-modality 6DoF Object Trackingcited by 7
- 2021Occlusion-Robust Object Pose Estimation with Holistic Representationcited by 6
- 2023Linear-Covariance Loss for End-to-End Learning of 6D Pose Estimationcited by 6
- 2021VIPose: Real-time Visual-Inertial 6D Object Pose Trackingcited by 5
- 2022Photo-realistic Neural Domain Randomizationcited by 5
- 20233D Neural Embedding Likelihood: Probabilistic Inverse Graphics for Robust 6D Pose Estimationcited by 5
- 2023DTF-Net: Category-Level Pose Estimation and Shape Reconstruction via Deformable Template Fieldcited by 5
- 2023YOLOPose V2: Understanding and Improving Transformer-based 6D Pose Estimationcited by 3
- 2023Physics-Based Rigid Body Object Tracking and Friction Filtering From RGB-D Videoscited by 3
- 2023FocalPose++: Focal Length and Object Pose Estimation via Render and Comparecited by 3
50 most cited of 59 All 59 (JSON)
- 2026Cov2Pose: Leveraging Spatial Covariance for Direct Manifold-aware 6-DoF Object Pose Estimation20 Mar 2026
- 2025LIFe-GoM: Generalizable Human Rendering with Learned Iterative Feedback Over Multi-Resolution Gaussians-on-Mesh13 Feb 2025
- 2024G3R: Gradient Guided Generalizable Reconstruction28 Sep 2024
- 2024Sparse Color-Code Net: Real-Time RGB-Based 6D Object Pose Estimation on Edge Devices5 Jun 2024
- 2024Resolving Symmetry Ambiguity in Correspondence-based Methods for Instance-level Object Pose Estimation17 May 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024GISR: Geometric Initialization and Silhouette-based Refinement for Single-View Robot Pose and Configuration Estimation8 May 2024
- 2024MRC-Net: 6-DoF Pose Estimation with MultiScale Residual Correlation12 Mar 2024
- 20236D-Diff: A Keypoint Diffusion Framework for 6D Object Pose Estimation29 Dec 2023
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Features30 Nov 2023
- 2023FocalPose++: Focal Length and Object Pose Estimation via Render and Compare15 Nov 2023
- 2023Diff-DOPE: Differentiable Deep Object Pose Estimation30 Sep 2023
38 more
- 2023Physics-Based Rigid Body Object Tracking and Friction Filtering From RGB-D Videos27 Sep 2023
- 2023Exploiting Point-Wise Attention in 6D Object Pose Estimation Based on Bidirectional Prediction16 Aug 2023
- 2023DTF-Net: Category-Level Pose Estimation and Shape Reconstruction via Deformable Template Field4 Aug 2023
- 2023Challenges for Monocular 6D Object Pose Estimation in Robotics22 Jul 2023
- 2023YOLOPose V2: Understanding and Improving Transformer-based 6D Pose Estimation21 Jul 2023
- 2023Shape-Constraint Recurrent Flow for 6D Object Pose Estimation23 Jun 2023
- 2023Manifold-Aware Self-Training for Unsupervised Domain Adaptation on Regressing 6D Object Pose18 May 2023
- 2023Linear-Covariance Loss for End-to-End Learning of 6D Pose Estimation21 Mar 2023
- 2023Markerless Camera-to-Robot Pose Estimation via Self-supervised Sim-to-Real Transfer28 Feb 2023
- 2023Fusing Visual Appearance and Geometry for Multi-modality 6DoF Object Tracking22 Feb 2023
- 20233D Neural Embedding Likelihood: Probabilistic Inverse Graphics for Robust 6D Pose Estimation7 Feb 2023
- 2022TexPose: Neural Texture Learning for Self-Supervised 6D Object Pose Estimation25 Dec 2022
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare13 Dec 2022
- 2022Photo-realistic Neural Domain Randomization23 Oct 2022
- 2022PCKRF: Point Cloud Completion and Keypoint Refinement With Fusion Data for 6D Pose Estimation7 Oct 2022
- 2022SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimation13 Aug 2022
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimation30 Jul 2022
- 2022Multi-View Object Pose Refinement With Differentiable Renderer6 Jul 2022
- 2022DPODv2: Dense Correspondence-Based 6 DoF Pose Estimation6 Jul 2022
- 2022DeepRM: Deep Recurrent Matching for 6D Pose Refinement28 May 2022
- 2022YOLOPose: Transformer-based Multi-Object 6D Pose Estimation using Keypoint Regression5 May 2022
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Picking14 Apr 2022
- 2022Focal Length and Object Pose Estimation via Render and Compare11 Apr 2022
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Framework29 Mar 2022
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objects28 Mar 2022
- 2022RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization24 Mar 2022
- 2022Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimation19 Mar 2022
- 2022Perspective Flow Aggregation for Data-Limited 6D Object Pose Estimation18 Mar 2022
- 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimation17 Mar 2022
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Voting15 Mar 2022
- 2022Iterative Corresponding Geometry: Fusing Region and Depth for Highly Efficient 3D Tracking of Textureless Objects10 Mar 2022
- 2021DemoGrasp: Few-Shot Learning for Robotic Grasping with Human Demonstration6 Dec 2021
- 2021ACR-Pose: Adversarial Canonical Representation Reconstruction Network for Category Level 6D Object Pose Estimation20 Nov 2021
- 2021Occlusion-Robust Object Pose Estimation with Holistic Representation22 Oct 2021
- 2021T6D-Direct: Transformers for Multi-Object 6D Pose Direct Regression22 Sep 2021
- 2021PR-GCN: A Deep Graph Convolutional Network with Point Refinement for 6D Pose Estimation23 Aug 2021
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networks19 Aug 2021
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimation18 Aug 2021
50 newest of 59 All 59 (JSON)
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 115
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Featurescited by 109
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Frameworkcited by 81
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networkscited by 69
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2022SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimationcited by 41
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
12 most cited of 59 All 59 (JSON)
- 2026Cov2Pose: Leveraging Spatial Covariance for Direct Manifold-aware 6-DoF Object Pose Estimation20 Mar 2026
- 2025LIFe-GoM: Generalizable Human Rendering with Learned Iterative Feedback Over Multi-Resolution Gaussians-on-Mesh13 Feb 2025
- 2024G3R: Gradient Guided Generalizable Reconstruction28 Sep 2024
- 2024Sparse Color-Code Net: Real-Time RGB-Based 6D Object Pose Estimation on Edge Devices5 Jun 2024
- 2024Resolving Symmetry Ambiguity in Correspondence-based Methods for Instance-level Object Pose Estimation17 May 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024GISR: Geometric Initialization and Silhouette-based Refinement for Single-View Robot Pose and Configuration Estimation8 May 2024
- 2024MRC-Net: 6-DoF Pose Estimation with MultiScale Residual Correlation12 Mar 2024
- 20236D-Diff: A Keypoint Diffusion Framework for 6D Object Pose Estimation29 Dec 2023
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Features30 Nov 2023
- 2023FocalPose++: Focal Length and Object Pose Estimation via Render and Compare15 Nov 2023
- 2023Diff-DOPE: Differentiable Deep Object Pose Estimation30 Sep 2023
12 newest of 59 All 59 (JSON)