Self6D: Self-Supervised Monocular 6D Object Pose Estimation
Not on the map. Why?
Abstract (arXiv)
6D object pose estimation is a fundamental problem in computer vision. Convolutional Neural Networks (CNNs) have recently proven to be capable of predicting reliable 6D pose estimates even from monocular images. Nonetheless, CNNs are identified as being extremely data-driven, and acquiring adequate annotations is oftentimes very time-consuming and labor intensive. To overcome this shortcoming, we propose the idea of monocular 6D pose estimation by means of self-supervised learning, removing the need for real annotations. After training our proposed network fully supervised with synthetic RGB data, we leverage recent advances in neural rendering to further self-supervise the model on unannotated real RGB-D data, seeking for a visually and geometrically optimal alignment. Extensive evaluations demonstrate that our proposed self-supervision is able to significantly enhance the model's original performance, outperforming all other methods relying on synthetic data or employing elaborate techniques from the domain adaptation realm.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 24; 2023: 18; 2024: 15; 2025: 5; 2026: 2.
79 papers.
Sort:
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 120
- 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 115
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2021MonoRUn: Monocular 3D Object Detection by Reconstruction and Uncertainty Propagationcited by 82
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
- 2022Category-Level 6D Object Pose and Size Estimation using Self-Supervised Deep Prior Deformation Networkscited by 73
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2022NeRF-Pose: A First-Reconstruct-Then-Regress Approach for Weakly-supervised 6D Object Pose Estimationcited by 57
- 2021Leveraging SE(3) Equivariance for Self-Supervised Category-Level Object Pose Estimationcited by 45
- 2022OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimationcited by 43
- 2021Category-Level Metric Scale Object Shape and Pose Estimationcited by 40
38 more
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
- 2022Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimationcited by 34
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2021Projective Manifold Gradient Layer for Deep Rotation Regressioncited by 31
- 2021Vote from the Center: 6 DoF Pose Estimation in RGB-D Images by Radial Keypoint Votingcited by 25
- 2022TexPose: Neural Texture Learning for Self-Supervised 6D Object Pose Estimationcited by 23
- 2023Challenges for Monocular 6D Object Pose Estimation in Roboticscited by 21
- 2021ACR-Pose: Adversarial Canonical Representation Reconstruction Network for Category Level 6D Object Pose Estimationcited by 20
- 2021DemoGrasp: Few-Shot Learning for Robotic Grasping with Human Demonstrationcited by 20
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Pickingcited by 20
- 2021PoseContrast: Class-Agnostic Object Viewpoint Estimation in the Wild with Pose-Aware Contrastive Learningcited by 19
- 2023FSD: Fast Self-Supervised Single RGB-D to Categorical 3D Objectscited by 18
- 2021StablePose: Learning 6D Object Poses from Geometrically Stable Patchescited by 17
- 2021T6D-Direct: Transformers for Multi-Object 6D Pose Direct Regressioncited by 16
- 2024High-Fidelity SLAM Using Gaussian Splatting with Rendering-Guided Densification and Regularized Optimizationcited by 15
- 2022Certifiable 3D Object Pose Estimation: Foundations, Learning Models, and Self-Trainingcited by 12
- 2023PoseMatcher: One-shot 6D Object Pose Estimation by Deep Feature Matchingcited by 12
- 2023GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondencecited by 12
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Imagecited by 12
- 2022Towards Self-Supervised Category-Level Object Pose and Size Estimationcited by 11
- 2025Scalable Unseen Objects 6-DoF Absolute Pose Estimation with Robotic Integrationcited by 11
- 2022COPE: End-to-end trainable Constant Runtime Object Pose Estimationcited by 10
- 2022Sim2Real Instance-Level Style Transfer for 6D Pose Estimationcited by 9
- 2022LocPoseNet: Robust Location Prior for Unseen Object Pose Estimationcited by 9
- 2023Pseudo Flow Consistency for Self-Supervised 6D Object Pose Estimationcited by 9
- 2024CRISP: Object Pose and Shape Estimation with Test-Time Adaptationcited by 9
- 2022Sim2Real Object-Centric Keypoint Detection and Descriptioncited by 8
- 2024OP-Align: Object-level and Part-level Alignment for Self-supervised Category-level Articulated Object Pose Estimationcited by 8
- 2022Semantic keypoint-based pose estimation from single RGB framescited by 7
- 2023A Correct-and-Certify Approach to Self-Supervise Object Pose Estimators via Ensemble Self-Trainingcited by 6
- 2023Tracking by 3D Model Estimation of Unknown Objects in Videoscited by 5
- 2023DR-Pose: A Two-stage Deformation-and-Registration Pipeline for Category-level 6D Object Pose Estimationcited by 5
- 2022Uni6Dv2: Noise Elimination for 6D Pose Estimationcited by 4
- 2023Differentiable Shadow Mapping for Efficient Inverse Graphicscited by 4
- 2023Pseudo-keypoint RKHS Learning for Self-supervised 6DoF Pose Estimationcited by 4
- 2024NeRF-Feat: 6D Object Pose Estimation using Feature Renderingcited by 4
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learningcited by 4
- 20256D Strawberry Pose Estimation: Real-time and Edge AI Solutions Using Purely Synthetic Training Datacited by 4
50 most cited of 79 All 79 (JSON)
- 2026Object Pose and Shape Estimation for Grasping: Does it Work?26 May 2026
- 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimation28 Feb 2026
- 20256D Strawberry Pose Estimation: Real-time and Edge AI Solutions Using Purely Synthetic Training Data14 Nov 2025
- 2025Instance-Level Generation for Representation Learning10 Oct 2025
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning9 Jul 2025
- 2025SurgPose: Generalisable Surgical Instrument Pose Estimation using Zero-Shot Learning and Stereo Vision16 May 2025
- 2025Scalable Unseen Objects 6-DoF Absolute Pose Estimation with Robotic Integration7 Mar 2025
- 2024CRISP: Object Pose and Shape Estimation with Test-Time Adaptation2 Dec 2024
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image25 Nov 2024
- 2024FAFA: Frequency-Aware Flow-Aided Self-Supervision for Underwater Object Pose Estimation25 Sep 2024
- 2024Good Grasps Only: A data engine for self-supervised fine-tuning of pose estimation using grasp poses for verification17 Sep 2024
- 2024Test-Time Certifiable Self-Supervision to Bridge the Sim2Real Gap in Event-Based Satellite Pose Estimation10 Sep 2024
38 more
- 2024MaskVal: Simple but Effective Uncertainty Quantification for 6D Pose Estimation5 Sep 2024
- 2024OP-Align: Object-level and Part-level Alignment for Self-supervised Category-level Articulated Object Pose Estimation29 Aug 2024
- 2024NeRF-Feat: 6D Object Pose Estimation using Feature Rendering19 Jun 2024
- 2024Sparse Color-Code Net: Real-Time RGB-Based 6D Object Pose Estimation on Edge Devices5 Jun 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024Semi-Supervised Unconstrained Head Pose Estimation in the Wild3 Apr 2024
- 2024Diffusion-Driven Self-Supervised Learning for Shape Reconstruction and Pose Estimation19 Mar 2024
- 2024High-Fidelity SLAM Using Gaussian Splatting with Rendering-Guided Densification and Regularized Optimization19 Mar 2024
- 2024SD-Net: Symmetric-Aware Keypoint Prediction and Domain Adaptation for 6D Pose Estimation In Bin-picking Scenarios14 Mar 2024
- 2024Detection and Pose Estimation of flat, Texture-less Industry Objects on HoloLens using synthetic Training7 Feb 2024
- 2023S2P3: Self-Supervised Polarimetric Pose Prediction2 Dec 2023
- 2023A Stochastic-Geometrical Framework for Object Pose Estimation based on Mixture Models Avoiding the Correspondence Problem29 Nov 2023
- 2023GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence23 Nov 2023
- 2023Pseudo-keypoint RKHS Learning for Self-supervised 6DoF Pose Estimation16 Nov 2023
- 2023FSD: Fast Self-Supervised Single RGB-D to Categorical 3D Objects19 Oct 2023
- 2023DR-Pose: A Two-stage Deformation-and-Registration Pipeline for Category-level 6D Object Pose Estimation5 Sep 2023
- 2023Differentiable Shadow Mapping for Efficient Inverse Graphics21 Aug 2023
- 2023Polarimetric Information for Multi-Modal 6D Pose Estimation of Photometrically Challenging Objects with Limited Data21 Aug 2023
- 2023Pseudo Flow Consistency for Self-Supervised 6D Object Pose Estimation19 Aug 2023
- 2023Learning Better Keypoints for Multi-Object 6DoF Pose Estimation15 Aug 2023
- 2023Challenges for Monocular 6D Object Pose Estimation in Robotics22 Jul 2023
- 2023View-to-Label: Multi-View Consistency for Self-Supervised 3D Object Detection29 May 2023
- 2023Manifold-Aware Self-Training for Unsupervised Domain Adaptation on Regressing 6D Object Pose18 May 2023
- 2023Tracking by 3D Model Estimation of Unknown Objects in Videos13 Apr 2023
- 2023PoseMatcher: One-shot 6D Object Pose Estimation by Deep Feature Matching3 Apr 2023
- 2023Open Challenges for Monocular Single-shot 6D Object Pose Estimation23 Feb 2023
- 2023Model-Based Underwater 6D Pose Estimation from RGB14 Feb 2023
- 2023A Correct-and-Certify Approach to Self-Supervise Object Pose Estimators via Ensemble Self-Training12 Feb 2023
- 2022TexPose: Neural Texture Learning for Self-Supervised 6D Object Pose Estimation25 Dec 2022
- 2022LocPoseNet: Robust Location Prior for Unseen Object Pose Estimation29 Nov 2022
- 2022Geo6D: Geometric Constraints Learning for 6D Pose Estimation20 Oct 2022
- 2022CASAPose: Class-Adaptive and Semantic-Aware Multi-Object Pose Estimation11 Oct 2022
- 2022COPE: End-to-end trainable Constant Runtime Object Pose Estimation18 Aug 2022
- 2022Uni6Dv2: Noise Elimination for 6D Pose Estimation15 Aug 2022
- 2022Category-Level 6D Object Pose and Size Estimation using Self-Supervised Deep Prior Deformation Networks12 Jul 2022
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Dataset30 Jun 2022
- 2022Certifiable 3D Object Pose Estimation: Foundations, Learning Models, and Self-Training22 Jun 2022
- 20223D-Augmented Contrastive Knowledge Distillation for Image-based Object Pose Estimation2 Jun 2022
50 newest of 79 All 79 (JSON)
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 120
- 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 115
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2021MonoRUn: Monocular 3D Object Detection by Reconstruction and Uncertainty Propagationcited by 82
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
- 2022Category-Level 6D Object Pose and Size Estimation using Self-Supervised Deep Prior Deformation Networkscited by 73
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2022NeRF-Pose: A First-Reconstruct-Then-Regress Approach for Weakly-supervised 6D Object Pose Estimationcited by 57
- 2021Leveraging SE(3) Equivariance for Self-Supervised Category-Level Object Pose Estimationcited by 45
- 2022OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimationcited by 43
- 2021Category-Level Metric Scale Object Shape and Pose Estimationcited by 40
12 most cited of 79 All 79 (JSON)
- 2026Object Pose and Shape Estimation for Grasping: Does it Work?26 May 2026
- 2026COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimation28 Feb 2026
- 20256D Strawberry Pose Estimation: Real-time and Edge AI Solutions Using Purely Synthetic Training Data14 Nov 2025
- 2025Instance-Level Generation for Representation Learning10 Oct 2025
- 2025MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning9 Jul 2025
- 2025SurgPose: Generalisable Surgical Instrument Pose Estimation using Zero-Shot Learning and Stereo Vision16 May 2025
- 2025Scalable Unseen Objects 6-DoF Absolute Pose Estimation with Robotic Integration7 Mar 2025
- 2024CRISP: Object Pose and Shape Estimation with Test-Time Adaptation2 Dec 2024
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image25 Nov 2024
- 2024FAFA: Frequency-Aware Flow-Aided Self-Supervision for Underwater Object Pose Estimation25 Sep 2024
- 2024Good Grasps Only: A data engine for self-supervised fine-tuning of pose estimation using grasp poses for verification17 Sep 2024
- 2024Test-Time Certifiable Self-Supervision to Bridge the Sim2Real Gap in Event-Based Satellite Pose Estimation10 Sep 2024
12 newest of 79 All 79 (JSON)