6D Object Pose Regression via Supervised Learning on Point Clouds
Not on the map. Why?
Abstract (arXiv)
This paper addresses the task of estimating the 6 degrees of freedom pose of a known 3D object from depth information represented by a point cloud. Deep features learned by convolutional neural networks from color information have been the dominant features to be used for inferring object poses, while depth information receives much less attention. However, depth information contains rich geometric information of the object shape, which is important for inferring the object pose. We use depth information represented by point clouds as the input to both deep networks and geometry-based pose refinement and use separate networks for rotation and translation regression. We argue that the axis-angle representation is a suitable rotation representation for deep learning, and use a geodesic loss function for rotation regression. Ablation studies show that these design choices outperform alternatives such as the quaternion representation and L2 loss, or regressing translation and rotation with the same network. Our simple yet effective approach clearly outperforms state-of-the-art methods on the YCB-video dataset. The implementation and trained model are avaliable at: https://github.com/GeeeG/CloudPose.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 8; 2023: 6; 2024: 5; 2025: 7; 2026: 3.
33 papers.
Sort:
By area:
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 115
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimationcited by 53
- 2022OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimationcited by 43
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2022CPPF: Towards Robust Category-Level 9D Pose Estimation in the Wildcited by 28
- 2024DiffusionNOCS: Managing Symmetry and Uncertainty in Sim2Real Multi-Modal Category-level Pose Estimationcited by 25
- 2022Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wildcited by 22
- 2022ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Frameworkcited by 19
- 2021StablePose: Learning 6D Object Poses from Geometrically Stable Patchescited by 17
- 2021CloudAAE: Learning 6D Object Pose Regression with On-line Data Synthesis on Point Cloudscited by 15
- 2023ViHOPE: Visuotactile In-Hand Object 6D Pose Estimation with Shape Completioncited by 14
21 more
- 2023GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondencecited by 12
- 20246DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splattingcited by 11
- 2023Depth-based 6DoF Object Pose Estimation using Swin Transformercited by 8
- 2022Keypoint Cascade Voting for Point Cloud Based 6DoF Pose Estimationcited by 7
- 2023TransPose: 6D Object Pose Estimation with Geometry-Aware Transformercited by 7
- 2022CPPF++: Uncertainty-Aware Sim2Real Object Pose Estimation by Vote Aggregationcited by 6
- 2022Quasi-Balanced Self-Training on Noise-Aware Synthesis of Object Point Clouds for Closing Domain Gapcited by 5
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Framescited by 3
- 2025Structure-Aware Correspondence Learning for Relative Pose Estimationcited by 3
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimationcited by 1
- 2022Det6D: A Ground-Aware Full-Pose 3D Object Detector for Improving Terrain Robustnesscited by 0
- 2023TransPose: A Transformer-based 6D Object Pose Estimation Network with Depth Refinementcited by 0
- 2023KVN: Keypoints Voting Network with Differentiable RANSAC for Stereo Pose Estimationcited by 0
- 2024FastPoseCNN: Real-Time Monocular Category-Level Pose and Size Estimation Frameworkcited by 0
- 2025Learning Point Cloud Representations with Pose Continuity for Depth-Based Category-Level 6D Object Pose Estimationcited by 0
- 2025SCOPE: Semantic Conditioning for Sim2Real Category-Level Object Pose Estimation in Roboticscited by 0
- 2025DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objectscited by 0
- 2025Equivariant symmetry-aware head pose estimation for fetal MRIcited by 0
- 2026Detecting 3D Line Segments for 6DoF Pose Estimation with Limited Datacited by 0
- 2026Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Modelscited by 0
- 2026G6D: Geometric Learning-Free RGB-D 6D Pose Solver for Robotic Manipulationcited by 0
- 2026G6D: Geometric Learning-Free RGB-D 6D Pose Solver for Robotic Manipulation20 Sep 2026
- 2026Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Models15 Jun 2026
- 2026Detecting 3D Line Segments for 6DoF Pose Estimation with Limited Data17 Jan 2026
- 2025Equivariant symmetry-aware head pose estimation for fetal MRI4 Dec 2025
- 2025DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objects13 Oct 2025
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation5 Oct 2025
- 2025SCOPE: Semantic Conditioning for Sim2Real Category-Level Object Pose Estimation in Robotics29 Sep 2025
- 2025Learning Point Cloud Representations with Pose Continuity for Depth-Based Category-Level 6D Object Pose Estimation20 Aug 2025
- 2025Structure-Aware Correspondence Learning for Relative Pose Estimation24 Mar 2025
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames5 Mar 2025
- 20246DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splatting2 Dec 2024
- 2024FastPoseCNN: Real-Time Monocular Category-Level Pose and Size Estimation Framework16 Jun 2024
21 more
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024DiffusionNOCS: Managing Symmetry and Uncertainty in Sim2Real Multi-Modal Category-level Pose Estimation20 Feb 2024
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videos23 Jan 2024
- 2023GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence23 Nov 2023
- 2023TransPose: 6D Object Pose Estimation with Geometry-Aware Transformer25 Oct 2023
- 2023ViHOPE: Visuotactile In-Hand Object 6D Pose Estimation with Shape Completion11 Sep 2023
- 2023KVN: Keypoints Voting Network with Differentiable RANSAC for Stereo Pose Estimation21 Jul 2023
- 2023TransPose: A Transformer-based 6D Object Pose Estimation Network with Depth Refinement9 Jul 2023
- 2023Depth-based 6DoF Object Pose Estimation using Swin Transformer3 Mar 2023
- 2022CPPF++: Uncertainty-Aware Sim2Real Object Pose Estimation by Vote Aggregation24 Nov 2022
- 2022Keypoint Cascade Voting for Point Cloud Based 6DoF Pose Estimation14 Oct 2022
- 2022Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wild13 Oct 2022
- 2022Det6D: A Ground-Aware Full-Pose 3D Object Detector for Improving Terrain Robustness19 Jul 2022
- 2022ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Framework3 Apr 2022
- 2022Quasi-Balanced Self-Training on Noise-Aware Synthesis of Object Point Clouds for Closing Domain Gap8 Mar 2022
- 2022CPPF: Towards Robust Category-Level 9D Pose Estimation in the Wild7 Mar 2022
- 2022OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimation2 Mar 2022
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimation27 Jun 2021
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overview29 May 2021
- 2021CloudAAE: Learning 6D Object Pose Regression with On-line Data Synthesis on Point Clouds2 Mar 2021
- 2021StablePose: Learning 6D Object Poses from Geometrically Stable Patches18 Feb 2021
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 115
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimationcited by 53
- 2022OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimationcited by 43
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2022CPPF: Towards Robust Category-Level 9D Pose Estimation in the Wildcited by 28
- 2024DiffusionNOCS: Managing Symmetry and Uncertainty in Sim2Real Multi-Modal Category-level Pose Estimationcited by 25
- 2022Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wildcited by 22
- 2022ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Frameworkcited by 19
- 2021StablePose: Learning 6D Object Poses from Geometrically Stable Patchescited by 17
- 2021CloudAAE: Learning 6D Object Pose Regression with On-line Data Synthesis on Point Cloudscited by 15
- 2023ViHOPE: Visuotactile In-Hand Object 6D Pose Estimation with Shape Completioncited by 14
12 most cited of 32 All 32 (JSON)
- 2026G6D: Geometric Learning-Free RGB-D 6D Pose Solver for Robotic Manipulation20 Sep 2026
- 2026Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Models15 Jun 2026
- 2026Detecting 3D Line Segments for 6DoF Pose Estimation with Limited Data17 Jan 2026
- 2025Equivariant symmetry-aware head pose estimation for fetal MRI4 Dec 2025
- 2025DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objects13 Oct 2025
- 2025SCOPE: Semantic Conditioning for Sim2Real Category-Level Object Pose Estimation in Robotics29 Sep 2025
- 2025Learning Point Cloud Representations with Pose Continuity for Depth-Based Category-Level 6D Object Pose Estimation20 Aug 2025
- 2025Structure-Aware Correspondence Learning for Relative Pose Estimation24 Mar 2025
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames5 Mar 2025
- 20246DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splatting2 Dec 2024
- 2024FastPoseCNN: Real-Time Monocular Category-Level Pose and Size Estimation Framework16 Jun 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
12 newest of 32 All 32 (JSON)