Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimation
Not on the map. Why?
Abstract (arXiv)
We present a 3D object detection method that uses regressed descriptors of locally-sampled RGB-D patches for 6D vote casting. For regression, we employ a convolutional auto-encoder that has been trained on a large collection of random local patches. During testing, scene patch descriptors are matched against a database of synthetic model view patches and cast 6D object votes which are subsequently filtered to refined hypotheses. We evaluate on three datasets to show that our method generalizes well to previously unseen input data, delivers robust detection results that compete with and surpass the state-of-the-art while being scalable in the number of objects.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jul 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 18; 2023: 3; 2024: 2; 2025: 2.
34 papers.
Sort:
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimizationcited by 70
- 2022CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimationcited by 69
- 2022Anomaly Detection in 3D Point Clouds using Deep Geometric Descriptorscited by 66
- 2021Convolutional Hough Matching Networkscited by 43
- 2022OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimationcited by 43
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2022Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimationcited by 34
- 2022DPODv2: Dense Correspondence-Based 6 DoF Pose Estimationcited by 32
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
22 more
- 2022CPPF: Towards Robust Category-Level 9D Pose Estimation in the Wildcited by 28
- 2022Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimationcited by 22
- 20216D-ViT: Category-Level 6D Object Pose Estimation via Transformer-based Instance Representation Learningcited by 20
- 2023FSD: Fast Self-Supervised Single RGB-D to Categorical 3D Objectscited by 18
- 2021StablePose: Learning 6D Object Poses from Geometrically Stable Patchescited by 17
- 2024LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimationcited by 13
- 2021Convolutional Hough Matching Networks for Robust and Efficient Visual Correspondencecited by 12
- 2022Spacecraft Pose Estimation Based on Unsupervised Domain Adaptation and on a 3D-Guided Loss Combinationcited by 12
- 2021KDFNet: Learning Keypoint Distance Field for 6D Object Pose Estimationcited by 9
- 2022DCL-Net: Deep Correspondence Learning Network for 6D Pose Estimationcited by 9
- 2023Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunitiescited by 9
- 2022HMD-EgoPose: Head-Mounted Display-Based Egocentric Marker-Less Tool and Hand Pose Estimation for Augmented Surgical Guidancecited by 5
- 2022Survey and Systematization of 3D Object Detection Models and Methodscited by 3
- 2022BiCo-Net: Regress Globally, Match Locally for Robust 6D Pose Estimationcited by 3
- 2022Spatial Feature Mapping for 6DoF Object Pose Estimationcited by 3
- 2021MPF6D: Masked Pyramid Fusion 6D Pose Estimationcited by 0
- 2022Weakly Supervised Learning of Keypoints for 6D Object Pose Estimationcited by 0
- 2022Context-aware 6D Pose Estimation of Known Objects using RGB-D datacited by 0
- 2023Canonical mapping as a general-purpose object descriptor for robotic manipulationcited by 0
- 2024Detection, Recognition and Pose Estimation of Tabletop Objectscited by 0
- 2025Glissando-Net: Deep sinGLe vIew category level poSe eStimation ANd 3D recOnstructioncited by 0
- 2025GTR: Gaussian Splatting Tracking and Reconstruction of Unknown Objects Based on Appearance and Geometric Complexitycited by 0
- 2025GTR: Gaussian Splatting Tracking and Reconstruction of Unknown Objects Based on Appearance and Geometric Complexity17 May 2025
- 2025Glissando-Net: Deep sinGLe vIew category level poSe eStimation ANd 3D recOnstruction24 Jan 2025
- 2024LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimation24 Sep 2024
- 2024Detection, Recognition and Pose Estimation of Tabletop Objects1 Sep 2024
- 2023FSD: Fast Self-Supervised Single RGB-D to Categorical 3D Objects19 Oct 2023
- 2023Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunities12 Oct 2023
- 2023Canonical mapping as a general-purpose object descriptor for robotic manipulation2 Mar 2023
- 2022Spacecraft Pose Estimation Based on Unsupervised Domain Adaptation and on a 3D-Guided Loss Combination27 Dec 2022
- 2022Context-aware 6D Pose Estimation of Known Objects using RGB-D data11 Dec 2022
- 2022DCL-Net: Deep Correspondence Learning Network for 6D Pose Estimation11 Oct 2022
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimation30 Jul 2022
- 2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimization27 Jul 2022
22 more
- 2022DPODv2: Dense Correspondence-Based 6 DoF Pose Estimation6 Jul 2022
- 2022Spatial Feature Mapping for 6DoF Object Pose Estimation3 Jun 2022
- 2022BiCo-Net: Regress Globally, Match Locally for Robust 6D Pose Estimation7 May 2022
- 2022Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimation28 Mar 2022
- 2022Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimation19 Mar 2022
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Voting15 Mar 2022
- 2022Weakly Supervised Learning of Keypoints for 6D Object Pose Estimation7 Mar 2022
- 2022CPPF: Towards Robust Category-Level 9D Pose Estimation in the Wild7 Mar 2022
- 2022CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimation3 Mar 2022
- 2022OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimation2 Mar 2022
- 2022HMD-EgoPose: Head-Mounted Display-Based Egocentric Marker-Less Tool and Hand Pose Estimation for Augmented Surgical Guidance24 Feb 2022
- 2022Anomaly Detection in 3D Point Clouds using Deep Geometric Descriptors23 Feb 2022
- 2022Survey and Systematization of 3D Object Detection Models and Methods23 Jan 2022
- 2021MPF6D: Masked Pyramid Fusion 6D Pose Estimation17 Nov 2021
- 20216D-ViT: Category-Level 6D Object Pose Estimation via Transformer-based Instance Representation Learning10 Oct 2021
- 2021KDFNet: Learning Keypoint Distance Field for 6D Object Pose Estimation21 Sep 2021
- 2021Convolutional Hough Matching Networks for Robust and Efficient Visual Correspondence11 Sep 2021
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimation18 Aug 2021
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overview29 May 2021
- 2021Convolutional Hough Matching Networks31 Mar 2021
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimation3 Mar 2021
- 2021StablePose: Learning 6D Object Poses from Geometrically Stable Patches18 Feb 2021
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimizationcited by 70
- 2022CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimationcited by 69
- 2022Anomaly Detection in 3D Point Clouds using Deep Geometric Descriptorscited by 66
- 2021Convolutional Hough Matching Networkscited by 43
- 2022OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimationcited by 43
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2022Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimationcited by 34
- 2022DPODv2: Dense Correspondence-Based 6 DoF Pose Estimationcited by 32
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
12 most cited of 34 All 34 (JSON)
- 2025GTR: Gaussian Splatting Tracking and Reconstruction of Unknown Objects Based on Appearance and Geometric Complexity17 May 2025
- 2025Glissando-Net: Deep sinGLe vIew category level poSe eStimation ANd 3D recOnstruction24 Jan 2025
- 2024LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimation24 Sep 2024
- 2024Detection, Recognition and Pose Estimation of Tabletop Objects1 Sep 2024
- 2023FSD: Fast Self-Supervised Single RGB-D to Categorical 3D Objects19 Oct 2023
- 2023Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunities12 Oct 2023
- 2023Canonical mapping as a general-purpose object descriptor for robotic manipulation2 Mar 2023
- 2022Spacecraft Pose Estimation Based on Unsupervised Domain Adaptation and on a 3D-Guided Loss Combination27 Dec 2022
- 2022Context-aware 6D Pose Estimation of Known Objects using RGB-D data11 Dec 2022
- 2022DCL-Net: Deep Correspondence Learning Network for 6D Pose Estimation11 Oct 2022
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimation30 Jul 2022
- 2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimization27 Jul 2022
12 newest of 34 All 34 (JSON)