H3DNet: 3D Object Detection Using Hybrid Geometric Primitives
Not on the map. Why?
Abstract (arXiv)
We introduce H3DNet, which takes a colorless 3D point cloud as input and outputs a collection of oriented object bounding boxes (or BB) and their semantic labels. The critical idea of H3DNet is to predict a hybrid set of geometric primitives, i.e., BB centers, BB face centers, and BB edge centers. We show how to convert the predicted geometric primitives into object proposals by defining a distance function between an object and the geometric primitives. This distance function enables continuous optimization of object proposals, and its local minimums provide high-fidelity object proposals. H3DNet then utilizes a matching and refinement module to classify object proposals into detected objects and fine-tune the geometric parameters of the detected objects. The hybrid set of geometric primitives not only provides more accurate signals for object detection than using a single type of geometric primitives, but it also provides an overcomplete set of constraints on the resulting 3D layout. Therefore, H3DNet can tolerate outliers in predicted geometric primitives. Our model achieves state-of-the-art 3D detection results on two large datasets with real 3D scans, ScanNet and SUN RGB-D.
Key facts. Cited by 123 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 34; 2023: 30; 2024: 18; 2025: 15; 2026: 6.
123 papers.
Sort:
By area:
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
- 2021ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detectioncited by 157
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2022Multimodal Token Fusion for Vision Transformerscited by 132
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2023OctFormer: Octree-based Transformers for 3D Point Cloudscited by 105
- 2022CenterFormer: Center-based Transformer for 3D Object Detectioncited by 99
38 more
- 2021FCAF3D: Fully Convolutional Anchor-Free 3D Object Detectioncited by 97
- 2022Surface Representation for Point Cloudscited by 84
- 2023CLIP2: Contrastive Language-Image-Point Pretraining from Real-World Point Cloud Datacited by 69
- 2021Back-tracing Representative Points for Voting-based 3D Object Detection in Point Cloudscited by 67
- 2021Pri3D: Can 3D Priors Help 2D Representation Learning?cited by 61
- 2022CAGroup3D: Class-Aware Grouping for 3D Object Detection on Point Cloudscited by 58
- 2023PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigmcited by 56
- 20214DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understandingcited by 54
- 2023PiMAE: Point Cloud and Image Interactive Masked Autoencoders for 3D Object Detectioncited by 53
- 2021D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Groundingcited by 52
- 2023NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View 3D Object Detectioncited by 51
- 2023CoDA: Collaborative Novel Box Discovery and Cross-modal Alignment for Open-vocabulary 3D Object Detectioncited by 51
- 2022Ponder: Point Cloud Pre-training via Neural Renderingcited by 50
- 2021EPNet++: Cascade Bi-directional Fusion for Multi-Modal 3D Object Detectioncited by 49
- 2023Mask-Attention-Free Transformer for 3D Instance Segmentationcited by 45
- 2023VL-SAT: Visual-Linguistic Semantics Assisted Training for 3D Semantic Scene Graph Prediction in Point Cloudcited by 42
- 2022RBGNet: Ray-based Grouping for 3D Object Detectioncited by 40
- 2021RandomRooms: Unsupervised Pre-training from Synthetic Shapes and Randomized Layouts for 3D Object Detectioncited by 37
- 2021HPNet: Deep Primitive Segmentation Using Hybrid Representationscited by 35
- 2023V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detectioncited by 34
- 2023TR3D: Towards Real-Time Indoor 3D Object Detectioncited by 32
- 20213D Spatial Recognition without Spatially Labeled 3Dcited by 31
- 2021Scene Synthesis via Uncertainty-Driven Attribute Synchronizationcited by 29
- 2021PQ-Transformer: Jointly Parsing 3D Objects and Layouts from Point Cloudscited by 26
- 2023Uni3DETR: Unified 3D Detection Transformercited by 26
- 2022Open-Vocabulary 3D Detection via Image-level Class and Debiased Cross-modal Contrastive Learningcited by 23
- 2022Rotationally Equivariant 3D Object Detectioncited by 21
- 20223D Vision with Transformers: A Surveycited by 21
- 2022LCPFormer: Towards Effective 3D Point Cloud Analysis via Local Context Propagation in Transformerscited by 21
- 2024UniDet3D: Multi-dataset Indoor 3D Object Detectioncited by 20
- 2022Bridged Transformer for Vision and Point Cloud 3D Object Detectioncited by 19
- 2023FM-OV3D: Foundation Model-based Cross-modal Knowledge Blending for Open-Vocabulary 3D Detectioncited by 19
- 2024OV-Uni3DETR: Towards Unified Open-Vocabulary 3D Object Detection via Cycle-Modality Propagationcited by 19
- 2022RGB-Depth Fusion GAN for Indoor Depth Completioncited by 18
- 2022Back to Reality: Weakly-supervised 3D Object Detection with Shape-guided Label Enhancementcited by 17
- 2024Collaborative Novel Object Discovery and Box-Guided Cross-Modal Alignment for Open-Vocabulary 3D Object Detectioncited by 17
- 2023ConDaFormer: Disassembled Transformer with Local Structure Enhancement for 3D Point Cloud Understandingcited by 16
- 2023Mask3D: Pre-training 2D Vision Transformers by Learning Masked 3D Priorscited by 15
50 most cited of 123 All 123 (JSON)
- 2026ShelfChange3D: Object-Level 3D Change Detection for Retail Shelf Monitoring1 Oct 2026
- 2026DIFTA-3D: Depth-Consistent Instance-Level Feature Transfer and Adaptation of DINOv3 for 3D Detection22 Sep 2026
- 2026PVCap: Towards Accurate 3D Dense Captioning via PseudoCap and VoxelCapNet7 Jul 2026
- 2026Boxer: Robust Lifting of Open-World 2D Bounding Boxes to 3D6 Apr 2026
- 2026Group3D: MLLM-Driven Semantic Grouping for Open-Vocabulary 3D Object Detection23 Mar 2026
- 2026SoPE: Spherical Coordinate-Based Positional Embedding for Enhancing Spatial Perception of 3D LVLMs26 Feb 2026
- 2025Auto-Vocabulary 3D Object Detection18 Dec 2025
- 2025DetAny4D: Detect Anything 4D Temporally in a Streaming RGB Video24 Nov 2025
- 2025CHARM: Control-point-based 3D Anime Hairstyle Auto-Regressive Modeling25 Sep 2025
- 2025Sparse Multiview Open-Vocabulary 3D Detection19 Sep 2025
- 2025OpenM3D: Open Vocabulary Multi-view Indoor 3D Object Detection without Human Annotations27 Aug 2025
- 2025Boosting Multi-View Indoor 3D Object Detection via Adaptive 3D Volume Construction24 Jul 2025
38 more
- 20253DGeoDet: General-purpose Geometry-aware Image-based 3D Object Detection11 Jun 2025
- 2025Sketchy Bounding-box Supervision for 3D Instance Segmentation22 May 2025
- 2025GLRD: Global-Local Collaborative Reason and Debate with PSL for 3D Open-Vocabulary Detection26 Mar 2025
- 2025GO-N3RDet: Geometry Optimized NeRF-enhanced 3D Object Detector19 Mar 2025
- 2025State Space Model Meets Transformer: A New Paradigm for 3D Object Detection18 Mar 2025
- 2025MoMa-Kitchen: A 100K+ Benchmark for Affordance-Grounded Last-Mile Navigation in Mobile Manipulation14 Mar 2025
- 2025TARS: Traffic-Aware Radar Scene Flow Estimation13 Mar 2025
- 2025HexPlane Representation for 3D Semantic Scene Understanding7 Mar 2025
- 2025PointSplit: Towards On-device 3D Object Detection with Heterogeneous Low-power Accelerators4 Mar 2025
- 2024Point Cloud Unsupervised Pre-training via 3D Gaussian Splatting27 Nov 2024
- 2024Constraint-Aware Feature Learning for Parametric Point Cloud12 Nov 2024
- 2024One for All: Multi-Domain Joint Training for Point Cloud Based 3D Object Detection3 Nov 2024
- 2024MVSDet: Multi-View Indoor 3D Object Detection via Efficient Plane Sweeps28 Oct 2024
- 2024UniDet3D: Multi-dataset Indoor 3D Object Detection6 Sep 2024
- 2024Diff3DETR:Agent-based Diffusion Model for Semi-supervised 3D Object Detection1 Aug 2024
- 2024General Geometry-aware Weakly Supervised 3D Object Detection18 Jul 2024
- 2024Global-Local Collaborative Inference with LLM for Lidar-Based Open-Vocabulary Detection12 Jul 2024
- 2024Boosting 3D Object Detection with Semantic-Aware Multi-Branch Framework8 Jul 2024
- 2024Syn-to-Real Unsupervised Domain Adaptation for Indoor 3D Object Detection17 Jun 2024
- 2024Enhancing Generalizability of Representation Learning for Data-Efficient 3D Scene Understanding17 Jun 2024
- 2024Collaborative Novel Object Discovery and Box-Guided Cross-Modal Alignment for Open-Vocabulary 3D Object Detection2 Jun 2024
- 2024X-3D: Explicit 3D Structure Modeling for Point Cloud Recognition23 Apr 2024
- 2024Weakly-Supervised 3D Scene Graph Generation via Visual-Linguistic Assisted Pseudo-labeling3 Apr 2024
- 2024OV-Uni3DETR: Towards Unified Open-Vocabulary 3D Object Detection via Cycle-Modality Propagation28 Mar 2024
- 2024FastCAD: Real-Time CAD Retrieval and Alignment from Scans and Videos22 Mar 2024
- 20243D Object Detection from Point Cloud via Voting Step Diffusion21 Mar 2024
- 2024MM-Point: Multi-View Information-Enhanced Multi-Modal Self-Supervised 3D Point Cloud Understanding15 Feb 2024
- 2023FM-OV3D: Foundation Model-based Cross-modal Knowledge Blending for Open-Vocabulary 3D Detection22 Dec 2023
- 2023SPGroup3D: Superpoint Grouping Network for Indoor 3D Object Detection21 Dec 2023
- 2023ConDaFormer: Disassembled Transformer with Local Structure Enhancement for 3D Point Cloud Understanding18 Dec 2023
- 2023Not Every Side Is Equal: Localization Uncertainty Estimation for Semi-Supervised 3D Object Detection16 Dec 2023
- 2023Semantic Complete Scene Forecasting from a 4D Dynamic Point Cloud Sequence13 Dec 2023
- 2023PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm12 Oct 2023
- 20233DS-SLAM: A 3D Object Detection based Semantic SLAM towards Dynamic Indoor Environments10 Oct 2023
- 2023Uni3DETR: Unified 3D Detection Transformer9 Oct 2023
- 2023CoDA: Collaborative Novel Box Discovery and Cross-modal Alignment for Open-vocabulary 3D Object Detection4 Oct 2023
- 2023Model2Scene: Learning 3D Scene Representation via Contrastive Language-CAD Models Pre-training29 Sep 2023
- 2023Shape Anchor Guided Holistic Indoor Scene Understanding20 Sep 2023
50 newest of 123 All 123 (JSON)
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
- 2021ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detectioncited by 157
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2022Multimodal Token Fusion for Vision Transformerscited by 132
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2023OctFormer: Octree-based Transformers for 3D Point Cloudscited by 105
- 2022CenterFormer: Center-based Transformer for 3D Object Detectioncited by 99
12 most cited of 120 All 120 (JSON)
- 2026ShelfChange3D: Object-Level 3D Change Detection for Retail Shelf Monitoring1 Oct 2026
- 2026DIFTA-3D: Depth-Consistent Instance-Level Feature Transfer and Adaptation of DINOv3 for 3D Detection22 Sep 2026
- 2026PVCap: Towards Accurate 3D Dense Captioning via PseudoCap and VoxelCapNet7 Jul 2026
- 2026Boxer: Robust Lifting of Open-World 2D Bounding Boxes to 3D6 Apr 2026
- 2026Group3D: MLLM-Driven Semantic Grouping for Open-Vocabulary 3D Object Detection23 Mar 2026
- 2025Auto-Vocabulary 3D Object Detection18 Dec 2025
- 2025DetAny4D: Detect Anything 4D Temporally in a Streaming RGB Video24 Nov 2025
- 2025CHARM: Control-point-based 3D Anime Hairstyle Auto-Regressive Modeling25 Sep 2025
- 2025Sparse Multiview Open-Vocabulary 3D Detection19 Sep 2025
- 2025OpenM3D: Open Vocabulary Multi-view Indoor 3D Object Detection without Human Annotations27 Aug 2025
- 2025Boosting Multi-View Indoor 3D Object Detection via Adaptive 3D Volume Construction24 Jul 2025
- 20253DGeoDet: General-purpose Geometry-aware Image-based 3D Object Detection11 Jun 2025
12 newest of 120 All 120 (JSON)