HDNET: Exploiting HD Maps for 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
In this paper we show that High-Definition (HD) maps provide strong priors that can boost the performance and robustness of modern 3D object detectors. Towards this goal, we design a single stage detector that extracts geometric and semantic features from the HD maps. As maps might not be available everywhere, we also propose a map prediction module that estimates the map on the fly from raw LiDAR data. We conduct extensive experiments on KITTI as well as a large-scale 3D detection benchmark containing 1 million frames, and show that the proposed map-aware detector consistently outperforms the state-of-the-art in both mapped and un-mapped scenarios. Importantly the whole framework runs at 20 frames per second.
Key facts. Cited by 78 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 19; 2023: 16; 2024: 8; 2025: 4; 2026: 3.
78 papers.
Sort:
By area:
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2021LiDAR R-CNN: An Efficient and Universal 3D Object Detectorcited by 129
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2021Improving 3D Object Detection with Channel-wise Transformercited by 108
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
- 2022COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehiclescited by 95
- 2021FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detectioncited by 92
- 2021Depth-conditioned Dynamic Message Propagation for Monocular 3D Object Detectioncited by 84
38 more
- 2021SceneGen: Learning to Generate Realistic Traffic Scenescited by 83
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 80
- 2023Neural Map Prior for Autonomous Drivingcited by 68
- 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
- 2021Object DGCNN: 3D Object Detection using Dynamic Graphscited by 58
- 2023Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Mapscited by 58
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2022Voxel Field Fusion for 3D Object Detectioncited by 50
- 20214D-Net for Learned Multi-Modal Alignmentcited by 44
- 2021Auto4D: Learning to Label 4D Objects from Sequential Point Cloudscited by 42
- 2022RBGNet: Ray-based Grouping for 3D Object Detectioncited by 40
- 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspectivecited by 37
- 2021YOLOStereo3D: A Step Back to 2D for Efficient Stereo 3D Detectioncited by 34
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
- 2021Pseudo-labeling for Scalable 3D Object Detectioncited by 32
- 2023Implicit Occupancy Flow Fields for Perception and Prediction in Self-Drivingcited by 30
- 2023UniBEV: Multi-modal 3D Object Detection with Uniform BEV Encoders for Robustness against Missing Sensor Modalitiescited by 28
- 2022Trust, but Verify: Cross-Modality Fusion for HD Map Change Detectioncited by 25
- 2021PLUMENet: Efficient 3D Object Detection from Stereo Imagescited by 19
- 2021PolarStream: Streaming Lidar Object Detection and Segmentation with Polar Pillarscited by 18
- 2021Revisiting 3D Object Detection From an Egocentric Perspectivecited by 18
- 2023LiDAR2Map: In Defense of LiDAR-Based Semantic Map Construction Using Online Camera Distillationcited by 18
- 2021A Simple and Efficient Multi-task Network for 3D Object Detection and Road Understandingcited by 17
- 2023ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD Map Constructioncited by 16
- 2023A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Servicescited by 14
- 2021SA-Det3D: Self-Attention Based Context-Aware 3D Object Detectioncited by 13
- 2022AGO-Net: Association-Guided 3D Point Cloud Object Detection Networkcited by 12
- 2022Privacy-preserving Decentralized Federated Learning over Time-varying Communication Graphcited by 11
- 2022Multi-Sem Fusion: Multimodal Semantic Fusion for 3D Object Detectioncited by 11
- 2024QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Drivingcited by 11
- 2021Investigating Attention Mechanism in 3D Point Cloud Object Detectioncited by 10
- 2022THMA: Tencent HD Map AI System for Creating HD Map Annotationscited by 9
- 2025Bridging Perspectives: Foundation Model Guided BEV Maps for 3D Object Detection and Trackingcited by 9
- 2024CMDA: Cross-Modal and Domain Adversarial Adaptation for LiDAR-Based 3D Object Detectioncited by 8
- 2022PseudoAugment: Learning to Use Unlabeled Data for Data Augmentation in Point Cloudscited by 7
- 2023Improving Online Lane Graph Extraction by Object-Lane Clusteringcited by 7
- 2021Safety-Oriented Pedestrian Motion and Scene Occupancy Forecastingcited by 6
- 2021MapFusion: A General Framework for 3D Object Detection with HDMapscited by 6
50 most cited of 78 All 78 (JSON)
- 2026Eyes All Around: Design and Analysis of 360-Degree LiDAR Perception Using Equivariant Feature Learning in Unstructured Traffic30 May 2026
- 2026Scene Reconstruction as Mapping Priors for 3D Detection21 May 2026
- 2026Bridging Structure and Language: Graph-Based Visual Reasoning for Autonomous Road Understanding20 May 2026
- 2025Compressed Map Priors for 3D Perception31 Dec 2025
- 2025nuScenes Revisited: Progress and Challenges in Autonomous Driving2 Dec 2025
- 2025Bridging Perspectives: Foundation Model Guided BEV Maps for 3D Object Detection and Tracking11 Oct 2025
- 2025Multimodal and Multiview Deep Fusion for Autonomous Marine Navigation2 May 2025
- 2024Vectorized Representation Dreamer (VRD): Dreaming-Assisted Multi-Agent Motion-Forecasting20 Jun 2024
- 2024SpotNet: An Image Centric, Lidar Anchored Approach To Long Range Perception24 May 2024
- 2024TS40K: a 3D Point Cloud Dataset of Rural Terrain and Electrical Transmission System22 May 2024
- 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspective8 May 2024
- 2024Toward Physics-Aware Deep Learning Architectures for LiDAR Intensity Simulation24 Apr 2024
38 more
- 2024QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Driving1 Apr 2024
- 2024CMDA: Cross-Modal and Domain Adversarial Adaptation for LiDAR-Based 3D Object Detection6 Mar 2024
- 2024MsSVT++: Mixed-scale Sparse Voxel Transformer with Center Voting for 3D Object Detection22 Jan 2024
- 2023Deep learning for 3D Object Detection and Tracking in Autonomous Driving: A Brief Survey10 Nov 2023
- 2023Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Maps7 Nov 2023
- 2023mmFUSION: Multimodal Fusion for 3D Objects Detection7 Nov 2023
- 2023ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD Map Construction20 Oct 2023
- 2023UniBEV: Multi-modal 3D Object Detection with Uniform BEV Encoders for Robustness against Missing Sensor Modalities25 Sep 2023
- 2023PatchContrast: Self-Supervised Pre-training for 3D Object Detection14 Aug 2023
- 2023Implicit Occupancy Flow Fields for Perception and Prediction in Self-Driving2 Aug 2023
- 2023R2Det: Redemption from Range-view for Accurate 3D Object Detection21 Jul 2023
- 2023Improving Online Lane Graph Extraction by Object-Lane Clustering20 Jul 2023
- 2023Practical Collaborative Perception: A Framework for Asynchronous and Multi-Agent 3D Object Detection4 Jul 2023
- 2023Frame Fusion with Vehicle Motion Prediction for 3D Object Detection19 Jun 2023
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curve16 Jun 2023
- 2023LiDAR2Map: In Defense of LiDAR-Based Semantic Map Construction Using Online Camera Distillation22 Apr 2023
- 2023Neural Map Prior for Autonomous Driving17 Apr 2023
- 2023A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services13 Apr 2023
- 2023Online Lane Graph Extraction from Onboard Video3 Apr 2023
- 2022THMA: Tencent HD Map AI System for Creating HD Map Annotations14 Dec 2022
- 2022Trust, but Verify: Cross-Modality Fusion for HD Map Change Detection14 Dec 2022
- 2022Multi-Sem Fusion: Multimodal Semantic Fusion for 3D Object Detection10 Dec 2022
- 2022PseudoAugment: Learning to Use Unlabeled Data for Data Augmentation in Point Clouds24 Oct 2022
- 2022Privacy-preserving Decentralized Federated Learning over Time-varying Communication Graph1 Oct 2022
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipe12 Sep 2022
- 2022AGO-Net: Association-Guided 3D Point Cloud Object Detection Network24 Aug 2022
- 2022MonoSIM: Simulating Learning Behaviors of Heterogeneous Point Cloud Object Detectors for Monocular 3D Object Detection19 Aug 2022
- 2022GraVoS: Voxel Selection for 3D Point-Cloud Detection18 Aug 2022
- 20223D Object Detection for Autonomous Driving: A Comprehensive Survey19 Jun 2022
- 2022VectorMapNet: End-to-end Vectorized HD Map Learning17 Jun 2022
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detection1 Jun 2022
- 2022Voxel Field Fusion for 3D Object Detection31 May 2022
- 2022Structure Aware and Class Balanced 3D Object Detection on nuScenes Dataset25 May 2022
- 2022COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehicles4 May 2022
- 2022RBGNet: Ray-based Grouping for 3D Object Detection5 Apr 2022
- 2022AziNorm: Exploiting the Radial Symmetry of Point Cloud for Azimuth-Normalized 3D Perception24 Mar 2022
- 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Driving8 Mar 2022
- 2022Survey and Systematization of 3D Object Detection Models and Methods23 Jan 2022
50 newest of 78 All 78 (JSON)
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
- 2022COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehiclescited by 95
- 2023Implicit Occupancy Flow Fields for Perception and Prediction in Self-Drivingcited by 30
- 2024QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Drivingcited by 11
- 2024QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Driving1 Apr 2024
- 2023Implicit Occupancy Flow Fields for Perception and Prediction in Self-Driving2 Aug 2023
- 2022COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehicles4 May 2022
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Driving16 Jan 2021
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2021LiDAR R-CNN: An Efficient and Universal 3D Object Detectorcited by 129
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2021Improving 3D Object Detection with Channel-wise Transformercited by 108
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2021FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detectioncited by 92
- 2021Depth-conditioned Dynamic Message Propagation for Monocular 3D Object Detectioncited by 84
- 2021SceneGen: Learning to Generate Realistic Traffic Scenescited by 83
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 80
12 most cited of 73 All 73 (JSON)
- 2026Eyes All Around: Design and Analysis of 360-Degree LiDAR Perception Using Equivariant Feature Learning in Unstructured Traffic30 May 2026
- 2026Scene Reconstruction as Mapping Priors for 3D Detection21 May 2026
- 2025Compressed Map Priors for 3D Perception31 Dec 2025
- 2025nuScenes Revisited: Progress and Challenges in Autonomous Driving2 Dec 2025
- 2025Bridging Perspectives: Foundation Model Guided BEV Maps for 3D Object Detection and Tracking11 Oct 2025
- 2025Multimodal and Multiview Deep Fusion for Autonomous Marine Navigation2 May 2025
- 2024Vectorized Representation Dreamer (VRD): Dreaming-Assisted Multi-Agent Motion-Forecasting20 Jun 2024
- 2024SpotNet: An Image Centric, Lidar Anchored Approach To Long Range Perception24 May 2024
- 2024TS40K: a 3D Point Cloud Dataset of Rural Terrain and Electrical Transmission System22 May 2024
- 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspective8 May 2024
- 2024Toward Physics-Aware Deep Learning Architectures for LiDAR Intensity Simulation24 Apr 2024
- 2024CMDA: Cross-Modal and Domain Adversarial Adaptation for LiDAR-Based 3D Object Detection6 Mar 2024
12 newest of 73 All 73 (JSON)