MapFusion: A General Framework for 3D Object Detection with HDMaps
Not on the map. Why?
Abstract (arXiv)
3D object detection is a key perception component in autonomous driving. Most recent approaches are based on Lidar sensors only or fused with cameras. Maps (e.g., High Definition Maps), a basic infrastructure for intelligent vehicles, however, have not been well exploited for boosting object detection tasks. In this paper, we propose a simple but effective framework - MapFusion to integrate the map information into modern 3D object detector pipelines. In particular, we design a FeatureAgg module for HD Map feature extraction and fusion, and a MapSeg module as an auxiliary segmentation head for the detection backbone. Our proposed MapFusion is detector independent and can be easily integrated into different detectors. The experimental results of three different baselines on large public autonomous driving dataset demonstrate the superiority of the proposed framework. By fusing the map information, we can achieve 1.27 to 2.79 points improvements for mean Average Precision (mAP) on three strong 3d object detection baselines.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 10 Mar 2021.
Builds on
21 of 32 references.
References · 21
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
9 more
- 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
- 2019From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Networkcited by 366
- 2017Joint 3D Proposal Generation and Object Detection from View Aggregationcited by 325
- 2019STD: Sparse-to-Dense 3D Object Detector for Point Cloudcited by 282
- 2017SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloudcited by 231
- 2020Multi-Task Multi-Sensor Fusion for 3D Object Detectioncited by 203
- 2019IoU Loss for 2D/3D Object Detectioncited by 128
- 2020HDNET: Exploiting HD Maps for 3D Object Detectioncited by 78
- 2019What You See is What You Get: Exploiting Visibility for 3D Object Detectioncited by 69
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 0; 2025: 2.
6 papers.
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2021FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detectioncited by 92
- 2022Multi-Sem Fusion: Multimodal Semantic Fusion for 3D Object Detectioncited by 11
- 2025Bridging Perspectives: Foundation Model Guided BEV Maps for 3D Object Detection and Trackingcited by 9
- 2023Practical Collaborative Perception: A Framework for Asynchronous and Multi-Agent 3D Object Detectioncited by 6
- 2025Compressed Map Priors for 3D Perceptioncited by 1
- 2025Compressed Map Priors for 3D Perception31 Dec 2025
- 2025Bridging Perspectives: Foundation Model Guided BEV Maps for 3D Object Detection and Tracking11 Oct 2025
- 2023Practical Collaborative Perception: A Framework for Asynchronous and Multi-Agent 3D Object Detection4 Jul 2023
- 2022Multi-Sem Fusion: Multimodal Semantic Fusion for 3D Object Detection10 Dec 2022
- 20223D Object Detection for Autonomous Driving: A Comprehensive Survey19 Jun 2022
- 2021FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detection23 Jun 2021