mlsanityData to 14 Oct 2026

MapKD: Unlocking Prior Knowledge with Cross-Modal Distillation for Efficient Online HD Map Construction

arXiv 2508.15653 ↗First posted 21 Aug 2025cs.CVcited by 3

On the map: Knowledge distillation → Multimodal distillation

Abstract (arXiv)

Online HD map construction is a fundamental task in autonomous driving systems, aiming to acquire semantic information of map elements around the ego vehicle based on real-time sensor inputs. Recently, several approaches have achieved promising results by incorporating offline priors such as SD maps and HD maps or by fusing multi-modal data. However, these methods depend on stale offline maps and multi-modal sensor suites, resulting in avoidable computational overhead at inference. To address these limitations, we employ a knowledge distillation strategy to transfer knowledge from multimodal models with prior knowledge to an efficient, low-cost, and vision-centric student model. Specifically, we propose MapKD, a novel multi-level cross-modal knowledge distillation framework with an innovative Teacher-Coach-Student (TCS) paradigm. This framework consists of: (1) a camera-LiDAR fusion model with SD/HD map priors serving as the teacher; (2) a vision-centric coach model with prior knowledge and simulated LiDAR to bridge the cross-modal knowledge transfer gap; and (3) a lightweight vision-based student model. Additionally, we introduce two targeted knowledge distillation strategies: Token-Guided 2D Patch Distillation (TGPD) for bird's eye view feature alignment and Masked Semantic Response Distillation (MSRD) for semantic learning guidance. Extensive experiments on the challenging nuScenes dataset demonstrate that MapKD improves the student model by +6.68 mIoU and +10.94 mAP while simultaneously accelerating inference speed. The code is available at:https://github.com/2004yan/MapKD2026.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal distillation, one of 12 directions in Knowledge distillation. Builds on 13 of its 24 references that are in the map. First posted on arXiv 21 Aug 2025.

Builds on

13 of 24 references.

References · 13

  1. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  2. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  3. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
  4. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
  5. 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 174
  6. 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 145
  7. 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 85
  8. 2024P-MapNet: Far-seeing Map Generator Enhanced by both SDMap and HDMap Priorscited by 54
  9. 2023DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillationcited by 41
  10. 2022PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detectioncited by 33
  11. 2023Complementing Onboard Sensors with Satellite Map: A New Perspective for HD Map Constructioncited by 28
  12. 2021PQ-Transformer: Jointly Parsing 3D Objects and Layouts from Point Cloudscited by 26
1 more
  1. 2024MapDistill: Boosting Efficient Camera-based HD Map Construction via Camera-LiDAR Fusion Model Distillationcited by 26

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Domain Adaptation-Based Crossmodal Knowledge Distillation for 3D Semantic Segmentation
  2. 2025BridgeTA: Bridging the Representation Gap in Knowledge Distillation via Teacher Assistant for Bird's Eye View Map Segmentation
  3. 2026HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-training
  4. 2025MMCD: Multi-Modal Collaborative Decision-Making for Connected Autonomy with Knowledge Distillation
  5. 2025Revisiting Cross-Modal Knowledge Distillation: A Disentanglement Approach for RGBD Semantic Segmentation
  6. 2026Drive-KD: Multi-Teacher Distillation for VLMs in Autonomous Driving
  7. 2025RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priors
  8. 2026The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset