mlsanityData to 14 Oct 2026

MapDiffusion: Generative Diffusion for Vectorized Online HD Map Construction and Uncertainty Estimation in Autonomous Driving

arXiv 2507.21423 ↗First posted 29 Jul 2025cs.CV cs.AI cs.LGcited by 13

Not on the map. Why?

Abstract (arXiv)

Autonomous driving requires an understanding of the static environment from sensor data. Learned Bird's-Eye View (BEV) encoders are commonly used to fuse multiple inputs, and a vector decoder predicts a vectorized map representation from the latent BEV grid. However, traditional map construction models provide deterministic point estimates, failing to capture uncertainty and the inherent ambiguities of real-world environments, such as occlusions and missing lane markings. We propose MapDiffusion, a novel generative approach that leverages the diffusion paradigm to learn the full distribution of possible vectorized maps. Instead of predicting a single deterministic output from learned queries, MapDiffusion iteratively refines randomly initialized queries, conditioned on a BEV latent grid, to generate multiple plausible map samples. This allows aggregating samples to improve prediction accuracy and deriving uncertainty estimates that directly correlate with scene ambiguity. Extensive experiments on the nuScenes dataset demonstrate that MapDiffusion achieves state-of-the-art performance in online map construction, surpassing the baseline by 5% in single-sample performance. We further show that aggregating multiple samples consistently improves performance along the ROC curve, validating the benefit of distribution modeling. Additionally, our uncertainty estimates are significantly higher in occluded areas, reinforcing their value in identifying regions with ambiguous sensor input. By modeling the full map distribution, MapDiffusion enhances the robustness and reliability of online vectorized HD map construction, enabling uncertainty-aware decision-making for autonomous vehicles in complex environments.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 40 of its 42 references that are in the map. First posted on arXiv 29 Jul 2025.

Builds on

40 of 42 references.

References · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2020End-to-End Object Detection with Transformerscited by 7,414
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  9. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  10. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  11. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  12. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
28 more
  1. 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
  2. 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 352
  3. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
  4. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
  5. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
  6. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 233
  7. 2023MotionDiffuser: Controllable Multi-Agent Motion Prediction using Diffusioncited by 213
  8. 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
  9. 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 145
  10. 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 106
  11. 2022CARD: Classification and Regression Diffusion Modelscited by 103
  12. 2022HouseDiffusion: Vector Floorplan Generation via a Diffusion Model with Discrete and Continuous Denoisingcited by 73
  13. 2024RadioDiff: An Effective Generative Diffusion Model for Sampling-Free Dynamic Radio Map Constructioncited by 56
  14. 2023Online Map Vectorization for Autonomous Driving: A Rasterization Perspectivecited by 54
  15. 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
  16. 2024HIMap: HybrId Representation Learning for End-to-end Vectorized HD Map Constructioncited by 48
  17. 2024Leveraging Enhanced Queries of Point Sets for Vectorized Map Constructioncited by 46
  18. 2024Stream Query Denoising for Vectorized HD Map Constructioncited by 43
  19. 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Modelscited by 38
  20. 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 33
  21. 2023DiffBEV: Conditional Diffusion Model for Bird's Eye View Perceptioncited by 30
  22. 2024OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Drivingcited by 29
  23. 2024DifFUSER: Diffusion Model for Robust Multi-Sensor Fusion in 3D Object Detection and BEV Segmentationcited by 18
  24. 2024DiffMap: Enhancing Map Segmentation with Map Prior Using Diffusion Modelcited by 13
  25. 2025AugMapNet: Improving Spatial Latent Structure via BEV Grid Augmentation for Enhanced Vectorized Online HD Map Constructioncited by 6
  26. 2024TempBEV: Improving Learned BEV Encoders with Combined Image and BEV Space Temporal Aggregationcited by 5
  27. 2024Lane Graph Extraction from Aerial Imagery via Lane Segmentation Refinement with Diffusion Modelscited by 5
  28. 2024Online Diffusion-Based 3D Occupancy Prediction at the Frontier with Probabilistic Map Reconciliationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 9.

13 papers.

Sort:

By area: