mlsanityData to 7 Oct 2026

MemFusionMap: Working Memory Fusion for Online Vectorized HD Map Construction

arXiv 2409.18737 ↗First posted 26 Sep 2024cs.CV cs.AI cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

High-definition (HD) maps provide environmental information for autonomous driving systems and are essential for safe planning. While existing methods with single-frame input achieve impressive performance for online vectorized HD map construction, they still struggle with complex scenarios and occlusions. We propose MemFusionMap, a novel temporal fusion model with enhanced temporal reasoning capabilities for online HD map construction. Specifically, we contribute a working memory fusion module that improves the model's memory capacity to reason across a history of frames. We also design a novel temporal overlap heatmap to explicitly inform the model about the temporal overlap information and vehicle trajectory in the Bird's Eye View space. By integrating these two designs, MemFusionMap significantly outperforms existing methods while also maintaining a versatile design for scalability. We conduct extensive evaluation on open-source benchmarks and demonstrate a maximum improvement of 5.4% in mAP over state-of-the-art methods. The project page for MemFusionMap is https://song-jingyu.github.io/MemFusionMap

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 35 of its 45 references that are in the map. First posted on arXiv 26 Sep 2024.

Builds on

35 of 45 references.

References · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  5. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  6. 2017Decoupled Weight Decay Regularizationcited by 1,722
  7. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  8. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  9. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
  10. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  11. 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
  12. 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 436
23 more
  1. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
  2. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
  3. 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
  4. 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
  5. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
  6. 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
  7. 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 177
  8. 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
  9. 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 143
  10. 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
  11. 2022Rethinking Efficient Lane Detection via Curve Modelingcited by 87
  12. 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 84
  13. 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 80
  14. 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 67
  15. 2023Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perceptioncited by 65
  16. 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
  17. 2024Leveraging Enhanced Queries of Point Sets for Vectorized Map Constructioncited by 46
  18. 2024Stream Query Denoising for Vectorized HD Map Constructioncited by 43
  19. 2022MotionSC: Data Set and Network for Real-Time Semantic Mapping in Dynamic Environmentscited by 40
  20. 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Modelscited by 36
  21. 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 32
  22. 2024CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillationcited by 27
  23. 2024RMem: Restricted Memory Banks Improve Video Object Segmentationcited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 4.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Online Temporal Fusion for Vectorized Map Construction in Mapless Autonomous Driving
  2. 2026FlexMap: Robust HD Map Construction under Flexible Camera Configurations
  3. 2025NavMapFusion: Diffusion-based Fusion of Navigation Maps for Online Vectorized HD Map Construction
  4. 2025DiffSemanticFusion: Semantic Raster BEV Fusion for Autonomous Driving via Online HD Map Diffusion
  5. 2025MTRDrive: Memory-Tool Synergistic Reasoning for Robust Autonomous Driving in Corner Cases
  6. 2024Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehicles
  7. 2026Drive by Hindsight and Foresight: Tool-Grounded Synergistic Reasoning over Hierarchical Memory for Autonomous Driving
  8. 2026PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving