MemFusionMap: Working Memory Fusion for Online Vectorized HD Map Construction
Not on the map. Why?
Abstract (arXiv)
High-definition (HD) maps provide environmental information for autonomous driving systems and are essential for safe planning. While existing methods with single-frame input achieve impressive performance for online vectorized HD map construction, they still struggle with complex scenarios and occlusions. We propose MemFusionMap, a novel temporal fusion model with enhanced temporal reasoning capabilities for online HD map construction. Specifically, we contribute a working memory fusion module that improves the model's memory capacity to reason across a history of frames. We also design a novel temporal overlap heatmap to explicitly inform the model about the temporal overlap information and vehicle trajectory in the Bird's Eye View space. By integrating these two designs, MemFusionMap significantly outperforms existing methods while also maintaining a versatile design for scalability. We conduct extensive evaluation on open-source benchmarks and demonstrate a maximum improvement of 5.4% in mAP over state-of-the-art methods. The project page for MemFusionMap is https://song-jingyu.github.io/MemFusionMap
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 35 of its 45 references that are in the map. First posted on arXiv 26 Sep 2024.
Builds on
35 of 45 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 436
23 more
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
- 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 177
- 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
- 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 143
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2022Rethinking Efficient Lane Detection via Curve Modelingcited by 87
- 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 84
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 80
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 67
- 2023Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perceptioncited by 65
- 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
- 2024Leveraging Enhanced Queries of Point Sets for Vectorized Map Constructioncited by 46
- 2024Stream Query Denoising for Vectorized HD Map Constructioncited by 43
- 2022MotionSC: Data Set and Network for Real-Time Semantic Mapping in Dynamic Environmentscited by 40
- 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Modelscited by 36
- 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 32
- 2024CRKD: Enhanced Camera-Radar Object Detection with Cross-modality Knowledge Distillationcited by 27
- 2024RMem: Restricted Memory Banks Improve Video Object Segmentationcited by 22
Built on by
Citing papers per year: 2025: 5; 2026: 4.
9 papers.
- 2025Uncertainty-Instructed Structure Injection for Generalizable HD Map Constructioncited by 3
- 2025Mapping like a Skeptic: Probabilistic BEV Projection for Online HD Mappingcited by 3
- 2026SatMap: Revisiting Satellite Maps as Prior for Online HD Map Constructioncited by 3
- 2025Inferring Driving Maps by Deep Learning-based Trail Map Extractioncited by 2
- 2025RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priorscited by 2
- 2026SEF-MAP: Subspace-Decomposed Expert Fusion for Robust Multimodal HD Map Predictioncited by 2
- 2025MambaMap: Online Vectorized HD Map Construction using State Space Modelcited by 1
- 2026Failure Modes for Deep Learning-Based Online Mapping: How to Measure and Address Themcited by 1
- 2026MapLightning: Online Vectorized HD Map Construction with 1D Map Tokenscited by 0
- 2026MapLightning: Online Vectorized HD Map Construction with 1D Map Tokens1 Oct 2026
- 2026Failure Modes for Deep Learning-Based Online Mapping: How to Measure and Address Them20 Mar 2026
- 2026SEF-MAP: Subspace-Decomposed Expert Fusion for Robust Multimodal HD Map Prediction25 Feb 2026
- 2026SatMap: Revisiting Satellite Maps as Prior for Online HD Map Construction15 Jan 2026
- 2025Mapping like a Skeptic: Probabilistic BEV Projection for Online HD Mapping29 Aug 2025
- 2025RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priors29 Jul 2025
- 2025MambaMap: Online Vectorized HD Map Construction using State Space Model27 Jul 2025
- 2025Inferring Driving Maps by Deep Learning-based Trail Map Extraction15 May 2025
- 2025Uncertainty-Instructed Structure Injection for Generalizable HD Map Construction29 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2024Online Temporal Fusion for Vectorized Map Construction in Mapless Autonomous Driving
- 2026FlexMap: Robust HD Map Construction under Flexible Camera Configurations
- 2025NavMapFusion: Diffusion-based Fusion of Navigation Maps for Online Vectorized HD Map Construction
- 2025DiffSemanticFusion: Semantic Raster BEV Fusion for Autonomous Driving via Online HD Map Diffusion
- 2025MTRDrive: Memory-Tool Synergistic Reasoning for Robust Autonomous Driving in Corner Cases
- 2024Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehicles
- 2026Drive by Hindsight and Foresight: Tool-Grounded Synergistic Reasoning over Hierarchical Memory for Autonomous Driving
- 2026PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving