mlsanityData to 7 Oct 2026

MapLightning: Online Vectorized HD Map Construction with 1D Map Tokens

arXiv 2610.01905 ↗First posted 1 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Online vectorized HD map construction is essential for scaling safe autonomous driving and requires accurate, real-time inference. Prior methods typically rely on dense bird's-eye-view (BEV) grids as the intermediate representation. We propose textitMapLightning, which replaces the dense BEV grid with a compact set of 1D learnable map tokens. To construct map tokens from image features, we choose self-attention over vanilla cross-attention because it enables joint interactions and contextual aggregation among image and map tokens. Our transformer-based mapper concatenates map and image tokens, applies full self-attention, discards the image tokens, and retains the updated map tokens for decoding. This design offers three advantages. First, our representation is efficient, using fewer tokens, consuming less memory, and running faster. Second, the lightweight design allows the map decoder to use full rather than deformable cross-attention for better global context. Third, unlike BEV-based methods, our network does not use camera projection parameters, making it robust to camera-extrinsic perturbations. MapLightning uses up to 16.7× fewer intermediate tokens than dense BEV-based methods and achieves state-of-the-art accuracy and efficiency on nuScenes and Argoverse~2. Its lightweight variant surpasses MapTRv2 by +10.1 mAP on nuScenes and +16.2 mAP on Argoverse~2, while delivering 1.73× faster inference (40+ FPS) with 53% less memory. We further show improvements on uncertainty-aware map construction and downstream trajectory prediction. Code and models will be released.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 68 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

58 of 68 references.

References · 58

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  7. 2016Layer Normalizationcited by 5,579
  8. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  10. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  11. 2019Searching for MobileNetV3cited by 1,984
  12. 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
38 more
  1. 2022Planning-oriented Autonomous Drivingcited by 1,068
  2. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  3. 2020On Layer Normalization in the Transformer Architecturecited by 906
  4. 2020Object-Centric Learning with Slot Attentioncited by 865
  5. 2021Segmenter: Transformer for Semantic Segmentationcited by 855
  6. 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 849
  7. 2023Vision Transformers Need Registerscited by 844
  8. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  9. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
  10. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
  11. 2023Learning to Compress Prompts with Gist Tokenscited by 379
  12. 2021AdaViT: Adaptive Tokens for Efficient Vision Transformercited by 360
  13. 2023Adapting Language Models to Compress Contextscited by 350
  14. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
  15. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
  16. 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
  17. 2021DeepViT: Towards Deeper Vision Transformercited by 288
  18. 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
  19. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
  20. 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
  21. 2021Adaptive Token Sampling For Efficient Vision Transformerscited by 181
  22. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
  23. 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 149
  24. 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 143
  25. 2022On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural Networkscited by 119
  26. 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 101
  27. 2023Sparse4D v2: Recurrent Temporal Fusion with Sparse Modelcited by 92
  28. 2020Memory Transformercited by 74
  29. 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 67
  30. 2023Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perceptioncited by 65
  31. 2024FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird's-Eye View and Perspective Viewcited by 51
  32. 2023Localization Is All You Evaluate: Data Leakage in Online Mapping Datasets and How to Fix Itcited by 44
  33. 2023BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detectioncited by 35
  34. 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 32
  35. 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Modelscited by 23
  36. 2024Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagationcited by 12
  37. 2024MemFusionMap: Working Memory Fusion for Online Vectorized HD Map Constructioncited by 9
  38. 2025AugMapNet: Improving Spatial Latent Structure via BEV Grid Augmentation for Enhanced Vectorized Online HD Map Constructioncited by 6

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.