MapLightning: Online Vectorized HD Map Construction with 1D Map Tokens
Not on the map. Why?
Abstract (arXiv)
Online vectorized HD map construction is essential for scaling safe autonomous driving and requires accurate, real-time inference. Prior methods typically rely on dense bird's-eye-view (BEV) grids as the intermediate representation. We propose textitMapLightning, which replaces the dense BEV grid with a compact set of 1D learnable map tokens. To construct map tokens from image features, we choose self-attention over vanilla cross-attention because it enables joint interactions and contextual aggregation among image and map tokens. Our transformer-based mapper concatenates map and image tokens, applies full self-attention, discards the image tokens, and retains the updated map tokens for decoding. This design offers three advantages. First, our representation is efficient, using fewer tokens, consuming less memory, and running faster. Second, the lightweight design allows the map decoder to use full rather than deformable cross-attention for better global context. Third, unlike BEV-based methods, our network does not use camera projection parameters, making it robust to camera-extrinsic perturbations. MapLightning uses up to 16.7× fewer intermediate tokens than dense BEV-based methods and achieves state-of-the-art accuracy and efficiency on nuScenes and Argoverse~2. Its lightweight variant surpasses MapTRv2 by +10.1 mAP on nuScenes and +16.2 mAP on Argoverse~2, while delivering 1.73× faster inference (40+ FPS) with 53% less memory. We further show improvements on uncertainty-aware map construction and downstream trajectory prediction. Code and models will be released.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 58 of its 68 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
58 of 68 references.
References · 58
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2016Layer Normalizationcited by 5,579
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2019Searching for MobileNetV3cited by 1,984
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
38 more
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 849
- 2023Vision Transformers Need Registerscited by 844
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2023Learning to Compress Prompts with Gist Tokenscited by 379
- 2021AdaViT: Adaptive Tokens for Efficient Vision Transformercited by 360
- 2023Adapting Language Models to Compress Contextscited by 350
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2021DeepViT: Towards Deeper Vision Transformercited by 288
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
- 2021Adaptive Token Sampling For Efficient Vision Transformerscited by 181
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
- 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 149
- 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 143
- 2022On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural Networkscited by 119
- 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 101
- 2023Sparse4D v2: Recurrent Temporal Fusion with Sparse Modelcited by 92
- 2020Memory Transformercited by 74
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 67
- 2023Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perceptioncited by 65
- 2024FastOcc: Accelerating 3D Occupancy Prediction by Fusing the 2D Bird's-Eye View and Perspective Viewcited by 51
- 2023Localization Is All You Evaluate: Data Leakage in Online Mapping Datasets and How to Fix Itcited by 44
- 2023BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detectioncited by 35
- 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 32
- 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Modelscited by 23
- 2024Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagationcited by 12
- 2024MemFusionMap: Working Memory Fusion for Online Vectorized HD Map Constructioncited by 9
- 2025AugMapNet: Improving Spatial Latent Structure via BEV Grid Augmentation for Enhanced Vectorized Online HD Map Constructioncited by 6
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.