mlsanityData to 13 Oct 2026

Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagation

arXiv 2411.11002 ↗First posted 17 Nov 2024cs.CV cs.AIcited by 12

Not on the map. Why?

Abstract (arXiv)

Predicting and constructing road geometric information (e.g., lane lines, road markers) is a crucial task for safe autonomous driving, while such static map elements can be repeatedly occluded by various dynamic objects on the road. Recent studies have shown significantly improved vectorized high-definition (HD) map construction performance, but there has been insufficient investigation of temporal information across adjacent input frames (i.e., clips), which may lead to inconsistent and suboptimal prediction results. To tackle this, we introduce a novel paradigm of clip-level vectorized HD map construction, MapUnveiler, which explicitly unveils the occluded map elements within a clip input by relating dense image representations with efficient clip tokens. Additionally, MapUnveiler associates inter-clip information through clip token propagation, effectively utilizing long-term temporal map information. MapUnveiler runs efficiently with the proposed clip-level pipeline by avoiding redundant computation with temporal stride while building a global map relationship. Our extensive experiments demonstrate that MapUnveiler achieves state-of-the-art performance on both the nuScenes and Argoverse2 benchmark datasets. We also showcase that MapUnveiler significantly outperforms state-of-the-art approaches in a challenging setting, achieving +10.7% mAP improvement in heavily occluded driving road scenes. The project page can be found at https://mapunveiler.github.io.

Key facts. Cited by 12 papers in the map (data through 13 Oct 2026). Builds on 41 of its 53 references that are in the map. First posted on arXiv 17 Nov 2024.

Builds on

41 of 53 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,106
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  3. 2020End-to-End Object Detection with Transformerscited by 7,396
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,498
  5. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,417
  6. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,352
  7. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,215
  8. 2022Planning-oriented Autonomous Drivingcited by 1,074
  9. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  10. 2019Compressive Transformers for Long-Range Sequence Modellingcited by 707
  11. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 704
  12. 2020End-to-End Video Instance Segmentation with Transformerscited by 443
29 more
  1. 2019Video Object Segmentation using Space-Time Memory Networkscited by 437
  2. 2019Video Instance Segmentationcited by 393
  3. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
  4. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 314
  5. 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
  6. 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
  7. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
  8. 2019CenterMask : Real-Time Anchor-Free Instance Segmentationcited by 200
  9. 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
  10. 2020LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mappingcited by 185
  11. 2023Putting the Object Back into Video Object Segmentationcited by 185
  12. 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 145
  13. 2021Video Instance Segmentation using Inter-Frame Communication Transformerscited by 105
  14. 2022VITA: Video Instance Segmentation via Object Token Associationcited by 94
  15. 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 85
  16. 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 82
  17. 2022Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformercited by 80
  18. 2022BEVPoolv2: A Cutting-edge Implementation of BEVDet Toward Deploymentcited by 79
  19. 2020Memory Transformercited by 74
  20. 2023Online Map Vectorization for Autonomous Driving: A Rasterization Perspectivecited by 54
  21. 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
  22. 2024HIMap: HybrId Representation Learning for End-to-end Vectorized HD Map Constructioncited by 48
  23. 2024Leveraging Enhanced Queries of Point Sets for Vectorized Map Constructioncited by 46
  24. 2024Stream Query Denoising for Vectorized HD Map Constructioncited by 43
  25. 2023Online Vectorized HD Map Construction using Geometrycited by 42
  26. 2021Divide-and-Conquer for Lane-Aware Diverse Trajectory Predictioncited by 37
  27. 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 32
  28. 2022Token Turing Machinescited by 25
  29. 2019Learning to Remember More with Less Memorizationcited by 14

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 7; 2026: 5.

12 papers.