mlsanityData to 14 Oct 2026

Mind the map! Accounting for existing map information when estimating online HDMaps from sensor

arXiv 2311.10517 ↗First posted 17 Nov 2023cs.LG cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

While HDMaps are a crucial component of autonomous driving, they are expensive to acquire and maintain. Estimating these maps from sensors therefore promises to significantly lighten costs. These estimations however overlook existing HDMaps, with current methods at most geolocalizing low quality maps or considering a general database of known maps. In this paper, we propose to account for existing maps of the precise situation studied when estimating HDMaps. We identify 3 reasonable types of useful existing maps (minimalist, noisy, and outdated). We also introduce MapEX, a novel online HDMap estimation framework that accounts for existing maps. MapEX achieves this by encoding map elements into query tokens and by refining the matching algorithm used to train classic query based map estimation models. We demonstrate that MapEX brings significant improvements on the nuScenes dataset. For instance, MapEX - given noisy maps - improves by 38% over the MapTRv2 detector it is based on and by 8% over the current SOTA.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 30 of its 53 references that are in the map. First posted on arXiv 17 Nov 2023.

Builds on

30 of 53 references.

References · 30

  1. 2020End-to-End Object Detection with Transformerscited by 7,414
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  4. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
  5. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
  6. 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
  7. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
  8. 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
  9. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
  10. 2021Multimodal Motion Prediction with Stacked Transformerscited by 208
  11. 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
  12. 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 117
18 more
  1. 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 114
  2. 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 113
  3. 2019A Survey of Deep Learning Applications to Autonomous Vehicle Controlcited by 106
  4. 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
  5. 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 85
  6. 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
  7. 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 82
  8. 2023Neural Map Prior for Autonomous Drivingcited by 68
  9. 2023Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Mapscited by 58
  10. 2023LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraintscited by 53
  11. 2020Learning Rates as a Function of Batch Size: A Random Matrix Theory Approach to Neural Network Trainingcited by 50
  12. 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 48
  13. 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
  14. 2023Complementing Onboard Sensors with Satellite Map: A New Perspective for HD Map Constructioncited by 28
  15. 2022Trust, but Verify: Cross-Modality Fusion for HD Map Change Detectioncited by 25
  16. 2023Towards Motion Forecasting with Real-World Perception Inputs: Are End-to-End Approaches Competitive?cited by 22
  17. 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Imagescited by 6
  18. 2023DisPlacing Objects: Improving Dynamic Vehicle Detection via Visual Place Recognition under Adverse Conditionscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 3.

6 papers.