Mind the map! Accounting for existing map information when estimating online HDMaps from sensor
Not on the map. Why?
Abstract (arXiv)
While HDMaps are a crucial component of autonomous driving, they are expensive to acquire and maintain. Estimating these maps from sensors therefore promises to significantly lighten costs. These estimations however overlook existing HDMaps, with current methods at most geolocalizing low quality maps or considering a general database of known maps. In this paper, we propose to account for existing maps of the precise situation studied when estimating HDMaps. We identify 3 reasonable types of useful existing maps (minimalist, noisy, and outdated). We also introduce MapEX, a novel online HDMap estimation framework that accounts for existing maps. MapEX achieves this by encoding map elements into query tokens and by refining the matching algorithm used to train classic query based map estimation models. We demonstrate that MapEX brings significant improvements on the nuScenes dataset. For instance, MapEX - given noisy maps - improves by 38% over the MapTRv2 detector it is based on and by 8% over the current SOTA.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 30 of its 53 references that are in the map. First posted on arXiv 17 Nov 2023.
Builds on
30 of 53 references.
References · 30
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2021Multimodal Motion Prediction with Stacked Transformerscited by 208
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
- 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 117
18 more
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 114
- 2021Multimodal Trajectory Prediction Conditioned on Lane-Graph Traversalscited by 113
- 2019A Survey of Deep Learning Applications to Autonomous Vehicle Controlcited by 106
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 85
- 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 82
- 2023Neural Map Prior for Autonomous Drivingcited by 68
- 2023Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Mapscited by 58
- 2023LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraintscited by 53
- 2020Learning Rates as a Function of Batch Size: A Random Matrix Theory Approach to Neural Network Trainingcited by 50
- 2023Leveraging Future Relationship Reasoning for Vehicle Trajectory Predictioncited by 48
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
- 2023Complementing Onboard Sensors with Satellite Map: A New Perspective for HD Map Constructioncited by 28
- 2022Trust, but Verify: Cross-Modality Fusion for HD Map Change Detectioncited by 25
- 2023Towards Motion Forecasting with Real-World Perception Inputs: Are End-to-End Approaches Competitive?cited by 22
- 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Imagescited by 6
- 2023DisPlacing Objects: Improving Dynamic Vehicle Detection via Visual Place Recognition under Adverse Conditionscited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 3.
6 papers.
- 2024TopoSD: Topology-Enhanced Lane Segment Perception with SDMap Priorcited by 12
- 2025SDTagNet: Leveraging Text-Annotated Navigation Maps for Online HD Map Constructioncited by 8
- 2026SatMap: Revisiting Satellite Maps as Prior for Online HD Map Constructioncited by 3
- 2026D2HDMap: Non-visible Driveline Map Prior for Online Vectorized HD Map Predictioncited by 2
- 2025SceneEdited: A City-Scale Benchmark for 3D HD Map Updating via Image-Guided Change Detectioncited by 1
- 2026Generation of Vectorized Maps Beyond Vehicle Viewcited by 0
- 2026Generation of Vectorized Maps Beyond Vehicle View7 Sep 2026
- 2026D2HDMap: Non-visible Driveline Map Prior for Online Vectorized HD Map Prediction17 Jun 2026
- 2026SatMap: Revisiting Satellite Maps as Prior for Online HD Map Construction15 Jan 2026
- 2025SceneEdited: A City-Scale Benchmark for 3D HD Map Updating via Image-Guided Change Detection19 Nov 2025
- 2025SDTagNet: Leveraging Text-Annotated Navigation Maps for Online HD Map Construction10 Jun 2025
- 2024TopoSD: Topology-Enhanced Lane Segment Perception with SDMap Prior22 Nov 2024