Uncertainty-Instructed Structure Injection for Generalizable HD Map Construction
Not on the map. Why?
Abstract (arXiv)
Reliable high-definition (HD) map construction is crucial for the driving safety of autonomous vehicles. Although recent studies demonstrate improved performance, their generalization capability across unfamiliar driving scenes remains unexplored. To tackle this issue, we propose UIGenMap, an uncertainty-instructed structure injection approach for generalizable HD map vectorization, which concerns the uncertainty resampling in statistical distribution and employs explicit instance features to reduce excessive reliance on training data. Specifically, we introduce the perspective-view (PV) detection branch to obtain explicit structural features, in which the uncertainty-aware decoder is designed to dynamically sample probability distributions considering the difference in scenes. With probabilistic embedding and selection, UI2DPrompt is proposed to construct PV-learnable prompts. These PV prompts are integrated into the map decoder by designed hybrid injection to compensate for neglected instance structures. To ensure real-time inference, a lightweight Mimic Query Distillation is designed to learn from PV prompts, which can serve as an efficient alternative to the flow of PV branches. Extensive experiments on challenging geographically disjoint (geo-based) data splits demonstrate that our UIGenMap achieves superior performance, with +5.7 mAP improvement on the nuScenes dataset. Source code will be available at https://github.com/xiaolul2/UIGenMap.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 55 of its 62 references that are in the map. First posted on arXiv 29 Mar 2025.
Builds on
55 of 62 references.
References · 55
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
38 more
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
- 2020LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mappingcited by 188
- 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 145
- 2020Data Uncertainty Learning in Face Recognitioncited by 134
- 2022Uncertainty Modeling for Out-of-Distribution Generalizationcited by 125
- 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 85
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 82
- 2023Far3D: Expanding the Horizon for Surround-view 3D Object Detectioncited by 70
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 68
- 2023Online Map Vectorization for Autonomous Driving: A Rasterization Perspectivecited by 54
- 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
- 2024HIMap: HybrId Representation Learning for End-to-end Vectorized HD Map Constructioncited by 48
- 2024Leveraging Enhanced Queries of Point Sets for Vectorized Map Constructioncited by 46
- 2023Localization Is All You Evaluate: Data Leakage in Online Mapping Datasets and How to Fix Itcited by 44
- 2024Stream Query Denoising for Vectorized HD Map Constructioncited by 43
- 2024Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillationcited by 43
- 2023PaSCo: Urban 3D Panoptic Scene Completion with Uncertainty Awarenesscited by 42
- 2023Online Vectorized HD Map Construction using Geometrycited by 42
- 2021Uncertainty-guided Model Generalization to Unseen Domainscited by 41
- 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 33
- 2024Enhancing Vectorized Map Perception with Historical Rasterized Mapscited by 29
- 2024Mask2Map: Vectorized HD Map Construction Using Bird's Eye View Segmentation Maskscited by 26
- 2021Transformer Uncertainty Estimation with Hierarchical Stochastic Attentioncited by 21
- 2024Enhancing 3D Lane Detection and Topology Reasoning with 2D Lane Priorscited by 21
- 2023LiDAR2Map: In Defense of LiDAR-Based Semantic Map Construction Using Online Camera Distillationcited by 18
- 2023GAFlow: Incorporating Gaussian Attention into Optical Flowcited by 18
- 2022A Simple Baseline for Multi-Camera 3D Object Detectioncited by 16
- 2024ADMap: Anti-disturbance framework for reconstructing online vectorized HD mapcited by 14
- 2024Enhancing 3D Object Detection with 2D Detection-Guided Query Anchorscited by 12
- 2023EgoVM: Achieving Precise Ego-Localization using Lightweight Vectorized Mapscited by 11
- 2024DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Constructioncited by 10
- 2023Towards Generalizable Multi-Camera 3D Object Detection via Perspective Debiasingcited by 9
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.