GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction
Not on the map. Why?
Abstract (arXiv)
Online High-Definition (HD) maps have emerged as the preferred option for autonomous driving, overshadowing the counterpart offline HD maps due to flexible update capability and lower maintenance costs. However, contemporary online HD map models embed parameters of visual sensors into training, resulting in a significant decrease in generalization performance when applied to visual sensors with different parameters. Inspired by the inherent potential of Inverse Perspective Mapping (IPM), where camera parameters are decoupled from the training process, we have designed a universal map generation framework, GenMapping. The framework is established with a triadic synergy architecture, including principal and dual auxiliary branches. When faced with a coarse road image with local distortion translated via IPM, the principal branch learns robust global features under the state space models. The two auxiliary branches are a dense perspective branch and a sparse prior branch. The former exploits the correlation information between static and moving objects, whereas the latter introduces the prior knowledge of OpenStreetMap (OSM). The triple-enhanced merging module is crafted to synergistically integrate the unique spatial features from all three branches. To further improve generalization capabilities, a Cross-View Map Learning (CVML) scheme is leveraged to realize joint learning within the common space. Additionally, a Bidirectional Data Augmentation (BiDA) module is introduced to mitigate reliance on datasets concurrently. A thorough array of experimental results shows that the proposed model surpasses current state-of-the-art methods in both semantic mapping and vectorized mapping, while also maintaining a rapid inference speed. The source code will be publicly available at https://github.com/lynn-yu/GenMapping.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 54 of its 66 references that are in the map. First posted on arXiv 13 Sep 2024.
Builds on
54 of 66 references.
References · 54
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
38 more
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentationcited by 286
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
- 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
- 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbonecited by 222
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
- 2022BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Drivingcited by 191
- 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
- 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 173
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 166
- 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 143
- 2022BEVSegFormer: Bird's Eye View Semantic Segmentation From Arbitrary Camera Rigscited by 123
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2021Translating Images into Mapscited by 115
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2023Sparse4D v2: Recurrent Temporal Fusion with Sparse Modelcited by 92
- 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 84
- 2022Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformercited by 80
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 80
- 2022BEVPoolv2: A Cutting-edge Implementation of BEVDet Toward Deploymentcited by 79
- 2023Neural Map Prior for Autonomous Drivingcited by 68
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 67
- 2023Online Map Vectorization for Autonomous Driving: A Rasterization Perspectivecited by 54
- 2024P-MapNet: Far-seeing Map Generator Enhanced by both SDMap and HDMap Priorscited by 54
- 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
- 2021Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Imagescited by 48
- 2023RoboBEV: Towards Robust Bird's Eye View Perception under Corruptionscited by 42
- 2023InstaGraM: Instance-level Graph Modeling for Vectorized HD Map Learningcited by 40
- 2019A Geometric Approach to Obtain a Bird's Eye View from an Imagecited by 34
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
- 2023Complementing Onboard Sensors with Satellite Map: A New Perspective for HD Map Constructioncited by 28
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025Uncertainty-Instructed Structure Injection for Generalizable HD Map Constructioncited by 3
- 2025HierDAMap: Towards Universal Domain Adaptive BEV Mapping via Hierarchical Perspective Priorscited by 2
- 2025NRSeg: Noise-Resilient Learning for BEV Semantic Segmentation via Driving World Modelscited by 2
- 2026HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priorscited by 0
- 2026HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priors23 Jul 2026
- 2025NRSeg: Noise-Resilient Learning for BEV Semantic Segmentation via Driving World Models5 Jul 2025
- 2025Uncertainty-Instructed Structure Injection for Generalizable HD Map Construction29 Mar 2025
- 2025HierDAMap: Towards Universal Domain Adaptive BEV Mapping via Hierarchical Perspective Priors10 Mar 2025