mlsanityData to 7 Oct 2026

GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction

arXiv 2409.08688 ↗First posted 13 Sep 2024cs.CV cs.RO eess.IVcited by 4

Not on the map. Why?

Abstract (arXiv)

Online High-Definition (HD) maps have emerged as the preferred option for autonomous driving, overshadowing the counterpart offline HD maps due to flexible update capability and lower maintenance costs. However, contemporary online HD map models embed parameters of visual sensors into training, resulting in a significant decrease in generalization performance when applied to visual sensors with different parameters. Inspired by the inherent potential of Inverse Perspective Mapping (IPM), where camera parameters are decoupled from the training process, we have designed a universal map generation framework, GenMapping. The framework is established with a triadic synergy architecture, including principal and dual auxiliary branches. When faced with a coarse road image with local distortion translated via IPM, the principal branch learns robust global features under the state space models. The two auxiliary branches are a dense perspective branch and a sparse prior branch. The former exploits the correlation information between static and moving objects, whereas the latter introduces the prior knowledge of OpenStreetMap (OSM). The triple-enhanced merging module is crafted to synergistically integrate the unique spatial features from all three branches. To further improve generalization capabilities, a Cross-View Map Learning (CVML) scheme is leveraged to realize joint learning within the common space. Additionally, a Bidirectional Data Augmentation (BiDA) module is introduced to mitigate reliance on datasets concurrently. A thorough array of experimental results shows that the proposed model surpasses current state-of-the-art methods in both semantic mapping and vectorized mapping, while also maintaining a rapid inference speed. The source code will be publicly available at https://github.com/lynn-yu/GenMapping.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 54 of its 66 references that are in the map. First posted on arXiv 13 Sep 2024.

Builds on

54 of 66 references.

References · 54

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  5. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  6. 2022Planning-oriented Autonomous Drivingcited by 1,068
  7. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  8. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  9. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  10. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  11. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  12. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
38 more
  1. 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
  2. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
  3. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
  4. 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
  5. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
  6. 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentationcited by 286
  7. 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
  8. 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
  9. 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
  10. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
  11. 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
  12. 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbonecited by 222
  13. 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
  14. 2022BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Drivingcited by 191
  15. 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
  16. 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 173
  17. 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 166
  18. 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 143
  19. 2022BEVSegFormer: Bird's Eye View Semantic Segmentation From Arbitrary Camera Rigscited by 123
  20. 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
  21. 2021Translating Images into Mapscited by 115
  22. 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
  23. 2023Sparse4D v2: Recurrent Temporal Fusion with Sparse Modelcited by 92
  24. 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 84
  25. 2022Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformercited by 80
  26. 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 80
  27. 2022BEVPoolv2: A Cutting-edge Implementation of BEVDet Toward Deploymentcited by 79
  28. 2023Neural Map Prior for Autonomous Drivingcited by 68
  29. 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 67
  30. 2023Online Map Vectorization for Autonomous Driving: A Rasterization Perspectivecited by 54
  31. 2024P-MapNet: Far-seeing Map Generator Enhanced by both SDMap and HDMap Priorscited by 54
  32. 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
  33. 2021Bird's-Eye-View Panoptic Segmentation Using Monocular Frontal View Imagescited by 48
  34. 2023RoboBEV: Towards Robust Bird's Eye View Perception under Corruptionscited by 42
  35. 2023InstaGraM: Instance-level Graph Modeling for Vectorized HD Map Learningcited by 40
  36. 2019A Geometric Approach to Obtain a Bird's Eye View from an Imagecited by 34
  37. 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
  38. 2023Complementing Onboard Sensors with Satellite Map: A New Perspective for HD Map Constructioncited by 28

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.