Improving Hierarchical Representations of Vectorized HD Maps with Perspective Clues
Not on the map. Why?
Abstract (arXiv)
The construction of vectorized High-Definition (HD) maps from onboard surround-view cameras has become a significant focus in autonomous driving. However, current map vector estimation pipelines face two key limitations: input-agnostic queries struggle to capture complex map structures, and the view transformation leads to information loss. These issues often result in inaccurate shape restoration or missing instances in map predictions. To address this concern, we propose a novel approach, namely PerCMap, which explicitly exploits clues from perspective-view features at both instance and point level. Specifically, at instance level, we propose Cross-view Instance Activation (CIA) to activate instance queries across surround-view images, thereby helping the model recover the instance attributes of map vectors. At point level, we design Dual-view Point Embedding (DPE), which fuses features from both views to generate input-aware positional embeddings and improve the accuracy of point coordinate estimation. Extensive experiments on textitnuScenes and textitArgoverse 2 demonstrate that PerCMap achieves strong and consistent performance across benchmarks, reaching 67.1 and 70.5 mAP, respectively.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 30 of its 41 references that are in the map. First posted on arXiv 17 Apr 2024.
Builds on
30 of 41 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
18 more
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
- 2022Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detectioncited by 177
- 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
- 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 143
- 2018Monocular Semantic Occupancy Grid Mapping with Convolutional Variational Encoder-Decoder Networkscited by 84
- 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 84
- 2022Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformercited by 80
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 80
- 2022Sparse Instance Activation for Real-Time Instance Segmentationcited by 63
- 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
- 2024HIMap: HybrId Representation Learning for End-to-end Vectorized HD Map Constructioncited by 48
- 2024Leveraging Enhanced Queries of Point Sets for Vectorized Map Constructioncited by 46
- 2023LATR: 3D Lane Detection from Monocular Images with Transformercited by 44
- 2023Bi-Mapper: Holistic BEV Semantic Mapping for Autonomous Drivingcited by 13
Built on by
Citing papers per year: 2024: 2; 2025: 2; 2026: 2.
6 papers.
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 16
- 2024DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Constructioncited by 10
- 2025FastMap: Fast Queries Initialization Based Vectorized HD Map Reconstruction Frameworkcited by 3
- 2025RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priorscited by 2
- 2026Ray-Aware Pointer Memory with Adaptive Updates for Streaming 3D Reconstructioncited by 1
- 2026HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priorscited by 0
- 2026HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priors23 Jul 2026
- 2026Ray-Aware Pointer Memory with Adaptive Updates for Streaming 3D Reconstruction7 May 2026
- 2025RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priors29 Jul 2025
- 2025FastMap: Fast Queries Initialization Based Vectorized HD Map Reconstruction Framework7 Mar 2025
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expert17 Dec 2024
- 2024DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Construction9 May 2024