MGMap: Mask-Guided Learning for Online Vectorized HD Map Construction
Not on the map. Why?
Abstract (arXiv)
Currently, high-definition (HD) map construction leans towards a lightweight online generation tendency, which aims to preserve timely and reliable road scene information. However, map elements contain strong shape priors. Subtle and sparse annotations make current detection-based frameworks ambiguous in locating relevant feature scopes and cause the loss of detailed structures in prediction. To alleviate these problems, we propose MGMap, a mask-guided approach that effectively highlights the informative regions and achieves precise map element localization by introducing the learned masks. Specifically, MGMap employs learned masks based on the enhanced multi-scale BEV features from two perspectives. At the instance level, we propose the Mask-activated instance (MAI) decoder, which incorporates global instance and structural information into instance queries by the activation of instance masks. At the point level, a novel position-guided mask patch refinement (PG-MPR) module is designed to refine point locations from a finer-grained perspective, enabling the extraction of point-specific patch information. Compared to the baselines, our proposed MGMap achieves a notable improvement of around 10 mAP for different input modalities. Extensive experiments also demonstrate that our approach showcases strong robustness and generalization capabilities. Our code can be found at https://github.com/xiaolul2/MGMap.
Key facts. Cited by 52 papers in the map (data through 7 Oct 2026). Builds on 48 of its 52 references that are in the map. First posted on arXiv 1 Apr 2024.
Builds on
48 of 52 references.
References · 48
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Mask R-CNNcited by 7,259
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
36 more
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2019On the Convergence of Adam and Beyondcited by 834
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
- 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 444
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
- 2022BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Drivingcited by 191
- 2020LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mappingcited by 185
- 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
- 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 173
- 2019Gated-SCNN: Gated Shape CNNs for Semantic Segmentationcited by 165
- 2022BEVSegFormer: Bird's Eye View Semantic Segmentation From Arbitrary Camera Rigscited by 123
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2019PolyTransform: Deep Polygon Transformer for Instance Segmentationcited by 92
- 2023PivotNet: Vectorized Pivot Learning for End-to-end HD Map Constructioncited by 84
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 80
- 2020Boundary-preserving Mask R-CNNcited by 74
- 2020A Sim2Real Deep Learning Approach for the Transformation of Images from Multiple Vehicle-Mounted Cameras to a Semantically Segmented Image in Bird's Eye Viewcited by 71
- 2022Sparse Instance Activation for Real-Time Instance Segmentationcited by 63
- 2023Online Map Vectorization for Autonomous Driving: A Rasterization Perspectivecited by 54
- 2021Look Closer to Segment Better: Boundary Patch Refinement for Instance Segmentationcited by 43
- 2023InstaGraM: Instance-level Graph Modeling for Vectorized HD Map Learningcited by 40
- 2022SuperFusion: Multilevel LiDAR-Camera Fusion for Long-Range HD Map Generationcited by 39
- 2023HGFormer: Hierarchical Grouping Transformer for Domain Generalized Semantic Segmentationcited by 31
- 2022Perceive, Interact, Predict: Learning Dynamic and Static Clues for End-to-End Motion Predictioncited by 28
- 2022UniFusion: Unified Multi-view Fusion Transformer for Spatial-Temporal Representation in Bird's-Eye-Viewcited by 24
- 2022Path-Aware Graph Attention for HD Maps in Motion Predictioncited by 23
- 2023LiDAR2Map: In Defense of LiDAR-Based Semantic Map Construction Using Online Camera Distillationcited by 18
- 2023EgoVM: Achieving Precise Ego-Localization using Lightweight Vectorized Mapscited by 11
Built on by
Citing papers per year: 2024: 13; 2025: 26; 2026: 13.
52 papers.
Sort:
By area:
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 16
- 2025Data Scaling Laws for End-to-End Autonomous Drivingcited by 14
- 2024PrevPredMap: Exploring Temporal Modeling with Previous Predictions for Online Vectorized HD Map Constructioncited by 12
- 2024Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagationcited by 12
- 2025SafeMap: Robust HD Map Construction from Incomplete Observationscited by 12
- 2025MapDiffusion: Generative Diffusion for Vectorized Online HD Map Construction and Uncertainty Estimation in Autonomous Drivingcited by 12
- 2024DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Constructioncited by 10
- 2024Label-efficient Semantic Scene Completion with Scribble Annotationscited by 9
- 2024MemFusionMap: Working Memory Fusion for Online Vectorized HD Map Constructioncited by 9
- 2024MGMapNet: Multi-Granularity Representation Learning for End-to-End Vectorized HD Map Constructioncited by 9
- 2025What Really Matters for Robust Multi-Sensor HD Map Construction?cited by 9
- 2025HisTrackMap: Global Vectorized High-Definition Map Construction via History Map Trackingcited by 8
38 more
- 2025InteractionMap: Improving Online Vectorized HDMap Construction with Interactioncited by 8
- 2024TopoMaskV2: Enhanced Instance-Mask-Based Formulation for the Road Topology Problemcited by 7
- 2024Improving Hierarchical Representations of Vectorized HD Maps with Perspective Cluescited by 6
- 2024Exploring Semi-Supervised Learning for Online Mappingcited by 6
- 2025AugMapNet: Improving Spatial Latent Structure via BEV Grid Augmentation for Enhanced Vectorized Online HD Map Constructioncited by 6
- 2025Delving into Mapping Uncertainty for Mapless Trajectory Predictioncited by 6
- 2025Stability Under Scrutiny: Benchmarking Representation Paradigms for Online HD Mappingcited by 6
- 2025DAMap: Distance-aware MapNet for High Quality HD Map Constructioncited by 6
- 2024Panacea+: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 5
- 2024TopoBDA: Towards Bezier Deformable Attention for Road Topology Understandingcited by 5
- 2025RTMap: Real-Time Recursive Mapping with Change Detection and Localizationcited by 5
- 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generationcited by 5
- 2024GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Constructioncited by 4
- 2025Uni-PrevPredMap: Extending PrevPredMap to a Unified Framework of Prior-Informed Modeling for Online Vectorized HD Map Constructioncited by 4
- 2025SparseMeXT Unlocking the Potential of Sparse Representations for HD Map Constructioncited by 4
- 2025FastMap: Fast Queries Initialization Based Vectorized HD Map Reconstruction Frameworkcited by 3
- 2025Uncertainty-Instructed Structure Injection for Generalizable HD Map Constructioncited by 3
- 2025Coherent Online Road Topology Estimation and Reasoning with Standard-Definition Mapscited by 3
- 2025Mapping like a Skeptic: Probabilistic BEV Projection for Online HD Mappingcited by 3
- 2026SatMap: Revisiting Satellite Maps as Prior for Online HD Map Constructioncited by 3
- 2025Inferring Driving Maps by Deep Learning-based Trail Map Extractioncited by 2
- 2025MapFM: Foundation Model-Driven HD Mapping with Multi-Task Contextual Learningcited by 2
- 2025RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priorscited by 2
- 2025PriorFusion: Unified Integration of Priors for Robust Road Perception in Autonomous Drivingcited by 2
- 2025AMap: Distilling Future Priors for Ahead-Aware Online HD Map Constructioncited by 2
- 2026DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Drivingcited by 2
- 2025ArgoTweak: Towards Self-Updating HD Maps through Structured Priorscited by 1
- 2025Learning Global Representation from Queries for Vectorized HD Map Constructioncited by 1
- 2026Failure Modes for Deep Learning-Based Online Mapping: How to Measure and Address Themcited by 1
- 2026OptiMVMap: Offline Vectorized Map Construction via Optimal Multi-vehicle Perspectivescited by 1
- 2026TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relationscited by 1
- 2026Unified Map Prior Encoder for Mapping and Planningcited by 1
- 2026Learning Ego-Centric BEV Representations from a Perspective-Privileged View: Cross-View Supervision for Online HD Map Constructioncited by 1
- 2025Multimodal HD Mapping for Intersections by Intelligent Roadside Unitscited by 0
- 2026PredMapNet: Future and Historical Reasoning for Consistent Online HD Vectorized Map Constructioncited by 0
- 2026Uncertainty-Aware Trajectory Prediction: A Unified Framework Harnessing Positional and Semantic Uncertaintiescited by 0
- 2026Localization-Guided Foreground Augmentation in Autonomous Drivingcited by 0
- 2026GSMap: 2D Gaussians for Online HD Mappingcited by 0
50 most cited of 52 All 52 (JSON)
- 2026HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priors23 Jul 2026
- 2026GaussianMap: Learning Gaussian Representation for Multi-Sensor Online HD Map Construction30 Jun 2026
- 2026Learning Ego-Centric BEV Representations from a Perspective-Privileged View: Cross-View Supervision for Online HD Map Construction12 May 2026
- 2026GSMap: 2D Gaussians for Online HD Mapping10 May 2026
- 2026Unified Map Prior Encoder for Mapping and Planning4 May 2026
- 2026TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relations27 Apr 2026
- 2026Localization-Guided Foreground Augmentation in Autonomous Driving21 Apr 2026
- 2026OptiMVMap: Offline Vectorized Map Construction via Optimal Multi-vehicle Perspectives18 Apr 2026
- 2026Uncertainty-Aware Trajectory Prediction: A Unified Framework Harnessing Positional and Semantic Uncertainties31 Mar 2026
- 2026Failure Modes for Deep Learning-Based Online Mapping: How to Measure and Address Them20 Mar 2026
- 2026DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Driving20 Mar 2026
- 2026PredMapNet: Future and Historical Reasoning for Consistent Online HD Vectorized Map Construction18 Feb 2026
38 more
- 2026SatMap: Revisiting Satellite Maps as Prior for Online HD Map Construction15 Jan 2026
- 2025AMap: Distilling Future Priors for Ahead-Aware Online HD Map Construction22 Dec 2025
- 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generation9 Nov 2025
- 2025DAMap: Distance-aware MapNet for High Quality HD Map Construction26 Oct 2025
- 2025Stability Under Scrutiny: Benchmarking Representation Paradigms for Online HD Mapping12 Oct 2025
- 2025Learning Global Representation from Queries for Vectorized HD Map Construction8 Oct 2025
- 2025ArgoTweak: Towards Self-Updating HD Maps through Structured Priors10 Sep 2025
- 2025Mapping like a Skeptic: Probabilistic BEV Projection for Online HD Mapping29 Aug 2025
- 2025PriorFusion: Unified Integration of Priors for Robust Road Perception in Autonomous Driving31 Jul 2025
- 2025RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priors29 Jul 2025
- 2025MapDiffusion: Generative Diffusion for Vectorized Online HD Map Construction and Uncertainty Estimation in Autonomous Driving29 Jul 2025
- 2025Delving into Mapping Uncertainty for Mapless Trajectory Prediction24 Jul 2025
- 2025Multimodal HD Mapping for Intersections by Intelligent Roadside Units11 Jul 2025
- 2025What Really Matters for Robust Multi-Sensor HD Map Construction?2 Jul 2025
- 2025Coherent Online Road Topology Estimation and Reasoning with Standard-Definition Maps2 Jul 2025
- 2025RTMap: Real-Time Recursive Mapping with Change Detection and Localization1 Jul 2025
- 2025SafeMap: Robust HD Map Construction from Incomplete Observations1 Jul 2025
- 2025MapFM: Foundation Model-Driven HD Mapping with Multi-Task Contextual Learning18 Jun 2025
- 2025Inferring Driving Maps by Deep Learning-based Trail Map Extraction15 May 2025
- 2025SparseMeXT Unlocking the Potential of Sparse Representations for HD Map Construction12 May 2025
- 2025Uni-PrevPredMap: Extending PrevPredMap to a Unified Framework of Prior-Informed Modeling for Online Vectorized HD Map Construction9 Apr 2025
- 2025Data Scaling Laws for End-to-End Autonomous Driving6 Apr 2025
- 2025Uncertainty-Instructed Structure Injection for Generalizable HD Map Construction29 Mar 2025
- 2025InteractionMap: Improving Online Vectorized HDMap Construction with Interaction27 Mar 2025
- 2025AugMapNet: Improving Spatial Latent Structure via BEV Grid Augmentation for Enhanced Vectorized Online HD Map Construction17 Mar 2025
- 2025HisTrackMap: Global Vectorized High-Definition Map Construction via History Map Tracking10 Mar 2025
- 2025FastMap: Fast Queries Initialization Based Vectorized HD Map Reconstruction Framework7 Mar 2025
- 2024TopoBDA: Towards Bezier Deformable Attention for Road Topology Understanding25 Dec 2024
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expert17 Dec 2024
- 2024Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagation17 Nov 2024
- 2024Exploring Semi-Supervised Learning for Online Mapping14 Oct 2024
- 2024MGMapNet: Multi-Granularity Representation Learning for End-to-End Vectorized HD Map Construction10 Oct 2024
- 2024MemFusionMap: Working Memory Fusion for Online Vectorized HD Map Construction26 Sep 2024
- 2024TopoMaskV2: Enhanced Instance-Mask-Based Formulation for the Road Topology Problem17 Sep 2024
- 2024GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction13 Sep 2024
- 2024Panacea+: Panoramic and Controllable Video Generation for Autonomous Driving14 Aug 2024
- 2024PrevPredMap: Exploring Temporal Modeling with Previous Predictions for Online Vectorized HD Map Construction24 Jul 2024
- 2024Label-efficient Semantic Scene Completion with Scribble Annotations24 May 2024
50 newest of 52 All 52 (JSON)
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 16
- 2024PrevPredMap: Exploring Temporal Modeling with Previous Predictions for Online Vectorized HD Map Constructioncited by 12
- 2024Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagationcited by 12
- 2025SafeMap: Robust HD Map Construction from Incomplete Observationscited by 12
- 2025MapDiffusion: Generative Diffusion for Vectorized Online HD Map Construction and Uncertainty Estimation in Autonomous Drivingcited by 12
- 2024DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Constructioncited by 10
- 2024Label-efficient Semantic Scene Completion with Scribble Annotationscited by 9
- 2024MemFusionMap: Working Memory Fusion for Online Vectorized HD Map Constructioncited by 9
- 2024MGMapNet: Multi-Granularity Representation Learning for End-to-End Vectorized HD Map Constructioncited by 9
- 2025What Really Matters for Robust Multi-Sensor HD Map Construction?cited by 9
- 2025HisTrackMap: Global Vectorized High-Definition Map Construction via History Map Trackingcited by 8
- 2025InteractionMap: Improving Online Vectorized HDMap Construction with Interactioncited by 8
12 most cited of 48 All 48 (JSON)
- 2026HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priors23 Jul 2026
- 2026GaussianMap: Learning Gaussian Representation for Multi-Sensor Online HD Map Construction30 Jun 2026
- 2026Learning Ego-Centric BEV Representations from a Perspective-Privileged View: Cross-View Supervision for Online HD Map Construction12 May 2026
- 2026GSMap: 2D Gaussians for Online HD Mapping10 May 2026
- 2026Unified Map Prior Encoder for Mapping and Planning4 May 2026
- 2026Localization-Guided Foreground Augmentation in Autonomous Driving21 Apr 2026
- 2026OptiMVMap: Offline Vectorized Map Construction via Optimal Multi-vehicle Perspectives18 Apr 2026
- 2026Uncertainty-Aware Trajectory Prediction: A Unified Framework Harnessing Positional and Semantic Uncertainties31 Mar 2026
- 2026Failure Modes for Deep Learning-Based Online Mapping: How to Measure and Address Them20 Mar 2026
- 2026PredMapNet: Future and Historical Reasoning for Consistent Online HD Vectorized Map Construction18 Feb 2026
- 2025AMap: Distilling Future Priors for Ahead-Aware Online HD Map Construction22 Dec 2025
- 2025LaneDiffusion: Improving Centerline Graph Learning via Prior Injected BEV Feature Generation9 Nov 2025
12 newest of 48 All 48 (JSON)