PivotNet: Vectorized Pivot Learning for End-to-end HD Map Construction
Not on the map. Why?
Abstract (arXiv)
Vectorized high-definition map online construction has garnered considerable attention in the field of autonomous driving research. Most existing approaches model changeable map elements using a fixed number of points, or predict local maps in a two-stage autoregressive manner, which may miss essential details and lead to error accumulation. Towards precise map element learning, we propose a simple yet effective architecture named PivotNet, which adopts unified pivot-based map representations and is formulated as a direct set prediction paradigm. Concretely, we first propose a novel point-to-line mask module to encode both the subordinate and geometrical point-line priors in the network. Then, a well-designed pivot dynamic matching module is proposed to model the topology in dynamic point sequences by introducing the concept of sequence matching. Furthermore, to supervise the position and topology of the vectorized point predictions, we propose a dynamic vectorized sequence loss. Extensive experiments and ablations show that PivotNet is remarkably superior to other SOTAs by 5.9 mAP at least. The code will be available soon.
Key facts. Cited by 85 papers in the map (data through 14 Oct 2026). Builds on 30 of its 44 references that are in the map. First posted on arXiv 31 Aug 2023.
Builds on
30 of 44 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2019On the Convergence of Adam and Beyondcited by 841
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
18 more
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 658
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2020LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mappingcited by 188
- 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 174
- 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2020Keep your Eyes on the Lane: Real-time Attention-guided Lane Detectioncited by 138
- 2020End-to-end Lane Shape Prediction with Transformerscited by 111
- 2022Rethinking Efficient Lane Detection via Curve Modelingcited by 88
- 2018Monocular Semantic Occupancy Grid Mapping with Convolutional Variational Encoder-Decoder Networkscited by 84
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 82
- 2022A Keypoint-based Global Association Network for Lane Detectioncited by 68
- 2021Focus on Local: Detecting Lane Marker from Bottom Up via Key Pointcited by 65
- 2021HDMapGen: A Hierarchical Graph Generative Model of High Definition Mapscited by 40
- 2019End-to-end Lane Detection through Differentiable Least-Squares Fittingcited by 36
- 2021YOLinO: Generic Single Shot Polyline Detection in Real Timecited by 4
Built on by
Citing papers per year: 2023: 5; 2024: 35; 2025: 34; 2026: 11.
85 papers.
Sort:
By area:
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 68
- 2023Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Mapscited by 58
- 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Drivingcited by 57
- 2024P-MapNet: Far-seeing Map Generator Enhanced by both SDMap and HDMap Priorscited by 54
- 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
- 2024HIMap: HybrId Representation Learning for End-to-end Vectorized HD Map Constructioncited by 48
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Drivingcited by 47
- 2024Leveraging Enhanced Queries of Point Sets for Vectorized Map Constructioncited by 46
- 2024Stream Query Denoising for Vectorized HD Map Constructioncited by 43
- 2023Online Vectorized HD Map Construction using Geometrycited by 42
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
38 more
- 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 33
- 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenescited by 29
- 2024Enhancing Vectorized Map Perception with Historical Rasterized Mapscited by 29
- 2024Is Your HD Map Constructor Reliable under Sensor Corruptions?cited by 28
- 2024MapDistill: Boosting Efficient Camera-based HD Map Construction via Camera-LiDAR Fusion Model Distillationcited by 26
- 2024Mask2Map: Vectorized HD Map Construction Using Bird's Eye View Segmentation Maskscited by 26
- 2024PreSight: Enhancing Autonomous Vehicle Perception with City-Scale NeRF Priorscited by 21
- 2024Enhancing 3D Lane Detection and Topology Reasoning with 2D Lane Priorscited by 21
- 2024RoadPainter: Points Are Ideal Navigators for Topology transformERcited by 17
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 17
- 2024ADMap: Anti-disturbance framework for reconstructing online vectorized HD mapcited by 14
- 2025SafeMap: Robust HD Map Construction from Incomplete Observationscited by 14
- 2024PrevPredMap: Exploring Temporal Modeling with Previous Predictions for Online Vectorized HD Map Constructioncited by 12
- 2024Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagationcited by 12
- 2024DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Constructioncited by 10
- 2024PriorDrive: Enhancing Online HD Mapping with Unified Vector Priorscited by 10
- 2024MemFusionMap: Working Memory Fusion for Online Vectorized HD Map Constructioncited by 9
- 2024MGMapNet: Multi-Granularity Representation Learning for End-to-End Vectorized HD Map Constructioncited by 9
- 2025TopoPoint: Enhance Topology Reasoning via Endpoint Detection in Autonomous Drivingcited by 9
- 2025What Really Matters for Robust Multi-Sensor HD Map Construction?cited by 9
- 2025HisTrackMap: Global Vectorized High-Definition Map Construction via History Map Trackingcited by 8
- 2025InteractionMap: Improving Online Vectorized HDMap Construction with Interactioncited by 8
- 2024TopoMaskV2: Enhanced Instance-Mask-Based Formulation for the Road Topology Problemcited by 7
- 2025Stability Under Scrutiny: Benchmarking Representation Paradigms for Online HD Mappingcited by 7
- 2023Mind the map! Accounting for existing map information when estimating online HDMaps from sensorcited by 6
- 2024Improving Hierarchical Representations of Vectorized HD Maps with Perspective Cluescited by 6
- 2025AugMapNet: Improving Spatial Latent Structure via BEV Grid Augmentation for Enhanced Vectorized Online HD Map Constructioncited by 6
- 2025Delving into Mapping Uncertainty for Mapless Trajectory Predictioncited by 6
- 2025Persistent Autoregressive Mapping with Traffic Rules for Autonomous Drivingcited by 6
- 2025DAMap: Distance-aware MapNet for High Quality HD Map Constructioncited by 6
- 2024Continuity Preserving Online CenterLine Graph Learningcited by 5
- 2024Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehiclescited by 5
- 2024TopoBDA: Towards Bezier Deformable Attention for Road Topology Understandingcited by 5
- 2025Spatial Retrieval Augmented Autonomous Drivingcited by 5
- 2024EAN-MapNet: Efficient Vectorized HD Map Construction with Anchor Neighborhoodscited by 4
- 2024GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Constructioncited by 4
- 2024Monocular Lane Detection Based on Deep Learning: A Surveycited by 4
- 2025Uni-PrevPredMap: Extending PrevPredMap to a Unified Framework of Prior-Informed Modeling for Online Vectorized HD Map Constructioncited by 4
50 most cited of 85 All 85 (JSON)
- 2026From Fragments to Global Maps: Learning Vectorized Map Aggregation with Large Language Models1 Oct 2026
- 2026TwinIR: Coordinated Invisible Dual-Point Attacks on Online HD Map Construction5 Aug 2026
- 2026Driver2Map: Imitating Human Driving for Online High-Definition Map Construction2 Aug 2026
- 2026GaussianMap: Learning Gaussian Representation for Multi-Sensor Online HD Map Construction30 Jun 2026
- 2026The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset1 Jun 2026
- 2026GSMap: 2D Gaussians for Online HD Mapping10 May 2026
- 2026TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relations27 Apr 2026
- 2026OptiMVMap: Offline Vectorized Map Construction via Optimal Multi-vehicle Perspectives18 Apr 2026
- 2026PredMapNet: Future and Historical Reasoning for Consistent Online HD Vectorized Map Construction18 Feb 2026
- 2026FlexMap: Robust HD Map Construction under Flexible Camera Configurations29 Jan 2026
- 2026SatMap: Revisiting Satellite Maps as Prior for Online HD Map Construction15 Jan 2026
- 2025AMap: Distilling Future Priors for Ahead-Aware Online HD Map Construction22 Dec 2025
38 more
- 2025SATMapTR: Satellite Image Enhanced Online HD Map Construction12 Dec 2025
- 2025Spatial Retrieval Augmented Autonomous Driving7 Dec 2025
- 2025nuScenes Revisited: Progress and Challenges in Autonomous Driving2 Dec 2025
- 2025MapRF: Weakly Supervised Online HD Map Construction via NeRF-Guided Self-Training24 Nov 2025
- 2025Polymap: generating high definition map based on rasterized polygons8 Nov 2025
- 2025DAMap: Distance-aware MapNet for High Quality HD Map Construction26 Oct 2025
- 2025Stability Under Scrutiny: Benchmarking Representation Paradigms for Online HD Mapping12 Oct 2025
- 2025Learning Global Representation from Queries for Vectorized HD Map Construction8 Oct 2025
- 2025Persistent Autoregressive Mapping with Traffic Rules for Autonomous Driving26 Sep 2025
- 2025UniMapGen: A Generative Framework for Large-Scale Map Construction from Multi-modal Data26 Sep 2025
- 2025Mapping like a Skeptic: Probabilistic BEV Projection for Online HD Mapping29 Aug 2025
- 2025MapKD: Unlocking Prior Knowledge with Cross-Modal Distillation for Efficient Online HD Map Construction21 Aug 2025
- 2025RATopo: Improving Lane Topology Reasoning via Redundancy Assignment21 Aug 2025
- 2025PriorFusion: Unified Integration of Priors for Robust Road Perception in Autonomous Driving31 Jul 2025
- 2025RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priors29 Jul 2025
- 2025Delving into Mapping Uncertainty for Mapless Trajectory Prediction24 Jul 2025
- 2025What Really Matters for Robust Multi-Sensor HD Map Construction?2 Jul 2025
- 2025Coherent Online Road Topology Estimation and Reasoning with Standard-Definition Maps2 Jul 2025
- 2025SafeMap: Robust HD Map Construction from Incomplete Observations1 Jul 2025
- 2025MapFM: Foundation Model-Driven HD Mapping with Multi-Task Contextual Learning18 Jun 2025
- 2025TopoPoint: Enhance Topology Reasoning via Endpoint Detection in Autonomous Driving23 May 2025
- 2025SuperMapNet for Long-Range and High-Accuracy Vectorized HD Map Construction20 May 2025
- 2025PosePilot: Steering Camera Pose for Generative World Models with Self-supervised Depth3 May 2025
- 2025LDPoly: Latent Diffusion for Polygonal Road Outline Extraction in Large-Scale Topographic Mapping29 Apr 2025
- 2025Uni-PrevPredMap: Extending PrevPredMap to a Unified Framework of Prior-Informed Modeling for Online Vectorized HD Map Construction9 Apr 2025
- 2025A Benchmark for Vision-Centric HD Mapping by V2I Systems31 Mar 2025
- 2025Uncertainty-Instructed Structure Injection for Generalizable HD Map Construction29 Mar 2025
- 2025InteractionMap: Improving Online Vectorized HDMap Construction with Interaction27 Mar 2025
- 2025AugMapNet: Improving Spatial Latent Structure via BEV Grid Augmentation for Enhanced Vectorized Online HD Map Construction17 Mar 2025
- 2025HisTrackMap: Global Vectorized High-Definition Map Construction via History Map Tracking10 Mar 2025
- 2025Rethinking Lanes and Points in Complex Scenarios for Monocular 3D Lane Detection8 Mar 2025
- 2025FastMap: Fast Queries Initialization Based Vectorized HD Map Reconstruction Framework7 Mar 2025
- 2025Leveraging V2X for Collaborative HD Maps Construction Using Scene Graph Generation14 Feb 2025
- 2024TopoBDA: Towards Bezier Deformable Attention for Road Topology Understanding25 Dec 2024
- 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expert17 Dec 2024
- 2024Monocular Lane Detection Based on Deep Learning: A Survey25 Nov 2024
- 2024Unveiling the Hidden: Online Vectorized HD Map Construction with Clip-Level Token Interaction and Propagation17 Nov 2024
- 2024HeightMapNet: Explicit Height Modeling for End-to-End HD Map Learning3 Nov 2024
50 newest of 85 All 85 (JSON)
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 231
- 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Drivingcited by 57
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Drivingcited by 47
- 2024Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehiclescited by 5
- 2025Spatial Retrieval Augmented Autonomous Drivingcited by 5
- 2026SatMap: Revisiting Satellite Maps as Prior for Online HD Map Constructioncited by 3
- 2026TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relationscited by 1
- 2026The Road Ahead in Autonomous Driving: The KITScenes Multimodal Datasetcited by 1
- 2026The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset1 Jun 2026
- 2026TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relations27 Apr 2026
- 2026SatMap: Revisiting Satellite Maps as Prior for Online HD Map Construction15 Jan 2026
- 2025Spatial Retrieval Augmented Autonomous Driving7 Dec 2025
- 2024EMMA: End-to-End Multimodal Model for Autonomous Driving30 Oct 2024
- 2024Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehicles5 Sep 2024
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Driving10 Apr 2024
- 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Driving26 Dec 2023
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 68
- 2023Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Mapscited by 58
- 2024P-MapNet: Far-seeing Map Generator Enhanced by both SDMap and HDMap Priorscited by 54
- 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
- 2024HIMap: HybrId Representation Learning for End-to-end Vectorized HD Map Constructioncited by 48
- 2024Leveraging Enhanced Queries of Point Sets for Vectorized Map Constructioncited by 46
- 2024Stream Query Denoising for Vectorized HD Map Constructioncited by 43
- 2023Online Vectorized HD Map Construction using Geometrycited by 42
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
- 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 33
- 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenescited by 29
- 2024Enhancing Vectorized Map Perception with Historical Rasterized Mapscited by 29
12 most cited of 73 All 73 (JSON)
- 2026From Fragments to Global Maps: Learning Vectorized Map Aggregation with Large Language Models1 Oct 2026
- 2026TwinIR: Coordinated Invisible Dual-Point Attacks on Online HD Map Construction5 Aug 2026
- 2026Driver2Map: Imitating Human Driving for Online High-Definition Map Construction2 Aug 2026
- 2026GaussianMap: Learning Gaussian Representation for Multi-Sensor Online HD Map Construction30 Jun 2026
- 2026GSMap: 2D Gaussians for Online HD Mapping10 May 2026
- 2026OptiMVMap: Offline Vectorized Map Construction via Optimal Multi-vehicle Perspectives18 Apr 2026
- 2026PredMapNet: Future and Historical Reasoning for Consistent Online HD Vectorized Map Construction18 Feb 2026
- 2026FlexMap: Robust HD Map Construction under Flexible Camera Configurations29 Jan 2026
- 2025AMap: Distilling Future Priors for Ahead-Aware Online HD Map Construction22 Dec 2025
- 2025SATMapTR: Satellite Image Enhanced Online HD Map Construction12 Dec 2025
- 2025nuScenes Revisited: Progress and Challenges in Autonomous Driving2 Dec 2025
- 2025MapRF: Weakly Supervised Online HD Map Construction via NeRF-Guided Self-Training24 Nov 2025
12 newest of 73 All 73 (JSON)