mlsanityData to 7 Oct 2026

InstaGraM: Instance-level Graph Modeling for Vectorized HD Map Learning

arXiv 2301.04470 ↗First posted 10 Jan 2023cs.CVcited by 40

Not on the map. Why?

Abstract (arXiv)

For scalable autonomous driving, a robust map-based localization system, independent of GPS, is fundamental. To achieve such map-based localization, online high-definition (HD) map construction plays a significant role in accurate estimation of the pose. Although recent advancements in online HD map construction have predominantly investigated on vectorized representation due to its effectiveness, they suffer from computational cost and fixed parametric model, which limit scalability. To alleviate these limitations, we propose a novel HD map learning framework that leverages graph modeling. This framework is designed to learn the construction of diverse geometric shapes, thereby enhancing the scalability of HD map construction. Our approach involves representing the map elements as an instance-level graph by decomposing them into vertices and edges to facilitate accurate and efficient end-to-end vectorized HD map learning. Furthermore, we introduce an association strategy using a Graph Neural Network to efficiently handle the complex geometry of various map elements, while maintaining scalability. Comprehensive experiments on public open dataset show that our proposed network outperforms state-of-the-art model by 1.6 mAP. We further showcase the superior scalability of our approach compared to state-of-the-art methods, achieving a 4.8 mAP improvement in long range configuration. Our code is available at https://github.com/juyebshin/InstaGraM.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 40 of its 53 references that are in the map. First posted on arXiv 10 Jan 2023.

Builds on

40 of 53 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2017Graph Attention Networkscited by 8,854
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  7. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  8. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  9. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  10. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
  11. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  12. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
28 more
  1. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  2. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  3. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  4. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  5. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
  6. 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 280
  7. 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
  8. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
  9. 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
  10. 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 173
  11. 2018Towards End-to-End Lane Detection: an Instance Segmentation Approachcited by 129
  12. 2022Vision-Centric BEV Perception: A Surveycited by 126
  13. 2022BEVSegFormer: Bird's Eye View Semantic Segmentation From Arbitrary Camera Rigscited by 123
  14. 2018Monocular Semantic Occupancy Grid Mapping with Convolutional Variational Encoder-Decoder Networkscited by 84
  15. 2022Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformercited by 80
  16. 2020A Sim2Real Deep Learning Approach for the Transformation of Images from Multiple Vehicle-Mounted Cameras to a Semantically Segmented Image in Bird's Eye Viewcited by 71
  17. 2020Inter-Region Affinity Distillation for Road Marking Segmentationcited by 58
  18. 2017VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognitioncited by 56
  19. 2020DAGMapper: Learning to Map by Discovering Lane Topologycited by 49
  20. 2021PolyWorld: Polygonal Building Extraction with Graph Neural Networks in Satellite Imagescited by 42
  21. 2018Learning to Look around Objects for Top-View Representations of Outdoor Scenescited by 37
  22. 2020Convolutional Recurrent Network for Road Boundary Extractioncited by 33
  23. 2020Understanding Bird's-Eye View of Road Semantics using an Onboard Cameracited by 29
  24. 2018Generative Adversarial Frontal View to Bird View Synthesiscited by 25
  25. 2020Driving among Flatmobiles: Bird-Eye-View occupancy grids from a monocular camera for holistic trajectory planningcited by 24
  26. 2020End-to-End Deep Structured Models for Drawing Crosswalkscited by 9
  27. 2021Coarse-to-fine Semantic Localization with HD Map for Autonomous Driving in Structural Scenescited by 5
  28. 2017Light-weight place recognition and loop detection using road markingscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 13; 2024: 15; 2025: 9; 2026: 3.

40 papers.

Sort:

By area:

  1. 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
  2. 2023CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perceptioncited by 81
  3. 2023Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Mapscited by 58
  4. 2023Graph-based Topology Reasoning for Driving Scenescited by 53
  5. 2024MGMap: Mask-Guided Learning for Online Vectorized HD Map Constructioncited by 52
  6. 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
  7. 2024Leveraging Enhanced Queries of Point Sets for Vectorized Map Constructioncited by 46
  8. 2023Localization Is All You Evaluate: Data Leakage in Online Mapping Datasets and How to Fix Itcited by 44
  9. 2024Producing and Leveraging Online Map Uncertainty in Trajectory Predictioncited by 32
  10. 2023Complementing Onboard Sensors with Satellite Map: A New Perspective for HD Map Constructioncited by 28
  11. 2024Mask2Map: Vectorized HD Map Construction Using Bird's Eye View Segmentation Maskscited by 26
  12. 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Reviewcited by 25
28 more
  1. 2023InsMapper: Exploring Inner-instance Information for Vectorized HD Mappingcited by 19
  2. 2024RoadPainter: Points Are Ideal Navigators for Topology transformERcited by 17
  3. 2023ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD Map Constructioncited by 16
  4. 2024MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expertcited by 16
  5. 2024DTCLMapper: Dual Temporal Consistent Learning for Vectorized HD Map Constructioncited by 10
  6. 2024MGMapNet: Multi-Granularity Representation Learning for End-to-End Vectorized HD Map Constructioncited by 9
  7. 2024Accelerating Online Mapping and Behavior Prediction via Direct BEV Feature Attentioncited by 8
  8. 2024TopoMaskV2: Enhanced Instance-Mask-Based Formulation for the Road Topology Problemcited by 7
  9. 2023TopoMask: Instance-Mask-Based Formulation for the Road Topology Problem via Transformer-Based Architecturecited by 5
  10. 2024Continuity Preserving Online CenterLine Graph Learningcited by 5
  11. 2024TopoBDA: Towards Bezier Deformable Attention for Road Topology Understandingcited by 5
  12. 2025Spatial Retrieval Augmented Autonomous Drivingcited by 5
  13. 2023BroadBEV: Collaborative LiDAR-camera Fusion for Broad-sighted Bird's Eye View Map Constructioncited by 4
  14. 2024Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehiclescited by 4
  15. 2024GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Constructioncited by 4
  16. 2023Learning to Predict Navigational Patterns from Partial Observationscited by 3
  17. 2025HierDAMap: Towards Universal Domain Adaptive BEV Mapping via Hierarchical Perspective Priorscited by 2
  18. 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenescited by 2
  19. 2025RelMap: Enhancing Online Map Construction with Class-Aware Spatial Relation and Semantic Priorscited by 2
  20. 2025MapRF: Weakly Supervised Online HD Map Construction via NeRF-Guided Self-Trainingcited by 2
  21. 2025nuScenes Revisited: Progress and Challenges in Autonomous Drivingcited by 2
  22. 2026To View Transform or Not to View Transform: NeRF-based Pre-training Perspectivecited by 2
  23. 2026Bridging Structure and Language: Graph-Based Visual Reasoning for Autonomous Road Understandingcited by 2
  24. 2025Learning Global Representation from Queries for Vectorized HD Map Constructioncited by 1
  25. 2025UniVector: Unified Vector Extraction via Instance-Geometry Interactioncited by 1
  26. 2024Addressing Diverging Training Costs using BEVRestore for High-resolution Bird's Eye View Map Constructioncited by 0
  27. 2025Leveraging V2X for Collaborative HD Maps Construction Using Scene Graph Generationcited by 0
  28. 2026MapTCL: Temporal Consistency Learning via Bidirectional Alignment for Vectorized HD Map Constructioncited by 0