mlsanityData to 14 Oct 2026

From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Driving

arXiv 2509.23641 ↗First posted 28 Sep 2025cs.CV cs.ROcited by 2

On the map: End-to-end autonomous driving → VLMs for autonomous driving

Abstract (arXiv)

The key to achieving autonomous driving lies in topology-aware perception, the structured understanding of the driving environment with an emphasis on lane topology and road semantics. This survey systematically reviews four core research directions under this theme: vectorized map construction, topological structure modeling, prior knowledge fusion, and language model-based perception. Across these directions, we observe a unifying trend: a paradigm shift from static, pre-built maps to dynamic, sensor-driven perception. Specifically, traditional static maps have provided semantic context for autonomous systems. However, they are costly to construct, difficult to update in real time, and lack generalization across regions, limiting their scalability. In contrast, dynamic representations leverage on-board sensor data for real-time map construction and topology reasoning. Each of the four research directions contributes to this shift through compact spatial modeling, semantic relational reasoning, robust domain knowledge integration, and multimodal scene understanding powered by pre-trained language models. Together, they pave the way for more adaptive, scalable, and explainable autonomous driving systems.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in VLMs for autonomous driving, one of 9 directions in End-to-end autonomous driving. Builds on 96 of its 111 references that are in the map. First posted on arXiv 28 Sep 2025.

Builds on

96 of 111 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Sce2DriveX: A Generalized MLLM Framework for Scene-to-Drive Learning19 Feb
  2. 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Driving26 Dec
  3. 2023DriveLM: Driving with Graph Visual Question Answering21 Dec
  4. 2023LingoQA: Visual Question Answering for Autonomous Driving21 Dec
  5. 2023Talk2BEV: Language-enhanced Bird's-eye View Maps for Autonomous Driving3 Oct

Other references · 91

  1. 2020End-to-End Object Detection with Transformerscited by 7,414
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  4. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  5. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  6. 2022Planning-oriented Autonomous Drivingcited by 1,087
  7. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  8. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
  9. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
  10. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
  11. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
  12. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
38 more
  1. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
  2. 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
  3. 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 377
  4. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
  5. 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 352
  6. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
  7. 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
  8. 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
  9. 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 280
  10. 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
  11. 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 262
  12. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
  13. 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
  14. 2018Textual Explanations for Self-Driving Vehiclescited by 226
  15. 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 212
  16. 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
  17. 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
  18. 2020LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mappingcited by 188
  19. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
  20. 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
  21. 2022M2BEV: Multi-Camera Joint 3D Detection and Segmentation with Unified Birds-Eye View Representationcited by 156
  22. 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
  23. 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 145
  24. 2019Talk2Car: Taking Control of Your Self-Driving Carcited by 142
  25. 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
  26. 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
  27. 2019Multimodal End-to-End Autonomous Drivingcited by 110
  28. 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 110
  29. 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
  30. 2023Visual Point Cloud Forecasting enables Scalable Autonomous Drivingcited by 99
  31. 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
  32. 2023Referring Multi-Object Trackingcited by 93
  33. 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
  34. 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
  35. 2023Neural Map Prior for Autonomous Drivingcited by 68
  36. 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 68
  37. 2023Rank2Tell: A Multimodal Driving Dataset for Joint Importance Ranking and Reasoningcited by 63
  38. 2023Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Mapscited by 58

50 most cited of 91 All 91 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Are VLMs Ready for Lane Topology Awareness in Autonomous Driving?
  2. 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenes
  3. 2024Embodied Understanding of Driving Scenarios
  4. 2023Graph-based Topology Reasoning for Driving Scenes
  5. 2025TopoStreamer: Temporal Lane Segment Topology Reasoning in Autonomous Driving
  6. 2025FASTopoWM: Fast-Slow Lane Segment Topology Reasoning with Latent World Models
  7. 2025RoadSceneBench: A Lightweight Benchmark for Mid-Level Road Scene Understanding
  8. 2025V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving