From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Driving
On the map: End-to-end autonomous driving → VLMs for autonomous driving
Abstract (arXiv)
The key to achieving autonomous driving lies in topology-aware perception, the structured understanding of the driving environment with an emphasis on lane topology and road semantics. This survey systematically reviews four core research directions under this theme: vectorized map construction, topological structure modeling, prior knowledge fusion, and language model-based perception. Across these directions, we observe a unifying trend: a paradigm shift from static, pre-built maps to dynamic, sensor-driven perception. Specifically, traditional static maps have provided semantic context for autonomous systems. However, they are costly to construct, difficult to update in real time, and lack generalization across regions, limiting their scalability. In contrast, dynamic representations leverage on-board sensor data for real-time map construction and topology reasoning. Each of the four research directions contributes to this shift through compact spatial modeling, semantic relational reasoning, robust domain knowledge integration, and multimodal scene understanding powered by pre-trained language models. Together, they pave the way for more adaptive, scalable, and explainable autonomous driving systems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in VLMs for autonomous driving, one of 9 directions in End-to-end autonomous driving. Builds on 96 of its 111 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
96 of 111 references.
Closest ancestors · 5
Same direction, newest first
- 2025Sce2DriveX: A Generalized MLLM Framework for Scene-to-Drive Learning19 Feb
- 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Driving26 Dec
- 2023DriveLM: Driving with Graph Visual Question Answering21 Dec
- 2023LingoQA: Visual Question Answering for Autonomous Driving21 Dec
- 2023Talk2BEV: Language-enhanced Bird's-eye View Maps for Autonomous Driving3 Oct
Other references · 91
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
38 more
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 377
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 352
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
- 2021HDMapNet: An Online HD Map Construction and Evaluation Frameworkcited by 281
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 280
- 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
- 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 262
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2018Textual Explanations for Self-Driving Vehiclescited by 226
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 212
- 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 193
- 2020LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mappingcited by 188
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
- 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 179
- 2022M2BEV: Multi-Camera Joint 3D Detection and Segmentation with Unified Birds-Eye View Representationcited by 156
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2023StreamMapNet: Streaming Mapping Network for Vectorized Online HD Map Constructioncited by 145
- 2019Talk2Car: Taking Control of Your Self-Driving Carcited by 142
- 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2019Multimodal End-to-End Autonomous Drivingcited by 110
- 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 110
- 2021THOMAS: Trajectory Heatmap Output with learned Multi-Agent Samplingcited by 101
- 2023Visual Point Cloud Forecasting enables Scalable Autonomous Drivingcited by 99
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2023Referring Multi-Object Trackingcited by 93
- 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
- 2022M2I: From Factored Marginal Trajectory Prediction to Interactive Predictioncited by 81
- 2023Neural Map Prior for Autonomous Drivingcited by 68
- 2024MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mappingcited by 68
- 2023Rank2Tell: A Multimodal Driving Dataset for Joint Importance Ranking and Reasoningcited by 63
- 2023Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Mapscited by 58
50 most cited of 91 All 91 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Are VLMs Ready for Lane Topology Awareness in Autonomous Driving?
- 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenes
- 2024Embodied Understanding of Driving Scenarios
- 2023Graph-based Topology Reasoning for Driving Scenes
- 2025TopoStreamer: Temporal Lane Segment Topology Reasoning in Autonomous Driving
- 2025FASTopoWM: Fast-Slow Lane Segment Topology Reasoning with Latent World Models
- 2025RoadSceneBench: A Lightweight Benchmark for Mid-Level Road Scene Understanding
- 2025V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving