mlsanityData to 13 Oct 2026

T2SG: Traffic Topology Scene Graph for Topology Reasoning in Autonomous Driving

arXiv 2411.18894 ↗First posted 28 Nov 2024cs.CVcited by 35

Not on the map. Why?

Abstract (arXiv)

Understanding the traffic scenes and then generating high-definition (HD) maps present significant challenges in autonomous driving. In this paper, we defined a novel Traffic Topology Scene Graph, a unified scene graph explicitly modeling the lane, controlled and guided by different road signals (e.g., right turn), and topology relationships among them, which is always ignored by previous high-definition (HD) mapping methods. For the generation of T2SG, we propose TopoFormer, a novel one-stage Topology Scene Graph TransFormer with two newly designed layers. Specifically, TopoFormer incorporates a Lane Aggregation Layer (LAL) that leverages the geometric distance among the centerline of lanes to guide the aggregation of global information. Furthermore, we proposed a Counterfactual Intervention Layer (CIL) to model the reasonable road structure ( e.g., intersection, straight) among lanes under counterfactual intervention. Then the generated T2SG can provide a more accurate and explainable description of the topological structure in traffic scenes. Experimental results demonstrate that TopoFormer outperforms existing methods on the T2SG generation task, and the generated T2SG significantly enhances traffic topology reasoning in downstream tasks, achieving a state-of-the-art performance of 46.3 OLS on the OpenLane-V2 benchmark. We will release our source code and model.

Key facts. Cited by 35 papers in the map (data through 13 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 28 Nov 2024.

Builds on

36 of 46 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  2. 2020End-to-End Object Detection with Transformerscited by 7,396
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,027
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,021
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,498
  6. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,417
  7. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,649
  8. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,215
  9. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 704
  10. 2017Scene Graph Generation by Iterative Message Passingcited by 462
  11. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
  12. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
24 more
  1. 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 212
  2. 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 205
  3. 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 187
  4. 2020Keep your Eyes on the Lane: Real-time Attention-guided Lane Detectioncited by 138
  5. 2021Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identificationcited by 114
  6. 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
  7. 2022RelTR: Relation Transformer for Scene Graph Generationcited by 95
  8. 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
  9. 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 82
  10. 2018Attentive Relational Networks for Mapping Images to Scene Graphscited by 73
  11. 2023Exploring Diverse In-Context Configurations for Image Captioningcited by 63
  12. 2023Graph-based Topology Reasoning for Driving Scenescited by 54
  13. 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
  14. 2021Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysiscited by 47
  15. 2023Online Vectorized HD Map Construction using Geometrycited by 42
  16. 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
  17. 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
  18. 2023SGAligner : 3D Scene Alignment with Scene Graphscited by 30
  19. 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenescited by 29
  20. 2023SGFormer: Semantic Graph Transformer for Point Cloud-based 3D Scene Graph Generationcited by 27
  21. 2022VQA-GNN: Reasoning with Multimodal Knowledge via Graph Neural Networks for Visual Question Answeringcited by 22
  22. 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embeddingcited by 19
  23. 2023Disentangled Counterfactual Learning for Physical Audiovisual Commonsense Reasoningcited by 13
  24. 2024Drones Help Drones: A Collaborative Framework for Multi-Drone Object Trajectory Prediction and Beyondcited by 12

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2024: 1; 2025: 14; 2026: 20.

35 papers.

Sort:

By area:

  1. 2025SafeDriveRAG: Towards Safe Autonomous Driving with Knowledge Graph-based Retrieval-Augmented Generationcited by 15
  2. 2025Explainable Action Form Assessment by Exploiting Multimodal Chain-of-Thoughts Reasoningcited by 14
  3. 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimationcited by 12
  4. 2025TopoPoint: Enhance Topology Reasoning via Endpoint Detection in Autonomous Drivingcited by 9
  5. 2025VLM-Assisted Continual learning for Visual Question Answering in Self-Drivingcited by 6
  6. 2025GraphPilot: Grounded Scene Graph Conditioning for Language-Based Autonomous Drivingcited by 6
  7. 2024TopoBDA: Towards Bezier Deformable Attention for Road Topology Understandingcited by 5
  8. 2025Robo-SGG: Exploiting Layout-Oriented Normalization and Restitution Can Improve Robust Scene Graph Generationcited by 3
  9. 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenescited by 3
  10. 2025TopoStreamer: Temporal Lane Segment Topology Reasoning in Autonomous Drivingcited by 3
  11. 2025FASTopoWM: Fast-Slow Lane Segment Topology Reasoning with Latent World Modelscited by 3
  12. 2026Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Modelscited by 3
23 more
  1. 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Drivingcited by 2
  2. 2025Seeing before Observable: Potential Risk Reasoning in Autonomous Driving via Vision Language Modelscited by 2
  3. 2026The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Modelscited by 2
  4. 2026CritiqueDriveVLM: From Verifier-Guided Reinforcement Learning to Latent Thought Distillation for Autonomous Drivingcited by 2
  5. 2025Chain-of-Evidence Multimodal Reasoning for Few-shot Temporal Action Localizationcited by 1
  6. 2026TopoMaskV3: 3D Mask Head with Dense Offset and Height Predictions for Road Topology Understandingcited by 1
  7. 2026GeoReFormer: Geometry-Aware Refinement for Lane Segment Detection and Topology Reasoningcited by 1
  8. 2026TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relationscited by 1
  9. 2026Unified Modeling of Lane and Lane Topology for Driving Scene Reasoningcited by 1
  10. 2026Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generationcited by 1
  11. 2026A VideoMAE-v2 Approach to Zero-Shot Traffic Accident Anticipationcited by 1
  12. 2025Multi-Modal Scene Graph with Kolmogorov-Arnold Experts for Audio-Visual Question Answeringcited by 0
  13. 2026Building Deep Graph Predictors with Graph Imitation Learningcited by 0
  14. 2026ReManNet: A Riemannian Manifold Network for Monocular 3D Lane Detectioncited by 0
  15. 2026Claude Code-Driving Scenario Mining for the Argoverse 2 Challengecited by 0
  16. 2026Leveraging Metric Depth for Relative Depth Predictioncited by 0
  17. 2026SGFormer++: Semantic Graph Transformer for Incremental 3D Scene Graph Generationcited by 0
  18. 2026A DVDrive Approach for doScenes Instructed Driving Challengecited by 0
  19. 2026Generative Lane Topology Reasoning via Autoregressive Model with Geometry Priorcited by 0
  20. 2026HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priorscited by 0
  21. 2026Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Drivingcited by 0
  22. 2026VTO: Visual Tool Orchestration for Video Anomaly Detectioncited by 0
  23. 2026Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Drivingcited by 0