T2SG: Traffic Topology Scene Graph for Topology Reasoning in Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Understanding the traffic scenes and then generating high-definition (HD) maps present significant challenges in autonomous driving. In this paper, we defined a novel Traffic Topology Scene Graph, a unified scene graph explicitly modeling the lane, controlled and guided by different road signals (e.g., right turn), and topology relationships among them, which is always ignored by previous high-definition (HD) mapping methods. For the generation of T2SG, we propose TopoFormer, a novel one-stage Topology Scene Graph TransFormer with two newly designed layers. Specifically, TopoFormer incorporates a Lane Aggregation Layer (LAL) that leverages the geometric distance among the centerline of lanes to guide the aggregation of global information. Furthermore, we proposed a Counterfactual Intervention Layer (CIL) to model the reasonable road structure ( e.g., intersection, straight) among lanes under counterfactual intervention. Then the generated T2SG can provide a more accurate and explainable description of the topological structure in traffic scenes. Experimental results demonstrate that TopoFormer outperforms existing methods on the T2SG generation task, and the generated T2SG significantly enhances traffic topology reasoning in downstream tasks, achieving a state-of-the-art performance of 46.3 OLS on the OpenLane-V2 benchmark. We will release our source code and model.
Key facts. Cited by 35 papers in the map (data through 13 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 28 Nov 2024.
Builds on
36 of 46 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2020End-to-End Object Detection with Transformerscited by 7,396
- 2016Feature Pyramid Networks for Object Detectioncited by 5,027
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,021
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,498
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,417
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,649
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,215
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 704
- 2017Scene Graph Generation by Iterative Message Passingcited by 462
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 314
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 245
24 more
- 2021MP3: A Unified Model to Map, Perceive, Predict and Plancited by 212
- 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 205
- 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 187
- 2020Keep your Eyes on the Lane: Real-time Attention-guided Lane Detectioncited by 138
- 2021Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identificationcited by 114
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2022RelTR: Relation Transformer for Scene Graph Generationcited by 95
- 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
- 2023End-to-End Vectorized HD-map Construction with Piecewise Bezier Curvecited by 82
- 2018Attentive Relational Networks for Mapping Images to Scene Graphscited by 73
- 2023Exploring Diverse In-Context Configurations for Image Captioningcited by 63
- 2023Graph-based Topology Reasoning for Driving Scenescited by 54
- 2023Lane Graph as Path: Continuity-preserving Path-wise Modeling for Online Lane Graph Constructioncited by 50
- 2021Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysiscited by 47
- 2023Online Vectorized HD Map Construction using Geometrycited by 42
- 2023TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoningcited by 41
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
- 2023SGAligner : 3D Scene Alignment with Scene Graphscited by 30
- 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenescited by 29
- 2023SGFormer: Semantic Graph Transformer for Point Cloud-based 3D Scene Graph Generationcited by 27
- 2022VQA-GNN: Reasoning with Multimodal Knowledge via Graph Neural Networks for Visual Question Answeringcited by 22
- 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embeddingcited by 19
- 2023Disentangled Counterfactual Learning for Physical Audiovisual Commonsense Reasoningcited by 13
- 2024Drones Help Drones: A Collaborative Framework for Multi-Drone Object Trajectory Prediction and Beyondcited by 12
Built on by
Citing papers per year: 2024: 1; 2025: 14; 2026: 20.
35 papers.
Sort:
By area:
- 2025SafeDriveRAG: Towards Safe Autonomous Driving with Knowledge Graph-based Retrieval-Augmented Generationcited by 15
- 2025Explainable Action Form Assessment by Exploiting Multimodal Chain-of-Thoughts Reasoningcited by 14
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimationcited by 12
- 2025TopoPoint: Enhance Topology Reasoning via Endpoint Detection in Autonomous Drivingcited by 9
- 2025VLM-Assisted Continual learning for Visual Question Answering in Self-Drivingcited by 6
- 2025GraphPilot: Grounded Scene Graph Conditioning for Language-Based Autonomous Drivingcited by 6
- 2024TopoBDA: Towards Bezier Deformable Attention for Road Topology Understandingcited by 5
- 2025Robo-SGG: Exploiting Layout-Oriented Normalization and Restitution Can Improve Robust Scene Graph Generationcited by 3
- 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenescited by 3
- 2025TopoStreamer: Temporal Lane Segment Topology Reasoning in Autonomous Drivingcited by 3
- 2025FASTopoWM: Fast-Slow Lane Segment Topology Reasoning with Latent World Modelscited by 3
- 2026Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Modelscited by 3
23 more
- 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Drivingcited by 2
- 2025Seeing before Observable: Potential Risk Reasoning in Autonomous Driving via Vision Language Modelscited by 2
- 2026The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Modelscited by 2
- 2026CritiqueDriveVLM: From Verifier-Guided Reinforcement Learning to Latent Thought Distillation for Autonomous Drivingcited by 2
- 2025Chain-of-Evidence Multimodal Reasoning for Few-shot Temporal Action Localizationcited by 1
- 2026TopoMaskV3: 3D Mask Head with Dense Offset and Height Predictions for Road Topology Understandingcited by 1
- 2026GeoReFormer: Geometry-Aware Refinement for Lane Segment Detection and Topology Reasoningcited by 1
- 2026TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relationscited by 1
- 2026Unified Modeling of Lane and Lane Topology for Driving Scene Reasoningcited by 1
- 2026Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generationcited by 1
- 2026A VideoMAE-v2 Approach to Zero-Shot Traffic Accident Anticipationcited by 1
- 2025Multi-Modal Scene Graph with Kolmogorov-Arnold Experts for Audio-Visual Question Answeringcited by 0
- 2026Building Deep Graph Predictors with Graph Imitation Learningcited by 0
- 2026ReManNet: A Riemannian Manifold Network for Monocular 3D Lane Detectioncited by 0
- 2026Claude Code-Driving Scenario Mining for the Argoverse 2 Challengecited by 0
- 2026Leveraging Metric Depth for Relative Depth Predictioncited by 0
- 2026SGFormer++: Semantic Graph Transformer for Incremental 3D Scene Graph Generationcited by 0
- 2026A DVDrive Approach for doScenes Instructed Driving Challengecited by 0
- 2026Generative Lane Topology Reasoning via Autoregressive Model with Geometry Priorcited by 0
- 2026HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priorscited by 0
- 2026Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Drivingcited by 0
- 2026VTO: Visual Tool Orchestration for Video Anomaly Detectioncited by 0
- 2026Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Drivingcited by 0
- 2026Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Driving18 Aug 2026
- 2026VTO: Visual Tool Orchestration for Video Anomaly Detection8 Aug 2026
- 2026Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Driving23 Jul 2026
- 2026HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priors23 Jul 2026
- 2026CritiqueDriveVLM: From Verifier-Guided Reinforcement Learning to Latent Thought Distillation for Autonomous Driving5 Jul 2026
- 2026Generative Lane Topology Reasoning via Autoregressive Model with Geometry Prior30 Jun 2026
- 2026A DVDrive Approach for doScenes Instructed Driving Challenge19 Jun 2026
- 2026SGFormer++: Semantic Graph Transformer for Incremental 3D Scene Graph Generation13 Jun 2026
- 2026Leveraging Metric Depth for Relative Depth Prediction9 Jun 2026
- 2026A VideoMAE-v2 Approach to Zero-Shot Traffic Accident Anticipation8 Jun 2026
- 2026Claude Code-Driving Scenario Mining for the Argoverse 2 Challenge8 Jun 2026
- 2026Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generation4 Jun 2026
23 more
- 2026Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models1 Jun 2026
- 2026Unified Modeling of Lane and Lane Topology for Driving Scene Reasoning9 May 2026
- 2026TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relations27 Apr 2026
- 2026GeoReFormer: Geometry-Aware Refinement for Lane Segment Detection and Topology Reasoning27 Mar 2026
- 2026ReManNet: A Riemannian Manifold Network for Monocular 3D Lane Detection20 Mar 2026
- 2026TopoMaskV3: 3D Mask Head with Dense Offset and Height Predictions for Road Topology Understanding2 Mar 2026
- 2026Building Deep Graph Predictors with Graph Imitation Learning21 Jan 2026
- 2026The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Models12 Jan 2026
- 2025Explainable Action Form Assessment by Exploiting Multimodal Chain-of-Thoughts Reasoning17 Dec 2025
- 2025Multi-Modal Scene Graph with Kolmogorov-Arnold Experts for Audio-Visual Question Answering28 Nov 2025
- 2025Seeing before Observable: Potential Risk Reasoning in Autonomous Driving via Vision Language Models28 Nov 2025
- 2025GraphPilot: Grounded Scene Graph Conditioning for Language-Based Autonomous Driving14 Nov 2025
- 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Driving28 Sep 2025
- 2025FASTopoWM: Fast-Slow Lane Segment Topology Reasoning with Latent World Models31 Jul 2025
- 2025SafeDriveRAG: Towards Safe Autonomous Driving with Knowledge Graph-based Retrieval-Augmented Generation29 Jul 2025
- 2025TopoStreamer: Temporal Lane Segment Topology Reasoning in Autonomous Driving1 Jul 2025
- 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenes16 Jun 2025
- 2025TopoPoint: Enhance Topology Reasoning via Endpoint Detection in Autonomous Driving23 May 2025
- 2025Chain-of-Evidence Multimodal Reasoning for Few-shot Temporal Action Localization18 Apr 2025
- 2025Robo-SGG: Exploiting Layout-Oriented Normalization and Restitution Can Improve Robust Scene Graph Generation17 Apr 2025
- 2025VLM-Assisted Continual learning for Visual Question Answering in Self-Driving2 Feb 2025
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimation9 Jan 2025
- 2024TopoBDA: Towards Bezier Deformable Attention for Road Topology Understanding25 Dec 2024
- 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenescited by 3
- 2025TopoStreamer: Temporal Lane Segment Topology Reasoning in Autonomous Drivingcited by 3
- 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Drivingcited by 2
- 2026TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relationscited by 1
- 2026A DVDrive Approach for doScenes Instructed Driving Challengecited by 0
- 2026Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Drivingcited by 0
- 2026Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Driving18 Aug 2026
- 2026A DVDrive Approach for doScenes Instructed Driving Challenge19 Jun 2026
- 2026TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relations27 Apr 2026
- 2025From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Driving28 Sep 2025
- 2025TopoStreamer: Temporal Lane Segment Topology Reasoning in Autonomous Driving1 Jul 2025
- 2025Geometry-Guided Representations for Coherent Lane and Traffic Topology Reasoning in Driving Scenes16 Jun 2025
- 2025Explainable Action Form Assessment by Exploiting Multimodal Chain-of-Thoughts Reasoningcited by 14
- 2026Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Modelscited by 3
- 2026CritiqueDriveVLM: From Verifier-Guided Reinforcement Learning to Latent Thought Distillation for Autonomous Drivingcited by 2
- 2025Chain-of-Evidence Multimodal Reasoning for Few-shot Temporal Action Localizationcited by 1
- 2026Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generationcited by 1
- 2026CritiqueDriveVLM: From Verifier-Guided Reinforcement Learning to Latent Thought Distillation for Autonomous Driving5 Jul 2026
- 2026Global-Local Monte Carlo Tree Search in Vision-Language Models for Text-to-3D Indoor Scene Generation4 Jun 2026
- 2026Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models1 Jun 2026
- 2025Explainable Action Form Assessment by Exploiting Multimodal Chain-of-Thoughts Reasoning17 Dec 2025
- 2025Chain-of-Evidence Multimodal Reasoning for Few-shot Temporal Action Localization18 Apr 2025
- 2025SafeDriveRAG: Towards Safe Autonomous Driving with Knowledge Graph-based Retrieval-Augmented Generationcited by 15
- 2025VLM-Assisted Continual learning for Visual Question Answering in Self-Drivingcited by 6
- 2025GraphPilot: Grounded Scene Graph Conditioning for Language-Based Autonomous Drivingcited by 6
- 2025Seeing before Observable: Potential Risk Reasoning in Autonomous Driving via Vision Language Modelscited by 2
- 2025Seeing before Observable: Potential Risk Reasoning in Autonomous Driving via Vision Language Models28 Nov 2025
- 2025GraphPilot: Grounded Scene Graph Conditioning for Language-Based Autonomous Driving14 Nov 2025
- 2025SafeDriveRAG: Towards Safe Autonomous Driving with Knowledge Graph-based Retrieval-Augmented Generation29 Jul 2025
- 2025VLM-Assisted Continual learning for Visual Question Answering in Self-Driving2 Feb 2025
- 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimationcited by 12
- 2025TopoPoint: Enhance Topology Reasoning via Endpoint Detection in Autonomous Drivingcited by 9
- 2024TopoBDA: Towards Bezier Deformable Attention for Road Topology Understandingcited by 5
- 2025Robo-SGG: Exploiting Layout-Oriented Normalization and Restitution Can Improve Robust Scene Graph Generationcited by 3
- 2026The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Modelscited by 2
- 2026TopoMaskV3: 3D Mask Head with Dense Offset and Height Predictions for Road Topology Understandingcited by 1
- 2026GeoReFormer: Geometry-Aware Refinement for Lane Segment Detection and Topology Reasoningcited by 1
- 2026Unified Modeling of Lane and Lane Topology for Driving Scene Reasoningcited by 1
- 2026A VideoMAE-v2 Approach to Zero-Shot Traffic Accident Anticipationcited by 1
- 2026Building Deep Graph Predictors with Graph Imitation Learningcited by 0
- 2026ReManNet: A Riemannian Manifold Network for Monocular 3D Lane Detectioncited by 0
- 2026Claude Code-Driving Scenario Mining for the Argoverse 2 Challengecited by 0
12 most cited of 17 All 17 (JSON)
- 2026Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Driving23 Jul 2026
- 2026HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priors23 Jul 2026
- 2026Generative Lane Topology Reasoning via Autoregressive Model with Geometry Prior30 Jun 2026
- 2026SGFormer++: Semantic Graph Transformer for Incremental 3D Scene Graph Generation13 Jun 2026
- 2026Leveraging Metric Depth for Relative Depth Prediction9 Jun 2026
- 2026A VideoMAE-v2 Approach to Zero-Shot Traffic Accident Anticipation8 Jun 2026
- 2026Claude Code-Driving Scenario Mining for the Argoverse 2 Challenge8 Jun 2026
- 2026Unified Modeling of Lane and Lane Topology for Driving Scene Reasoning9 May 2026
- 2026GeoReFormer: Geometry-Aware Refinement for Lane Segment Detection and Topology Reasoning27 Mar 2026
- 2026ReManNet: A Riemannian Manifold Network for Monocular 3D Lane Detection20 Mar 2026
- 2026TopoMaskV3: 3D Mask Head with Dense Offset and Height Predictions for Road Topology Understanding2 Mar 2026
- 2026Building Deep Graph Predictors with Graph Imitation Learning21 Jan 2026
12 newest of 17 All 17 (JSON)