Building Transportation Foundation Model via Generative Graph Transformer
Not on the map. Why?
Abstract (arXiv)
Efficient traffic management is crucial for maintaining urban mobility, especially in densely populated areas where congestion, accidents, and delays can lead to frustrating and expensive commutes. However, existing prediction methods face challenges in terms of optimizing a single objective and understanding the complex composition of the transportation system. Moreover, they lack the ability to understand the macroscopic system and cannot efficiently utilize big data. In this paper, we propose a novel approach, Transportation Foundation Model (TFM), which integrates the principles of traffic simulation into traffic prediction. TFM uses graph structures and dynamic graph generation algorithms to capture the participatory behavior and interaction of transportation system actors. This data-driven and model-free simulation method addresses the challenges faced by traditional systems in terms of structural complexity and model accuracy and provides a foundation for solving complex transportation problems with real data. The proposed approach shows promising results in accurately predicting traffic outcomes in an urban transportation setting.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 12 of its 58 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
12 of 58 references.
References · 12
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
- 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 213
- 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 210
- 2018Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Predictioncited by 122
- 2021Z-GCNETs: Time Zigzags at Graph Convolutional Networks for Time Series Forecastingcited by 67
- 2019STG2Seq: Spatial-temporal Graph to Sequence Model for Multi-step Passenger Demand Forecastingcited by 60
- 2017Predicting Citywide Crowd Flows Using Deep Spatio-Temporal Residual Networkscited by 34
- 2021An Overview of Agent-based Traffic Simulatorscited by 11
Built on by
Citing papers per year: 2023: 4; 2024: 5; 2025: 6; 2026: 4.
19 papers.
Sort:
By area:
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 239
- 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
- 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 110
- 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 103
- 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 87
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
- 2025Foundation Models for Spatio-Temporal Data Science: A Tutorial and Surveycited by 24
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
- 2024Large Language Models for Mobility Analysis in Transportation Systems: A Survey on Forecasting Taskscited by 16
- 2023TransWorldNG: Traffic Simulation via Foundation Modelcited by 9
- 2025Towards Graph Foundation Models: A Transferability Perspectivecited by 7
7 more
- 2026A Fair Evaluation of Graph Foundation Models for Node Property Predictioncited by 4
- 2024TCDformer-based Momentum Transfer Model for Long-term Sports Predictioncited by 2
- 2026Enactor: From Traffic Simulators to Surrogate World Modelscited by 2
- 2025VTS-LLM: Domain-Adaptive LLM Agent for Enhancing Awareness in Vessel Traffic Services through Natural Languagecited by 1
- 2025Uncovering Zero-Shot Generalization Gaps in Time-Series Foundation Models Using Real-World Videoscited by 1
- 2026A Generative Model for Closed-Loop Microsimulation of Signalized Intersectionscited by 0
- 2026PhaseShift: Topology-Aware Data Harmonization and Model Consolidation Across Signalized Intersectionscited by 0
- 2026PhaseShift: Topology-Aware Data Harmonization and Model Consolidation Across Signalized Intersections26 Aug 2026
- 2026A Fair Evaluation of Graph Foundation Models for Node Property Prediction23 Jun 2026
- 2026A Generative Model for Closed-Loop Microsimulation of Signalized Intersections22 Jun 2026
- 2026Enactor: From Traffic Simulators to Surrogate World Models18 Mar 2026
- 2025Uncovering Zero-Shot Generalization Gaps in Time-Series Foundation Models Using Real-World Videos30 Sep 2025
- 2025VTS-LLM: Domain-Adaptive LLM Agent for Enhancing Awareness in Vessel Traffic Services through Natural Language2 May 2025
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap27 Mar 2025
- 2025Foundation Models for Spatio-Temporal Data Science: A Tutorial and Survey12 Mar 2025
- 2025Towards Graph Foundation Models: A Transferability Perspective12 Mar 2025
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directions8 Jan 2025
- 2024TCDformer-based Momentum Transfer Model for Long-term Sports Prediction16 Sep 2024
- 2024Large Language Models for Mobility Analysis in Transportation Systems: A Survey on Forecasting Tasks3 May 2024
7 more
- 2024Foundation Models for Time Series Analysis: A Tutorial and Survey21 Mar 2024
- 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Prediction19 Feb 2024
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models30 Jan 2024
- 2023Graph Foundation Models: Concepts, Opportunities and Challenges18 Oct 2023
- 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook16 Oct 2023
- 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detection7 Jul 2023
- 2023TransWorldNG: Traffic Simulation via Foundation Model25 May 2023
- 2026Enactor: From Traffic Simulators to Surrogate World Models18 Mar 2026
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 239
- 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
- 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 110
- 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 103
- 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 87
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
- 2025Foundation Models for Spatio-Temporal Data Science: A Tutorial and Surveycited by 24
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
- 2024Large Language Models for Mobility Analysis in Transportation Systems: A Survey on Forecasting Taskscited by 16
- 2023TransWorldNG: Traffic Simulation via Foundation Modelcited by 9
- 2025Towards Graph Foundation Models: A Transferability Perspectivecited by 7
12 most cited of 17 All 17 (JSON)
- 2026PhaseShift: Topology-Aware Data Harmonization and Model Consolidation Across Signalized Intersections26 Aug 2026
- 2026A Fair Evaluation of Graph Foundation Models for Node Property Prediction23 Jun 2026
- 2026A Generative Model for Closed-Loop Microsimulation of Signalized Intersections22 Jun 2026
- 2025Uncovering Zero-Shot Generalization Gaps in Time-Series Foundation Models Using Real-World Videos30 Sep 2025
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap27 Mar 2025
- 2025Foundation Models for Spatio-Temporal Data Science: A Tutorial and Survey12 Mar 2025
- 2025Towards Graph Foundation Models: A Transferability Perspective12 Mar 2025
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directions8 Jan 2025
- 2024TCDformer-based Momentum Transfer Model for Long-term Sports Prediction16 Sep 2024
- 2024Large Language Models for Mobility Analysis in Transportation Systems: A Survey on Forecasting Tasks3 May 2024
- 2024Foundation Models for Time Series Analysis: A Tutorial and Survey21 Mar 2024
- 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Prediction19 Feb 2024
12 newest of 17 All 17 (JSON)