mlsanityData to 14 Oct 2026

Building Transportation Foundation Model via Generative Graph Transformer

arXiv 2305.14826 ↗First posted 24 May 2023cs.LG cs.AIcited by 19

Not on the map. Why?

Abstract (arXiv)

Efficient traffic management is crucial for maintaining urban mobility, especially in densely populated areas where congestion, accidents, and delays can lead to frustrating and expensive commutes. However, existing prediction methods face challenges in terms of optimizing a single objective and understanding the complex composition of the transportation system. Moreover, they lack the ability to understand the macroscopic system and cannot efficiently utilize big data. In this paper, we propose a novel approach, Transportation Foundation Model (TFM), which integrates the principles of traffic simulation into traffic prediction. TFM uses graph structures and dynamic graph generation algorithms to capture the participatory behavior and interaction of transportation system actors. This data-driven and model-free simulation method addresses the challenges faced by traditional systems in terms of structural complexity and model accuracy and provides a foundation for solving complex transportation problems with real data. The proposed approach shows promising results in accurately predicting traffic outcomes in an urban transportation setting.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 12 of its 58 references that are in the map. First posted on arXiv 24 May 2023.

Builds on

12 of 58 references.

References · 12

  1. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  2. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  3. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
  4. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
  5. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
  6. 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 213
  7. 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 210
  8. 2018Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Predictioncited by 122
  9. 2021Z-GCNETs: Time Zigzags at Graph Convolutional Networks for Time Series Forecastingcited by 67
  10. 2019STG2Seq: Spatial-temporal Graph to Sequence Model for Multi-step Passenger Demand Forecastingcited by 60
  11. 2017Predicting Citywide Crowd Flows Using Deep Spatio-Temporal Residual Networkscited by 34
  12. 2021An Overview of Agent-based Traffic Simulatorscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 4; 2024: 5; 2025: 6; 2026: 4.

19 papers.

Sort:

By area:

  1. 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 239
  2. 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
  3. 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 110
  4. 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 103
  5. 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 87
  6. 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
  7. 2025Foundation Models for Spatio-Temporal Data Science: A Tutorial and Surveycited by 24
  8. 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
  9. 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
  10. 2024Large Language Models for Mobility Analysis in Transportation Systems: A Survey on Forecasting Taskscited by 16
  11. 2023TransWorldNG: Traffic Simulation via Foundation Modelcited by 9
  12. 2025Towards Graph Foundation Models: A Transferability Perspectivecited by 7
7 more
  1. 2026A Fair Evaluation of Graph Foundation Models for Node Property Predictioncited by 4
  2. 2024TCDformer-based Momentum Transfer Model for Long-term Sports Predictioncited by 2
  3. 2026Enactor: From Traffic Simulators to Surrogate World Modelscited by 2
  4. 2025VTS-LLM: Domain-Adaptive LLM Agent for Enhancing Awareness in Vessel Traffic Services through Natural Languagecited by 1
  5. 2025Uncovering Zero-Shot Generalization Gaps in Time-Series Foundation Models Using Real-World Videoscited by 1
  6. 2026A Generative Model for Closed-Loop Microsimulation of Signalized Intersectionscited by 0
  7. 2026PhaseShift: Topology-Aware Data Harmonization and Model Consolidation Across Signalized Intersectionscited by 0