mlsanityData to 7 Oct 2026

Embracing Large Language Models in Traffic Flow Forecasting

arXiv 2412.12201 ↗First posted 15 Dec 2024cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Traffic flow forecasting aims to predict future traffic flows based on the historical traffic conditions and the road network. It is an important problem in intelligent transportation systems, with a plethora of methods been proposed. Existing efforts mainly focus on capturing and utilizing spatio-temporal dependencies to predict future traffic flows. Though promising, they fall short in adapting to test-time environmental changes of traffic conditions. To tackle this challenge, we propose to introduce large language models (LLMs) to help traffic flow forecasting and design a novel method named Large Language Model Enhanced Traffic Flow Predictor (LEAF). LEAF adopts two branches, capturing different spatio-temporal relations using graph and hypergraph structures respectively. The two branches are first pre-trained individually, and during test-time, they yield different predictions. Based on these predictions, a large language model is used to select the most likely result. Then, a ranking loss is applied as the learning objective to enhance the prediction ability of the two branches. Extensive experiments on several datasets demonstrate the effectiveness of the proposed LEAF.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 28 of its 84 references that are in the map. First posted on arXiv 15 Dec 2024.

Builds on

28 of 84 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  8. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  9. 2024Chronos: Learning the Language of Time Seriescited by 712
  10. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  11. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
  12. 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 299
16 more
  1. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
  2. 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 212
  3. 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 179
  4. 2021Dynamic Graph Convolutional Recurrent Network for Traffic Prediction: Benchmark and Solutioncited by 156
  5. 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activitiescited by 154
  6. 2023Large Language Models in Law: A Surveycited by 128
  7. 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 86
  8. 2024Spatial-Temporal Large Language Model for Traffic Predictioncited by 81
  9. 2021Traffic Flow Forecasting with Spatial-Temporal Graph Diffusion Networkcited by 52
  10. 2023Exploring Large Language Models for Human Mobility Prediction under Public Eventscited by 34
  11. 2021Spatio-Temporal Joint Graph Convolutional Networks for Traffic Forecastingcited by 23
  12. 2023Calibration of Time-Series Forecasting: Detecting and Adapting Context-Driven Distribution Shiftcited by 23
  13. 2024Chain-of-History Reasoning for Temporal Knowledge Graph Forecastingcited by 17
  14. 2023MultiSPANS: A Multi-range Spatial-Temporal Transformer Network for Traffic Forecast via Structural Entropy Optimizationcited by 13
  15. 2024Tri-Level Navigator: LLM-Empowered Tri-Level Learning for Time Series OOD Generalizationcited by 12
  16. 2017Scalable Deep Traffic Flow Neural Networks for Urban Traffic Congestion Predictioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.