mlsanityData to 14 Oct 2026

Enhancing Traffic Prediction with Textual Data Using Large Language Models

arXiv 2405.06719 ↗First posted 10 May 2024cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Traffic prediction is pivotal for rational transportation supply scheduling and allocation. Existing researches into short-term traffic prediction, however, face challenges in adequately addressing exceptional circumstances and integrating non-numerical contextual information like weather into models. While, Large language models offer a promising solution due to their inherent world knowledge. However, directly using them for traffic prediction presents drawbacks such as high cost, lack of determinism, and limited mathematical capability. To mitigate these issues, this study proposes a novel approach. Instead of directly employing large models for prediction, it utilizes them to process textual information and obtain embeddings. These embeddings are then combined with historical traffic data and inputted into traditional spatiotemporal forecasting models. The study investigates two types of special scenarios: regional-level and node-level. For regional-level scenarios, textual information is represented as a node connected to the entire network. For node-level scenarios, embeddings from the large model represent additional nodes connected only to corresponding nodes. This approach shows a significant improvement in prediction accuracy according to our experiment of New York Bike dataset.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 35 of its 42 references that are in the map. First posted on arXiv 10 May 2024.

Builds on

35 of 42 references.

References · 35

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  3. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 566
  4. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
  5. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  6. 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 401
  7. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
  8. 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 226
  9. 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 180
  10. 2023Talk like a Graph: Encoding Graphs for Large Language Modelscited by 176
  11. 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 172
  12. 2019Graph Wavelet Neural Networkcited by 131
23 more
  1. 2024Large Language Models for Time Series: A Surveycited by 114
  2. 2023GraphText: Graph Reasoning in Text Spacecited by 111
  3. 2023Where Would I Go Next? Large Language Models as Human Mobility Predictorscited by 93
  4. 2023Talk2BEV: Language-enhanced Bird's-eye View Maps for Autonomous Drivingcited by 89
  5. 2024Spatial-Temporal Large Language Model for Traffic Predictioncited by 83
  6. 2024UrbanGPT: Spatio-Temporal Large Language Modelscited by 81
  7. 2023Temporal Data Meets LLM -- Explainable Financial Time Series Forecastingcited by 77
  8. 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Modelscited by 65
  9. 2024LSTPrompt: Large Language Models as Zero-Shot Time Series Forecasters by Long-Short-Term Promptingcited by 59
  10. 2023HiLM-D: Enhancing MLLMs with Multi-Scale High-Resolution Details for Autonomous Drivingcited by 50
  11. 2024Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilitiescited by 48
  12. 2023Open-TI: Open Traffic Intelligence with Augmented Language Modelcited by 38
  13. 2023Urban Generative Intelligence (UGI): A Foundational Platform for Agents in Embodied City Environmentcited by 37
  14. 2023DeWave: Discrete EEG Waves Encoding for Brain Dynamics to Text Translationcited by 36
  15. 2023Exploring Large Language Models for Human Mobility Prediction under Public Eventscited by 34
  16. 2023ETP: Learning Transferable ECG Representations via ECG-Text Pre-trainingcited by 29
  17. 2024Multi-Patch Prediction: Adapting LLMs for Time Series Representation Learningcited by 25
  18. 2023Leveraging Vision-Language Models for Granular Market Change Predictioncited by 22
  19. 2023Large Language Models in Analyzing Crash Narratives -- A Comparative Study of ChatGPT, BARD and GPT-4cited by 16
  20. 2023Large Language Models for Travel Behavior Predictioncited by 13
  21. 2023Evaluation of Large Language Models for Decision Making in Autonomous Drivingcited by 8
  22. 2024TransportationGames: Benchmarking Transportation Knowledge of (Multimodal) Large Language Modelscited by 8
  23. 2024Leveraging Social Media Data to Identify Factors Influencing Public Attitude Towards Accessibility, Socioeconomic Disparity and Public Transportationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Reviewcited by 8
  2. 2026Earth Science Foundation Models: From Perception to Reasoning and Discoverycited by 0