mlsanityData to 14 Oct 2026

RAST: A Retrieval Augmented Spatio-Temporal Framework for Traffic Prediction

arXiv 2508.16623 ↗First posted 14 Aug 2025cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Traffic prediction is a cornerstone of modern intelligent transportation systems and a critical task in spatio-temporal forecasting. Although advanced Spatio-temporal Graph Neural Networks (STGNNs) and pre-trained models have achieved significant progress in traffic prediction, two key challenges remain: (i) limited contextual capacity when modeling complex spatio-temporal dependencies, and (ii) low predictability at fine-grained spatio-temporal points due to heterogeneous patterns. Inspired by Retrieval-Augmented Generation (RAG), we propose RAST, a universal framework that integrates retrieval-augmented mechanisms with spatio-temporal modeling to address these challenges. Our framework consists of three key designs: 1) Decoupled Encoder and Query Generator to capture decoupled spatial and temporal features and construct a fusion query via residual fusion; 2) Spatio-temporal Retrieval Store and Retrievers to maintain and retrieve vectorized fine-grained patterns; and 3) Universal Backbone Predictor that flexibly accommodates pre-trained STGNNs or simple MLP predictors. Extensive experiments on six real-world traffic networks, including large-scale datasets, demonstrate that RAST achieves superior performance while maintaining computational efficiency.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 44 of its 67 references that are in the map. First posted on arXiv 14 Aug 2025.

Builds on

44 of 67 references.

References · 44

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  8. 2017Billion-scale similarity search with GPUscited by 2,497
  9. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  10. 2019Language Models as Knowledge Bases?cited by 1,936
  11. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  12. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
32 more
  1. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  2. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
  3. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
  4. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
  5. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
  6. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  7. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  8. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 566
  9. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
  10. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
  11. 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 458
  12. 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 434
  13. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 333
  14. 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 213
  15. 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 210
  16. 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 172
  17. 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 151
  18. 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
  19. 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
  20. 2022Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecastingcited by 123
  21. 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 118
  22. 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
  23. 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 87
  24. 2023UrbanCLIP: Learning Text-enhanced Urban Region Profiling with Contrastive Language-Image Pretraining from the Webcited by 78
  25. 2021DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Predictioncited by 73
  26. 2021Z-GCNETs: Time Zigzags at Graph Convolutional Networks for Time Series Forecastingcited by 67
  27. 2024Position: What Can Large Language Models Tell Us about Time Series Analysiscited by 47
  28. 2024RAGEval: Scenario Specific RAG Evaluation Dataset Generation Frameworkcited by 39
  29. 2024RPMixer: Shaking Up Time Series Forecasting with Random Projections for Large Spatial-Temporal Datacited by 17
  30. 2024ST-LoRA: Low-rank Adaptation for Spatio-Temporal Forecastingcited by 9
  31. 2025Multi-Order Wavelet Derivative Transform for Deep Time Series Forecastingcited by 4
  32. 2023Deep Learning for Spatiotemporal Big Data: A Vision on Opportunities and Challengescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Prediction
  2. 2024Navigating Spatio-Temporal Heterogeneity: A Graph Transformer Approach for Traffic Forecasting
  3. 2025Efficient Traffic Prediction Through Spatio-Temporal Distillation
  4. 2026A Multi-Resolution Multi-Domain Pre-Training Framework for Universal Traffic Forecasting
  5. 2026PHGNet: Prototype-Guided Hypergraph Construction for Heterogeneous Spatiotemporal Forecasting
  6. 2026GAMMA-Net: Adaptive Long-Horizon Traffic Spatio-Temporal Forecasting Model based on Interleaved Graph Attention and Multi-Axis Mamba
  7. 2026Spatiotemporal Graph Transformer for Traffic Intelligence in Edge Computing
  8. 2024Robust Traffic Forecasting against Spatial Shift over Years