RAST: A Retrieval Augmented Spatio-Temporal Framework for Traffic Prediction
Not on the map. Why?
Abstract (arXiv)
Traffic prediction is a cornerstone of modern intelligent transportation systems and a critical task in spatio-temporal forecasting. Although advanced Spatio-temporal Graph Neural Networks (STGNNs) and pre-trained models have achieved significant progress in traffic prediction, two key challenges remain: (i) limited contextual capacity when modeling complex spatio-temporal dependencies, and (ii) low predictability at fine-grained spatio-temporal points due to heterogeneous patterns. Inspired by Retrieval-Augmented Generation (RAG), we propose RAST, a universal framework that integrates retrieval-augmented mechanisms with spatio-temporal modeling to address these challenges. Our framework consists of three key designs: 1) Decoupled Encoder and Query Generator to capture decoupled spatial and temporal features and construct a fusion query via residual fusion; 2) Spatio-temporal Retrieval Store and Retrievers to maintain and retrieve vectorized fine-grained patterns; and 3) Universal Backbone Predictor that flexibly accommodates pre-trained STGNNs or simple MLP predictors. Extensive experiments on six real-world traffic networks, including large-scale datasets, demonstrate that RAST achieves superior performance while maintaining computational efficiency.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 44 of its 67 references that are in the map. First posted on arXiv 14 Aug 2025.
Builds on
44 of 67 references.
References · 44
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
32 more
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 566
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
- 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
- 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 458
- 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 434
- 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 333
- 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 213
- 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 210
- 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 172
- 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 151
- 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2022Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecastingcited by 123
- 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 118
- 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
- 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 87
- 2023UrbanCLIP: Learning Text-enhanced Urban Region Profiling with Contrastive Language-Image Pretraining from the Webcited by 78
- 2021DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Predictioncited by 73
- 2021Z-GCNETs: Time Zigzags at Graph Convolutional Networks for Time Series Forecastingcited by 67
- 2024Position: What Can Large Language Models Tell Us about Time Series Analysiscited by 47
- 2024RAGEval: Scenario Specific RAG Evaluation Dataset Generation Frameworkcited by 39
- 2024RPMixer: Shaking Up Time Series Forecasting with Random Projections for Large Spatial-Temporal Datacited by 17
- 2024ST-LoRA: Low-rank Adaptation for Spatio-Temporal Forecastingcited by 9
- 2025Multi-Order Wavelet Derivative Transform for Deep Time Series Forecastingcited by 4
- 2023Deep Learning for Spatiotemporal Big Data: A Vision on Opportunities and Challengescited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Prediction
- 2024Navigating Spatio-Temporal Heterogeneity: A Graph Transformer Approach for Traffic Forecasting
- 2025Efficient Traffic Prediction Through Spatio-Temporal Distillation
- 2026A Multi-Resolution Multi-Domain Pre-Training Framework for Universal Traffic Forecasting
- 2026PHGNet: Prototype-Guided Hypergraph Construction for Heterogeneous Spatiotemporal Forecasting
- 2026GAMMA-Net: Adaptive Long-Horizon Traffic Spatio-Temporal Forecasting Model based on Interleaved Graph Attention and Multi-Axis Mamba
- 2026Spatiotemporal Graph Transformer for Traffic Intelligence in Edge Computing
- 2024Robust Traffic Forecasting against Spatial Shift over Years