FlashST: A Simple and Universal Prompt-Tuning Framework for Traffic Prediction
Not on the map. Why?
Abstract (arXiv)
The objective of traffic prediction is to accurately forecast and analyze the dynamics of transportation patterns, considering both space and time. However, the presence of distribution shift poses a significant challenge in this field, as existing models struggle to generalize well when faced with test data that significantly differs from the training distribution. To tackle this issue, this paper introduces a simple and universal spatio-temporal prompt-tuning framework-FlashST, which adapts pre-trained models to the specific characteristics of diverse downstream datasets, improving generalization in diverse traffic prediction scenarios. Specifically, the FlashST framework employs a lightweight spatio-temporal prompt network for in-context learning, capturing spatio-temporal invariant knowledge and facilitating effective adaptation to diverse scenarios. Additionally, we incorporate a distribution mapping mechanism to align the data distributions of pre-training and downstream data, facilitating effective knowledge transfer in spatio-temporal forecasting. Empirical evaluations demonstrate the effectiveness of our FlashST across different spatio-temporal prediction tasks using diverse urban datasets. Code is available at https://github.com/HKUDS/FlashST.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 28 May 2024.
Builds on
36 of 45 references.
References · 36
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
- 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 433
24 more
- 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 399
- 2020Understanding the Behaviour of Contrastive Losscited by 397
- 2020Debiased Contrastive Learningcited by 354
- 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
- 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 212
- 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 209
- 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 179
- 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
- 2020Graph Information Bottleneckcited by 168
- 2018Deep Multi-View Spatial-Temporal Network for Taxi Demand Predictioncited by 162
- 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 149
- 2023PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Predictioncited by 135
- 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
- 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 116
- 2022Repository-Level Prompt Generation for Large Language Models of Codecited by 106
- 2024UrbanGPT: Spatio-Temporal Large Language Modelscited by 81
- 2022Visual Prompt Tuning for Generative Transfer Learningcited by 75
- 2022Towards Spatio-Temporal Aware Traffic Time Series Forecasting--Full Versioncited by 59
- 2020Coupled Layer-wise Graph Convolution for Transportation Demand Predictioncited by 54
- 2021Traffic Flow Forecasting with Spatial-Temporal Graph Diffusion Networkcited by 52
- 2022Spatio-Temporal Graph Few-Shot Learning with Cross-City Knowledge Transfercited by 43
- 2022Spatial-Temporal Hypergraph Self-Supervised Learning for Crime Predictioncited by 39
- 2023GPT-ST: Generative Pre-Training of Spatio-Temporal Graph Neural Networkscited by 14
- 2023Spatial-Temporal Graph Learning with Adversarial Contrastive Adaptationcited by 13
Built on by
Citing papers per year: 2024: 7; 2025: 6; 2026: 5.
18 papers.
Sort:
By area:
- 2024OpenCity: Open Spatio-Temporal Foundation Models for Traffic Predictioncited by 27
- 2024BIGCity: A Universal Spatiotemporal Model for Unified Trajectory and Traffic State Data Analysiscited by 16
- 2024MM-Path: Multi-modal, Multi-granularity Path Representation Learning -- Extended Versioncited by 14
- 2024Expand and Compress: Exploring Tuning Principles for Continual Spatio-Temporal Graph Forecastingcited by 10
- 2025Unraveling Spatio-Temporal Foundation Models via the Pipeline Lens: A Comprehensive Reviewcited by 10
- 2025Learning with Calibration: Exploring Test-Time Computing of Spatio-Temporal Forecastingcited by 9
- 2024Strada-LLM: Graph LLM for traffic predictioncited by 3
- 2025Urban Computing in the Era of Large Language Modelscited by 2
- 2025STM-Graph: A Python Framework for Spatio-Temporal Mapping and Graph Neural Network Predictionscited by 2
- 2026Enhancing Ride-Hailing Forecasting at DiDi with Multi-View Geospatial Representation Learning from the Webcited by 2
- 2024Distribution-aware Online Continual Learning for Urban Spatio-Temporal Forecastingcited by 1
- 2024HiMoE: Heterogeneity-Informed Mixture-of-Experts for Fair Spatial-Temporal Forecastingcited by 0
6 more
- 2025CONTINA: Confidence Interval for Traffic Demand Prediction with Coverage Guaranteecited by 0
- 2025FedTDP: A Privacy-Preserving and Unified Framework for Trajectory Data Preparation via Federated Learningcited by 0
- 2026Dimensional Balance Improves Large Scale Spatiotemporal Prediction Performancecited by 0
- 2026GeoGNN: Time Series Geo-Localization using Two-Tower Graph Neural Networkscited by 0
- 2026MP3: Multi-Period Pattern Pre-training for Spatio-Temporal Forecastingcited by 0
- 2026CIWI-CKT: Chaos-Informed Wave Interference Feature Fusion and Cross-City Knowledge Transfer for Traffic Flow Forecastingcited by 0
- 2026CIWI-CKT: Chaos-Informed Wave Interference Feature Fusion and Cross-City Knowledge Transfer for Traffic Flow Forecasting14 Jun 2026
- 2026MP3: Multi-Period Pattern Pre-training for Spatio-Temporal Forecasting11 Jun 2026
- 2026GeoGNN: Time Series Geo-Localization using Two-Tower Graph Neural Networks6 Jun 2026
- 2026Dimensional Balance Improves Large Scale Spatiotemporal Prediction Performance11 May 2026
- 2026Enhancing Ride-Hailing Forecasting at DiDi with Multi-View Geospatial Representation Learning from the Web11 Feb 2026
- 2025STM-Graph: A Python Framework for Spatio-Temporal Mapping and Graph Neural Network Predictions4 Sep 2025
- 2025Unraveling Spatio-Temporal Foundation Models via the Pipeline Lens: A Comprehensive Review2 Jun 2025
- 2025Learning with Calibration: Exploring Test-Time Computing of Spatio-Temporal Forecasting31 May 2025
- 2025FedTDP: A Privacy-Preserving and Unified Framework for Trajectory Data Preparation via Federated Learning8 May 2025
- 2025CONTINA: Confidence Interval for Traffic Demand Prediction with Coverage Guarantee17 Apr 2025
- 2025Urban Computing in the Era of Large Language Models2 Apr 2025
- 2024BIGCity: A Universal Spatiotemporal Model for Unified Trajectory and Traffic State Data Analysis1 Dec 2024
6 more
- 2024HiMoE: Heterogeneity-Informed Mixture-of-Experts for Fair Spatial-Temporal Forecasting30 Nov 2024
- 2024MM-Path: Multi-modal, Multi-granularity Path Representation Learning -- Extended Version27 Nov 2024
- 2024Distribution-aware Online Continual Learning for Urban Spatio-Temporal Forecasting24 Nov 2024
- 2024Strada-LLM: Graph LLM for traffic prediction28 Oct 2024
- 2024Expand and Compress: Exploring Tuning Principles for Continual Spatio-Temporal Graph Forecasting16 Oct 2024
- 2024OpenCity: Open Spatio-Temporal Foundation Models for Traffic Prediction16 Aug 2024
- 2024OpenCity: Open Spatio-Temporal Foundation Models for Traffic Predictioncited by 27
- 2024BIGCity: A Universal Spatiotemporal Model for Unified Trajectory and Traffic State Data Analysiscited by 16
- 2024MM-Path: Multi-modal, Multi-granularity Path Representation Learning -- Extended Versioncited by 14
- 2024Expand and Compress: Exploring Tuning Principles for Continual Spatio-Temporal Graph Forecastingcited by 10
- 2025Unraveling Spatio-Temporal Foundation Models via the Pipeline Lens: A Comprehensive Reviewcited by 10
- 2025Learning with Calibration: Exploring Test-Time Computing of Spatio-Temporal Forecastingcited by 9
- 2024Strada-LLM: Graph LLM for traffic predictioncited by 3
- 2025Urban Computing in the Era of Large Language Modelscited by 2
- 2025STM-Graph: A Python Framework for Spatio-Temporal Mapping and Graph Neural Network Predictionscited by 2
- 2026Enhancing Ride-Hailing Forecasting at DiDi with Multi-View Geospatial Representation Learning from the Webcited by 2
- 2024Distribution-aware Online Continual Learning for Urban Spatio-Temporal Forecastingcited by 1
- 2025CONTINA: Confidence Interval for Traffic Demand Prediction with Coverage Guaranteecited by 0
12 most cited of 17 All 17 (JSON)
- 2026CIWI-CKT: Chaos-Informed Wave Interference Feature Fusion and Cross-City Knowledge Transfer for Traffic Flow Forecasting14 Jun 2026
- 2026MP3: Multi-Period Pattern Pre-training for Spatio-Temporal Forecasting11 Jun 2026
- 2026GeoGNN: Time Series Geo-Localization using Two-Tower Graph Neural Networks6 Jun 2026
- 2026Dimensional Balance Improves Large Scale Spatiotemporal Prediction Performance11 May 2026
- 2026Enhancing Ride-Hailing Forecasting at DiDi with Multi-View Geospatial Representation Learning from the Web11 Feb 2026
- 2025STM-Graph: A Python Framework for Spatio-Temporal Mapping and Graph Neural Network Predictions4 Sep 2025
- 2025Unraveling Spatio-Temporal Foundation Models via the Pipeline Lens: A Comprehensive Review2 Jun 2025
- 2025Learning with Calibration: Exploring Test-Time Computing of Spatio-Temporal Forecasting31 May 2025
- 2025FedTDP: A Privacy-Preserving and Unified Framework for Trajectory Data Preparation via Federated Learning8 May 2025
- 2025CONTINA: Confidence Interval for Traffic Demand Prediction with Coverage Guarantee17 Apr 2025
- 2025Urban Computing in the Era of Large Language Models2 Apr 2025
- 2024BIGCity: A Universal Spatiotemporal Model for Unified Trajectory and Traffic State Data Analysis1 Dec 2024
12 newest of 17 All 17 (JSON)