mlsanityData to 7 Oct 2026

FlashST: A Simple and Universal Prompt-Tuning Framework for Traffic Prediction

arXiv 2405.17898 ↗First posted 28 May 2024cs.LG cs.AI cs.CYcited by 18

Not on the map. Why?

Abstract (arXiv)

The objective of traffic prediction is to accurately forecast and analyze the dynamics of transportation patterns, considering both space and time. However, the presence of distribution shift poses a significant challenge in this field, as existing models struggle to generalize well when faced with test data that significantly differs from the training distribution. To tackle this issue, this paper introduces a simple and universal spatio-temporal prompt-tuning framework-FlashST, which adapts pre-trained models to the specific characteristics of diverse downstream datasets, improving generalization in diverse traffic prediction scenarios. Specifically, the FlashST framework employs a lightweight spatio-temporal prompt network for in-context learning, capturing spatio-temporal invariant knowledge and facilitating effective adaptation to diverse scenarios. Additionally, we incorporate a distribution mapping mechanism to align the data distributions of pre-training and downstream data, facilitating effective knowledge transfer in spatio-temporal forecasting. Empirical evaluations demonstrate the effectiveness of our FlashST across different spatio-temporal prediction tasks using diverse urban datasets. Code is available at https://github.com/HKUDS/FlashST.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 28 May 2024.

Builds on

36 of 45 references.

References · 36

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  3. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  4. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
  5. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  6. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  7. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  8. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  9. 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
  10. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
  11. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
  12. 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 433
24 more
  1. 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 399
  2. 2020Understanding the Behaviour of Contrastive Losscited by 397
  3. 2020Debiased Contrastive Learningcited by 354
  4. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
  5. 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 212
  6. 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 209
  7. 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 179
  8. 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
  9. 2020Graph Information Bottleneckcited by 168
  10. 2018Deep Multi-View Spatial-Temporal Network for Taxi Demand Predictioncited by 162
  11. 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 149
  12. 2023PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Predictioncited by 135
  13. 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
  14. 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 116
  15. 2022Repository-Level Prompt Generation for Large Language Models of Codecited by 106
  16. 2024UrbanGPT: Spatio-Temporal Large Language Modelscited by 81
  17. 2022Visual Prompt Tuning for Generative Transfer Learningcited by 75
  18. 2022Towards Spatio-Temporal Aware Traffic Time Series Forecasting--Full Versioncited by 59
  19. 2020Coupled Layer-wise Graph Convolution for Transportation Demand Predictioncited by 54
  20. 2021Traffic Flow Forecasting with Spatial-Temporal Graph Diffusion Networkcited by 52
  21. 2022Spatio-Temporal Graph Few-Shot Learning with Cross-City Knowledge Transfercited by 43
  22. 2022Spatial-Temporal Hypergraph Self-Supervised Learning for Crime Predictioncited by 39
  23. 2023GPT-ST: Generative Pre-Training of Spatio-Temporal Graph Neural Networkscited by 14
  24. 2023Spatial-Temporal Graph Learning with Adversarial Contrastive Adaptationcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 6; 2026: 5.

18 papers.

Sort:

By area:

  1. 2024OpenCity: Open Spatio-Temporal Foundation Models for Traffic Predictioncited by 27
  2. 2024BIGCity: A Universal Spatiotemporal Model for Unified Trajectory and Traffic State Data Analysiscited by 16
  3. 2024MM-Path: Multi-modal, Multi-granularity Path Representation Learning -- Extended Versioncited by 14
  4. 2024Expand and Compress: Exploring Tuning Principles for Continual Spatio-Temporal Graph Forecastingcited by 10
  5. 2025Unraveling Spatio-Temporal Foundation Models via the Pipeline Lens: A Comprehensive Reviewcited by 10
  6. 2025Learning with Calibration: Exploring Test-Time Computing of Spatio-Temporal Forecastingcited by 9
  7. 2024Strada-LLM: Graph LLM for traffic predictioncited by 3
  8. 2025Urban Computing in the Era of Large Language Modelscited by 2
  9. 2025STM-Graph: A Python Framework for Spatio-Temporal Mapping and Graph Neural Network Predictionscited by 2
  10. 2026Enhancing Ride-Hailing Forecasting at DiDi with Multi-View Geospatial Representation Learning from the Webcited by 2
  11. 2024Distribution-aware Online Continual Learning for Urban Spatio-Temporal Forecastingcited by 1
  12. 2024HiMoE: Heterogeneity-Informed Mixture-of-Experts for Fair Spatial-Temporal Forecastingcited by 0
6 more
  1. 2025CONTINA: Confidence Interval for Traffic Demand Prediction with Coverage Guaranteecited by 0
  2. 2025FedTDP: A Privacy-Preserving and Unified Framework for Trajectory Data Preparation via Federated Learningcited by 0
  3. 2026Dimensional Balance Improves Large Scale Spatiotemporal Prediction Performancecited by 0
  4. 2026GeoGNN: Time Series Geo-Localization using Two-Tower Graph Neural Networkscited by 0
  5. 2026MP3: Multi-Period Pattern Pre-training for Spatio-Temporal Forecastingcited by 0
  6. 2026CIWI-CKT: Chaos-Informed Wave Interference Feature Fusion and Cross-City Knowledge Transfer for Traffic Flow Forecastingcited by 0