Prompt-Based Spatio-Temporal Graph Transfer Learning
Not on the map. Why?
Abstract (arXiv)
Spatio-temporal graph neural networks have proven efficacy in capturing complex dependencies for urban computing tasks such as forecasting and kriging. Yet, their performance is constrained by the reliance on extensive data for training on a specific task, thereby limiting their adaptability to new urban domains with varied task demands. Although transfer learning has been proposed to remedy this problem by leveraging knowledge across domains, the cross-task generalization still remains under-explored in spatio-temporal graph transfer learning due to the lack of a unified framework. To bridge the gap, we propose Spatio-Temporal Graph Prompting (STGP), a prompt-based framework capable of adapting to multi-diverse tasks in a data-scarce domain. Specifically, we first unify different tasks into a single template and introduce a task-agnostic network architecture that aligns with this template. This approach enables capturing dependencies shared across tasks. Furthermore, we employ learnable prompts to achieve domain and task transfer in a two-stage prompting pipeline, facilitating the prompts to effectively capture domain knowledge and task-specific properties. Our extensive experiments demonstrate that STGP outperforms state-of-the-art baselines in three tasks-forecasting, kriging, and extrapolation-achieving an improvement of up to 10.7%.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 21 May 2024.
Builds on
26 of 44 references.
References · 26
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
- 2018On First-Order Meta-Learning Algorithmscited by 1,018
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
- 2022Transformers in Time Series: A Surveycited by 497
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
- 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 132
- 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
14 more
- 2021AdaRNN: Adaptive Learning and Forecasting of Time Seriescited by 121
- 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 118
- 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
- 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 110
- 2020Inductive Graph Neural Networks for Spatiotemporal Krigingcited by 91
- 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 87
- 2019Learning from Multiple Cities: A Meta-Learning Approach for Spatial-Temporal Predictioncited by 64
- 2022Spatio-Temporal Graph Few-Shot Learning with Cross-City Knowledge Transfercited by 43
- 2022Domain Adversarial Spatial-Temporal Network: A Transferable Framework for Short-term Traffic Forecasting across Citiescited by 38
- 2023Kriging Convolutional Networkscited by 31
- 2021Spatial Aggregation and Temporal Convolution Networks for Real-time Krigingcited by 27
- 2023INCREASE: Inductive Graph Representation Learning for Spatio-Temporal Krigingcited by 27
- 2023Cross-city Few-Shot Traffic Forecasting via Traffic Pattern Bankcited by 24
- 2021Decoupling Long- and Short-Term Patterns in Spatiotemporal Inferencecited by 15
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 6.
10 papers.
- 2024A Systematic Literature Review of Spatio-Temporal Graph Neural Network Models for Time Series Forecasting and Classificationcited by 9
- 2025Node-as-Agent: Graph Agentic Networkcited by 2
- 2025Generalising Traffic Forecasting to Regions without Traffic Observationscited by 1
- 2026PIMCST: Physics-Informed Multi-Phase Consensus and Spatio-Temporal Few-Shot Learning for Traffic Flow Forecastingcited by 1
- 2025FUSE-Traffic: Fusion of Unstructured and Structured Data for Event-aware Traffic Forecastingcited by 0
- 2026MoE Enhanced Federated Learning for Spatiotemporal Predictioncited by 0
- 2026CIWI-CKT: Chaos-Informed Wave Interference Feature Fusion and Cross-City Knowledge Transfer for Traffic Flow Forecastingcited by 0
- 2026Continuous Cross-Domain Traffic State Prediction via Memory-Augmented Graph Liquid Time-Constant Networkscited by 0
- 2026Learning to Transfer Across Modes: Towards Unified Urban Mobility Forecastingcited by 0
- 2026Just for FUNS: LLM-Guided Spatio-Temporal Graph Node Generation for Forecasting Unobserved Node Statescited by 0
- 2026Just for FUNS: LLM-Guided Spatio-Temporal Graph Node Generation for Forecasting Unobserved Node States24 Sep 2026
- 2026Learning to Transfer Across Modes: Towards Unified Urban Mobility Forecasting28 Aug 2026
- 2026Continuous Cross-Domain Traffic State Prediction via Memory-Augmented Graph Liquid Time-Constant Networks14 Jun 2026
- 2026CIWI-CKT: Chaos-Informed Wave Interference Feature Fusion and Cross-City Knowledge Transfer for Traffic Flow Forecasting14 Jun 2026
- 2026MoE Enhanced Federated Learning for Spatiotemporal Prediction9 Jun 2026
- 2026PIMCST: Physics-Informed Multi-Phase Consensus and Spatio-Temporal Few-Shot Learning for Traffic Flow Forecasting2 Feb 2026
- 2025FUSE-Traffic: Fusion of Unstructured and Structured Data for Event-aware Traffic Forecasting16 Oct 2025
- 2025Generalising Traffic Forecasting to Regions without Traffic Observations12 Aug 2025
- 2025Node-as-Agent: Graph Agentic Network1 Aug 2025
- 2024A Systematic Literature Review of Spatio-Temporal Graph Neural Network Models for Time Series Forecasting and Classification29 Oct 2024