mlsanityData to 14 Oct 2026

Prompt-Based Spatio-Temporal Graph Transfer Learning

arXiv 2405.12452 ↗First posted 21 May 2024cs.LG cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Spatio-temporal graph neural networks have proven efficacy in capturing complex dependencies for urban computing tasks such as forecasting and kriging. Yet, their performance is constrained by the reliance on extensive data for training on a specific task, thereby limiting their adaptability to new urban domains with varied task demands. Although transfer learning has been proposed to remedy this problem by leveraging knowledge across domains, the cross-task generalization still remains under-explored in spatio-temporal graph transfer learning due to the lack of a unified framework. To bridge the gap, we propose Spatio-Temporal Graph Prompting (STGP), a prompt-based framework capable of adapting to multi-diverse tasks in a data-scarce domain. Specifically, we first unify different tasks into a single template and introduce a task-agnostic network architecture that aligns with this template. This approach enables capturing dependencies shared across tasks. Furthermore, we employ learnable prompts to achieve domain and task transfer in a two-stage prompting pipeline, facilitating the prompts to effectively capture domain knowledge and task-specific properties. Our extensive experiments demonstrate that STGP outperforms state-of-the-art baselines in three tasks-forecasting, kriging, and extrapolation-achieving an improvement of up to 10.7%.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 21 May 2024.

Builds on

26 of 44 references.

References · 26

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  3. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  4. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
  5. 2018On First-Order Meta-Learning Algorithmscited by 1,018
  6. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
  7. 2022Transformers in Time Series: A Surveycited by 497
  8. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
  9. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
  10. 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 167
  11. 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 132
  12. 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
14 more
  1. 2021AdaRNN: Adaptive Learning and Forecasting of Time Seriescited by 121
  2. 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 118
  3. 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
  4. 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 110
  5. 2020Inductive Graph Neural Networks for Spatiotemporal Krigingcited by 91
  6. 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 87
  7. 2019Learning from Multiple Cities: A Meta-Learning Approach for Spatial-Temporal Predictioncited by 64
  8. 2022Spatio-Temporal Graph Few-Shot Learning with Cross-City Knowledge Transfercited by 43
  9. 2022Domain Adversarial Spatial-Temporal Network: A Transferable Framework for Short-term Traffic Forecasting across Citiescited by 38
  10. 2023Kriging Convolutional Networkscited by 31
  11. 2021Spatial Aggregation and Temporal Convolution Networks for Real-time Krigingcited by 27
  12. 2023INCREASE: Inductive Graph Representation Learning for Spatio-Temporal Krigingcited by 27
  13. 2023Cross-city Few-Shot Traffic Forecasting via Traffic Pattern Bankcited by 24
  14. 2021Decoupling Long- and Short-Term Patterns in Spatiotemporal Inferencecited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 6.

10 papers.