mlsanityData to 7 Oct 2026

EasyST: A Simple Framework for Spatio-Temporal Prediction

arXiv 2409.06748 ↗First posted 10 Sep 2024cs.LG cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Spatio-temporal prediction is a crucial research area in data-driven urban computing, with implications for transportation, public safety, and environmental monitoring. However, scalability and generalization challenges remain significant obstacles. Advanced models often rely on Graph Neural Networks to encode spatial and temporal correlations, but struggle with the increased complexity of large-scale datasets. The recursive GNN-based message passing schemes used in these models hinder their training and deployment in real-life urban sensing scenarios. Moreover, long-spanning large-scale spatio-temporal data introduce distribution shifts, necessitating improved generalization performance. To address these challenges, we propose a simple framework for spatio-temporal prediction - EasyST paradigm. It learns lightweight and robust Multi-Layer Perceptrons (MLPs) by effectively distilling knowledge from complex spatio-temporal GNNs. We ensure robust knowledge distillation by integrating the spatio-temporal information bottleneck with teacher-bounded regression loss, filtering out task-irrelevant noise and avoiding erroneous guidance. We further enhance the generalization ability of the student model by incorporating spatial and temporal prompts to provide downstream task contexts. Evaluation on three spatio-temporal datasets for urban computing tasks demonstrates that EasyST surpasses state-of-the-art approaches in terms of efficiency and accuracy. The implementation code is available at: https://github.com/HKUDS/EasyST.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 28 of its 42 references that are in the map. First posted on arXiv 10 Sep 2024.

Builds on

28 of 42 references.

References · 28

  1. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  2. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  3. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  4. 2016Deep Variational Information Bottleneckcited by 915
  5. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  6. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
  7. 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 433
  8. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
  9. 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 298
  10. 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 209
  11. 2018Deep Multi-View Spatial-Temporal Network for Taxi Demand Predictioncited by 162
  12. 2021Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillationcited by 151
16 more
  1. 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 149
  2. 2020Distilling Knowledge from Graph Convolutional Networkscited by 128
  3. 2018Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Predictioncited by 119
  4. 2022Spatio-Temporal Self-Supervised Learning for Traffic Flow Predictioncited by 77
  5. 2021Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Frameworkcited by 69
  6. 2021Graph-Free Knowledge Distillation for Graph Neural Networkscited by 46
  7. 2021On Representation Knowledge Distillation for Graph Neural Networkscited by 38
  8. 2020On Self-Distilling Graph Neural Networkcited by 35
  9. 2022Spatial-Temporal Sequential Hypergraph Network for Crime Prediction with Dynamic Multiplex Relation Learningcited by 32
  10. 2022T2-GNN: Graph Neural Networks for Graphs with Incomplete Features and Structure via Teacher-Student Distillationcited by 32
  11. 2021Historical Inertia: A Neglected but Powerful Baseline for Long Sequence Time-series Forecastingcited by 26
  12. 2023Automated Spatio-Temporal Graph Contrastive Learningcited by 24
  13. 2022Geometric Knowledge Distillation: Topology Compression for Graph Neural Networkscited by 22
  14. 2020SAIL: Self-Augmented Graph Contrastive Learningcited by 20
  15. 2022Compressing Deep Graph Neural Networks via Adversarial Knowledge Distillationcited by 18
  16. 2023Weather2K: A Multivariate Spatio-Temporal Benchmark Dataset for Meteorological Forecasting Based on Real-Time Observation Data from Ground Weather Stationscited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 3.

6 papers.