mlsanityData to 7 Oct 2026

Decoupling Long- and Short-Term Patterns in Spatiotemporal Inference

arXiv 2109.09506 ↗First posted 16 Sep 2021cs.LG cs.AIcited by 15

Not on the map. Why?

Abstract (arXiv)

Sensors are the key to environmental monitoring, which impart benefits to smart cities in many aspects, such as providing real-time air quality information to assist human decision-making. However, it is impractical to deploy massive sensors due to the expensive costs, resulting in sparse data collection. Therefore, how to get fine-grained data measurement has long been a pressing issue. In this paper, we aim to infer values at non-sensor locations based on observations from available sensors (termed spatiotemporal inference), where capturing spatiotemporal relationships among the data plays a critical role. Our investigations reveal two significant insights that have not been explored by previous works. Firstly, data exhibits distinct patterns at both long- and short-term temporal scales, which should be analyzed separately. Secondly, short-term patterns contain more delicate relations including those across spatial and temporal dimensions simultaneously, while long-term patterns involve high-level temporal trends. Based on these observations, we propose to decouple the modeling of short-term and long-term patterns. Specifically, we introduce a joint spatiotemporal graph attention network to learn the relations across space and time for short-term patterns. Furthermore, we propose a graph recurrent network with a time skip strategy to alleviate the gradient vanishing problem and model the long-term dependencies. Experimental results on four public real-world datasets demonstrate that our method effectively captures both long- and short-term relations, achieving state-of-the-art performance against existing methods.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 27 of its 72 references that are in the map. First posted on arXiv 16 Sep 2021.

Builds on

27 of 72 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2017Inductive Representation Learning on Large Graphscited by 6,284
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  7. 2018How Powerful are Graph Neural Networks?cited by 4,355
  8. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  9. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
  10. 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
  11. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  12. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
15 more
  1. 2019GraphSAINT: Graph Sampling Based Inductive Learning Methodcited by 618
  2. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
  3. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
  4. 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 433
  5. 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 399
  6. 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 212
  7. 2021Discrete Graph Structure Learning for Forecasting Multiple Time Seriescited by 169
  8. 2021Dynamic Graph Convolutional Recurrent Network for Traffic Prediction: Benchmark and Solutioncited by 156
  9. 2020Inductive Graph Neural Networks for Spatiotemporal Krigingcited by 90
  10. 2020Multi-hop Attention Graph Neural Networkcited by 53
  11. 2019Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networkscited by 40
  12. 2020Joint Air Quality and Weather Prediction Based on Multi-Adversarial Spatiotemporal Networkscited by 39
  13. 2018Processing of missing data by neural networkscited by 36
  14. 2021Online Multi-Agent Forecasting with Interpretable Collaborative Graph Neural Networkcited by 20
  15. 2014Data Imputation through the Identification of Local Anomaliescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 4; 2025: 5; 2026: 3.

15 papers.

Sort: