It is all Connected: A New Graph Formulation for Spatio-Temporal Forecasting
Not on the map. Why?
Abstract (arXiv)
With an ever-increasing number of sensors in modern society, spatio-temporal time series forecasting has become a de facto tool to make informed decisions about the future. Most spatio-temporal forecasting models typically comprise distinct components that learn spatial and temporal dependencies. A common methodology employs some Graph Neural Network (GNN) to capture relations between spatial locations, while another network, such as a recurrent neural network (RNN), learns temporal correlations. By representing every recorded sample as its own node in a graph, rather than all measurements for a particular location as a single node, temporal and spatial information is encoded in a similar manner. In this setting, GNNs can now directly learn both temporal and spatial dependencies, jointly, while also alleviating the need for additional temporal networks. Furthermore, the framework does not require aligned measurements along the temporal dimension, meaning that it also naturally facilitates irregular time series, different sampling frequencies or missing data, without the need for data imputation. To evaluate the proposed methodology, we consider wind speed forecasting as a case study, where our proposed framework outperformed other spatio-temporal models using GNNs with either Transformer or LSTM networks as temporal update functions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 54 references that are in the map. First posted on arXiv 23 Mar 2023.
Builds on
31 of 54 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2017Graph Attention Networkscited by 8,854
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
19 more
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
- 2020Time Series Forecasting With Deep Learning: A Surveycited by 457
- 2021A Survey of Transformerscited by 399
- 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 298
- 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 260
- 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 179
- 2019Set Functions for Time Seriescited by 137
- 2020Handling Missing Data with Graph Representation Learningcited by 132
- 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 128
- 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
- 2021Graph-Guided Network for Irregularly Sampled Multivariate Time Seriescited by 110
- 2023Everything is Connected: Graph Neural Networkscited by 85
- 2017Deep Forecast: Deep Learning-based Spatio-Temporal Forecastingcited by 13
- 2022Wind energy forecasting with missing values within a fully conditional specification frameworkcited by 4
- 2022Persistence Initialization: A novel adaptation of the Transformer architecture for Time Series Forecastingcited by 3
Built on by
Not cited yet.