Towards Scalable and Structured Spatiotemporal Forecasting
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel Spatial Balance Attention block for spatiotemporal forecasting. To strike a balance between obeying spatial proximity and capturing global correlation, we partition the spatial graph into a set of subgraphs and instantiate Intra-subgraph Attention to learn local spatial correlation within each subgraph; to capture the global spatial correlation, we further aggregate the nodes to produce subgraph representations and achieve message passing among the subgraphs via Inter-subgraph Attention. Building on the proposed Spatial Balance Attention block, we develop a multiscale spatiotemporal forecasting model by progressively increasing the subgraph scales. The resulting model is both scalable and able to produce structured spatial correlation, and meanwhile, it is easy to implement. We evaluate its efficacy and efficiency against the existing models on real-world spatiotemporal datasets from medium to large sizes. The experimental results show that it can achieve performance improvements up to 7.7% over the baseline methods at low running costs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 50 references that are in the map. First posted on arXiv 10 Sep 2025.
Builds on
36 of 50 references.
References · 36
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
24 more
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 566
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
- 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
- 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 434
- 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 401
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
- 2021Discrete Graph Structure Learning for Forecasting Multiple Time Seriescited by 171
- 2023Graph Inductive Biases in Transformers without Message Passingcited by 153
- 2023PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Predictioncited by 137
- 2022Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecastingcited by 123
- 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 118
- 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
- 2024SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusioncited by 76
- 2022Towards Spatio-Temporal Aware Traffic Time Series Forecasting--Full Versioncited by 59
- 2023CARD: Channel Aligned Robust Blend Transformer for Time Series Forecastingcited by 55
- 2022Scalable Spatiotemporal Graph Neural Networkscited by 52
- 2024RPMixer: Shaking Up Time Series Forecasting with Random Projections for Large Spatial-Temporal Datacited by 17
- 2019Graph-Partitioning-Based Diffusion Convolutional Recurrent Neural Network for Large-Scale Traffic Forecastingcited by 16
- 2024SAGDFN: A Scalable Adaptive Graph Diffusion Forecasting Network for Multivariate Time Series Forecastingcited by 8
- 2024ForecastGrapher: Redefining Multivariate Time Series Forecasting with Graph Neural Networkscited by 3
- 2023Hierarchical Joint Graph Learning and Multivariate Time Series Forecastingcited by 2
Built on by
Not cited yet.