STCFormer: Adaptive Spatio-Temporal Modeling with Dynamic Cluster Transformer for Station-based Weather Forecasting
Not on the map. Why?
Abstract (arXiv)
Station-based weather forecasting supports daily life and economic activity, yet accurate forecasts require modeling complex spatial dependencies among stations. Recent clustering-based selective modeling offers a promising alternative to dense inter-station interactions. However, a grouping shared across an observation window may obscure local changes in station relationships, while intra-cluster interactions alone may miss important global context. The theoretical advantages of selective interactions over dense connectivity also remain insufficiently understood. We therefore propose STCFormer, an adaptive spatio-temporal Transformer that dynamically groups stations according to their local evolution within each temporal patch. Its Cluster-Guided Attention Block combines fine-grained local attention within clusters and global attention over regional state summaries, allowing each station to access information beyond its own cluster. We further show that a derived Lipschitz upper bound for cluster-conditioned local attention is no larger than its fully connected counterpart, explaining a potential robustness benefit and motivating the design of InfoLoss. Experiments on three real-world weather datasets spanning eight temperature and wind forecasting tasks show that STCFormer achieves the lowest 24-hour mean squared error on all eight tasks and ranks first or second in 47 of 48 comparisons across metrics and forecasting horizons. Ablations and case studies further confirm the benefits of locally adaptive grouping and complementary local-global interactions. Our code can be obtained at https://github.com/hnu-vis/STCFormer.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 44 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
30 of 44 references.
References · 30
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
- 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
- 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
- 2019Tackling Climate Change with Machine Learningcited by 264
18 more
- 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 241
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
- 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
- 2022SimVP: Simpler yet Better Video Predictioncited by 181
- 2019Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecastingcited by 161
- 2023Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity Analysiscited by 113
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 104
- 2022Spatio-Temporal Meta-Graph Learning for Traffic Forecastingcited by 88
- 2021A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learningcited by 82
- 2025TimeFilter: Patch-Specific Spatial-Temporal Graph Filtration for Time Series Forecastingcited by 60
- 2023How Smooth Is Attention?cited by 44
- 2024From Similarity to Superiority: Channel Clustering for Time Series Forecastingcited by 37
- 2024xPatch: Dual-Stream Time Series Forecasting with Exponential Seasonal-Trend Decompositioncited by 35
- 2025Temporal Query Network for Efficient Multivariate Time Series Forecastingcited by 29
- 2024On the Integration of Spatial-Temporal Knowledge: A Lightweight Approach to Atmospheric Time Series Forecastingcited by 7
- 2024EasyST: A Simple Framework for Spatio-Temporal Predictioncited by 6
- 2025S2Transformer: Scalable Structured Transformers for Global Station Weather Forecastingcited by 2
Built on by
Not cited yet.