SFANet: Spatial-Frequency Attention Network for Weather Forecasting
Not on the map. Why?
Abstract (arXiv)
Weather forecasting plays a critical role in various sectors, driving decision-making and risk management. However, traditional methods often struggle to capture the complex dynamics of meteorological systems, particularly in the presence of high-resolution data. In this paper, we propose the Spatial-Frequency Attention Network (SFANet), a novel deep learning framework designed to address these challenges and enhance the accuracy of spatiotemporal weather prediction. Drawing inspiration from the limitations of existing methodologies, we present an innovative approach that seamlessly integrates advanced token mixing and attention mechanisms. By leveraging both pooling and spatial mixing strategies, SFANet optimizes the processing of high-dimensional spatiotemporal sequences, preserving inter-component relational information and modeling extensive long-range relationships. To further enhance feature integration, we introduce a novel spatial-frequency attention module, enabling the model to capture intricate cross-modal correlations. Our extensive experimental evaluation on two distinct datasets, the Storm EVent ImageRy (SEVIR) and the Institute for Climate and Application Research (ICAR) - El Ni~no Southern Oscillation (ENSO) dataset, demonstrates the remarkable performance of SFANet. Notably, SFANet achieves substantial advancements over state-of-the-art methods, showcasing its proficiency in forecasting precipitation patterns and predicting El Ni~no events.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 49 references that are in the map. First posted on arXiv 29 May 2024.
Builds on
34 of 49 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2020Rethinking Attention with Performerscited by 1,584
- 2019Generating Long Sequences with Sparse Transformerscited by 1,523
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2018Image Transformercited by 770
22 more
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
- 2021MetaFormer Is Actually What You Need for Visioncited by 523
- 2021Pay Attention to MLPscited by 367
- 2019Axial Attention in Multidimensional Transformerscited by 350
- 2021Random Feature Attentioncited by 350
- 2017A simple neural network module for relational reasoningcited by 345
- 2021FNet: Mixing Tokens with Fourier Transformscited by 343
- 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 338
- 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 261
- 2020Sparse Sinkhorn Attentioncited by 250
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
- 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
- 2022SimVP: Simpler yet Better Video Predictioncited by 181
- 2017Deep Learning for Precipitation Nowcasting: A Benchmark and A New Modelcited by 180
- 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 170
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
- 2021AS-MLP: An Axial Shifted MLP Architecture for Visioncited by 101
- 2023Implicit Stacked Autoregressive Model for Video Predictioncited by 14
- 2022Region-Conditioned Orthogonal 3D U-Net for Weather4Cast Competitioncited by 4
Built on by
Not cited yet.