mlsanityData to 7 Oct 2026

SFANet: Spatial-Frequency Attention Network for Weather Forecasting

arXiv 2405.18849 ↗First posted 29 May 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Weather forecasting plays a critical role in various sectors, driving decision-making and risk management. However, traditional methods often struggle to capture the complex dynamics of meteorological systems, particularly in the presence of high-resolution data. In this paper, we propose the Spatial-Frequency Attention Network (SFANet), a novel deep learning framework designed to address these challenges and enhance the accuracy of spatiotemporal weather prediction. Drawing inspiration from the limitations of existing methodologies, we present an innovative approach that seamlessly integrates advanced token mixing and attention mechanisms. By leveraging both pooling and spatial mixing strategies, SFANet optimizes the processing of high-dimensional spatiotemporal sequences, preserving inter-component relational information and modeling extensive long-range relationships. To further enhance feature integration, we introduce a novel spatial-frequency attention module, enabling the model to capture intricate cross-modal correlations. Our extensive experimental evaluation on two distinct datasets, the Storm EVent ImageRy (SEVIR) and the Institute for Climate and Application Research (ICAR) - El Ni~no Southern Oscillation (ENSO) dataset, demonstrates the remarkable performance of SFANet. Notably, SFANet achieves substantial advancements over state-of-the-art methods, showcasing its proficiency in forecasting precipitation patterns and predicting El Ni~no events.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 49 references that are in the map. First posted on arXiv 29 May 2024.

Builds on

34 of 49 references.

References · 34

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2020Longformer: The Long-Document Transformercited by 3,362
  6. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  7. 2020Rethinking Attention with Performerscited by 1,584
  8. 2019Generating Long Sequences with Sparse Transformerscited by 1,523
  9. 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
  10. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  11. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  12. 2018Image Transformercited by 770
22 more
  1. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  2. 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 717
  3. 2021MetaFormer Is Actually What You Need for Visioncited by 523
  4. 2021Pay Attention to MLPscited by 367
  5. 2019Axial Attention in Multidimensional Transformerscited by 350
  6. 2021Random Feature Attentioncited by 350
  7. 2017A simple neural network module for relational reasoningcited by 345
  8. 2021FNet: Mixing Tokens with Fourier Transformscited by 343
  9. 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 338
  10. 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
  11. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 261
  12. 2020Sparse Sinkhorn Attentioncited by 250
  13. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
  14. 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
  15. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
  16. 2022SimVP: Simpler yet Better Video Predictioncited by 181
  17. 2017Deep Learning for Precipitation Nowcasting: A Benchmark and A New Modelcited by 180
  18. 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 170
  19. 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
  20. 2021AS-MLP: An Axial Shifted MLP Architecture for Visioncited by 101
  21. 2023Implicit Stacked Autoregressive Model for Video Predictioncited by 14
  22. 2022Region-Conditioned Orthogonal 3D U-Net for Weather4Cast Competitioncited by 4

Built on by

Not cited yet.