mlsanityData to 7 Oct 2026

KARINA: An Efficient Deep Learning Model for Global Weather Forecast

arXiv 2403.10555 ↗First posted 13 Mar 2024cs.LG cs.AI cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Deep learning-based, data-driven models are gaining prevalence in climate research, particularly for global weather prediction. However, training the global weather data at high resolution requires massive computational resources. Therefore, we present a new model named KARINA to overcome the substantial computational demands typical of this field. This model achieves forecasting accuracy comparable to higher-resolution counterparts with significantly less computational resources, requiring only 4 NVIDIA A100 GPUs and less than 12 hours of training. KARINA combines ConvNext, SENet, and Geocyclic Padding to enhance weather forecasting at a 2.5deg resolution, which could filter out high-frequency noise. Geocyclic Padding preserves pixels at the lateral boundary of the input image, thereby maintaining atmospheric flow continuity in the spherical Earth. SENet dynamically improves feature response, advancing atmospheric process modeling, particularly in the vertical column process as numerous channels. In this vein, KARINA sets new benchmarks in weather forecasting accuracy, surpassing existing models like the ECMWF S2S reforecasts at a lead time of up to 7 days. Remarkably, KARINA achieved competitive performance even when compared to the recently developed models (Pangu-Weather, GraphCast, ClimaX, and FourCastNet) trained with high-resolution data having 100 times larger pixels. Conclusively, KARINA significantly advances global weather forecasting by efficiently modeling Earth's atmosphere with improved accuracy and resource efficiency.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 13 Mar 2024.

Builds on

21 of 36 references.

References · 21

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2016Layer Normalizationcited by 5,579
  4. 2022A ConvNet for the 2020scited by 3,545
  5. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  6. 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
  7. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  8. 2023ClimaX: A foundation model for weather and climatecited by 325
  9. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
  10. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 261
  11. 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 237
  12. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
9 more
  1. 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 170
  2. 2020Improving data-driven global weather prediction using deep convolutional neural networks on a cubed spherecited by 95
  3. 2021Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction modelscited by 76
  4. 2023SwinRDM: Integrate SwinRNN with Diffusion Model towards High-Resolution and High-Quality Weather Forecastingcited by 32
  5. 2022SwinVRNN: A Data-Driven Ensemble Forecasting Model via Learned Distribution Perturbationcited by 31
  6. 2019Revisiting Fine-tuning for Few-shot Learningcited by 29
  7. 2023Masking Strategies for Background Bias Removal in Computer Vision Modelscited by 9
  8. 2021Regularization in ResNet with Stochastic Depthcited by 7
  9. 2024Advancing Data-driven Weather Forecasting: Time-Sliding Data Augmentation of ERA5cited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 3; 2026: 3.

9 papers.