mlsanityData to 7 Oct 2026

Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction models

arXiv 2102.05107 ↗First posted 9 Feb 2021physics.ao-ph cs.LGcited by 76

Not on the map. Why?

Abstract (arXiv)

We present an ensemble prediction system using a Deep Learning Weather Prediction (DLWP) model that recursively predicts key atmospheric variables with six-hour time resolution. This model uses convolutional neural networks (CNNs) on a cubed sphere grid to produce global forecasts. The approach is computationally efficient, requiring just three minutes on a single GPU to produce a 320-member set of six-week forecasts at 1.4deg resolution. Ensemble spread is primarily produced by randomizing the CNN training process to create a set of 32 DLWP models with slightly different learned weights. Although our DLWP model does not forecast precipitation, it does forecast total column water vapor, and it gives a reasonable 4.5-day deterministic forecast of Hurricane Irma. In addition to simulating mid-latitude weather systems, it spontaneously generates tropical cyclones in a one-year free-running simulation. Averaged globally and over a two-year test set, the ensemble mean RMSE retains skill relative to climatology beyond two-weeks, with anomaly correlation coefficients remaining above 0.6 through six days. Our primary application is to subseasonal-to-seasonal (S2S) forecasting at lead times from two to six weeks. Current forecast systems have low skill in predicting one- or 2-week-average weather patterns at S2S time scales. The continuous ranked probability score (CRPS) and the ranked probability skill score (RPSS) show that the DLWP ensemble is only modestly inferior in performance to the European Centre for Medium Range Weather Forecasts (ECMWF) S2S ensemble over land at lead times of 4 and 5-6 weeks. At shorter lead times, the ECMWF ensemble performs better than DLWP.

Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). Builds on 7 of its 35 references that are in the map. First posted on arXiv 9 Feb 2021.

Builds on

7 of 35 references.

References · 7

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2020Improving data-driven global weather prediction using deep convolutional neural networks on a cubed spherecited by 95
  4. 2019Physically Interpretable Neural Networks for the Geosciences: Applications to Earth System Variabilitycited by 43
  5. 2018Improving Subseasonal Forecasting in the Western U.S. with Machine Learningcited by 15
  6. 2020Evaluation, Tuning and Interpretation of Neural Networks for Meteorological Applicationscited by 7
  7. 2020Ensemble methods for neural network-based weather forecastscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 12; 2023: 15; 2024: 24; 2025: 12; 2026: 9.

76 papers.

Sort:

By area:

  1. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  2. 2023ClimaX: A foundation model for weather and climatecited by 325
  3. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
  4. 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
  5. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  6. 2022Forecasting Global Weather with Graph Neural Networkscited by 165
  7. 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 164
  8. 2024Mamba-ND: Selective State Space Modeling for Multi-Dimensional Datacited by 84
  9. 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 78
  10. 2025FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scalecited by 56
  11. 2024ChaosBench: A Multi-Channel, Physics-Based Benchmark for Subseasonal-to-Seasonal Climate Predictioncited by 40
  12. 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
38 more
  1. 2023AtmoRep: A stochastic model of atmosphere dynamics using large scale representation learningcited by 35
  2. 2024On the Foundations of Earth and Climate Foundation Modelscited by 31
  3. 2024Prithvi WxC: Foundation Model for Weather and Climatecited by 28
  4. 2023Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Meshcited by 27
  5. 2024Continuous Ensemble Weather Forecasting with Diffusion modelscited by 27
  6. 2023ClimateSet: A Large-Scale Climate Model Dataset for Machine Learningcited by 25
  7. 2024A Practical Probabilistic Benchmark for AI Weather Modelscited by 25
  8. 2021SubseasonalClimateUSA: A Dataset for Subseasonal Forecasting and Benchmarkingcited by 21
  9. 2024Probabilistic Emulation of a Global Climate Model with Spherical DYffusioncited by 21
  10. 2024Coupled Ocean-Atmosphere Dynamics in a Machine Learning Earth System Modelcited by 20
  11. 2021Combining distribution-based neural networks to predict weather forecast probabilitiescited by 18
  12. 2022Adaptive Bias Correction for Improved Subseasonal Forecastingcited by 18
  13. 2024Huge Ensembles Part I: Design of Ensemble Weather Forecasts using Spherical Fourier Neural Operatorscited by 17
  14. 2022WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline modelscited by 16
  15. 2021Towards physically consistent data-driven weather forecasting: Integrating data assimilation with equivariance-preserving deep spatial transformerscited by 15
  16. 2024Validating Deep Learning Weather Forecast Models on Recent High-Impact Extreme Eventscited by 14
  17. 2022Global Extreme Heat Forecasting Using Neural Weather Modelscited by 13
  18. 2025CirT: Global Subseasonal-to-Seasonal Forecasting with Geometry-inspired Transformercited by 13
  19. 2023Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciar'ancited by 12
  20. 2024Huge Ensembles Part II: Properties of a Huge Ensemble of Hindcasts Generated with Spherical Fourier Neural Operatorscited by 12
  21. 2024Robustness of AI-based weather forecasts in a changing climatecited by 11
  22. 2023KoopmanLab: machine learning for solving complex physics equationscited by 9
  23. 2023DiffESM: Conditional Emulation of Earth System Models with Diffusion Modelscited by 9
  24. 2024KARINA: An Efficient Deep Learning Model for Global Weather Forecastcited by 9
  25. 2022Long-term stability and generalization of observationally-constrained stochastic data-driven models for geophysical turbulencecited by 8
  26. 2024EWMoE: An effective model for global weather forecasting with mixture-of-expertscited by 8
  27. 2024WeatherReal: A Benchmark Based on In-Situ Observations for Evaluating Weather Modelscited by 8
  28. 2024FengWu-W2S: A deep learning model for seamless weather-to-subseasonal forecast of global atmospherecited by 8
  29. 2025AERIS: Argonne Earth Systems Model for Reliable and Skillful Predictionscited by 8
  30. 2022Probabilistic forecasts of extreme heatwaves using convolutional neural networks in a regime of lack of datacited by 7
  31. 2025Generative emulation of chaotic dynamics with coherent priorcited by 7
  32. 2021Learning and Dynamical Models for Sub-seasonal Climate Forecasting: Comparison and Collaborationcited by 6
  33. 2022Computing the ensemble spread from deterministic weather predictions using conditional generative adversarial networkscited by 5
  34. 2024Mitigating Time Discretization Challenges with WeatherODE: A Sandwich Physics-Driven Neural ODE for Weather Forecastingcited by 5
  35. 2025CERA: A Framework for Improved Generalization of Machine Learning Models to Changed Climatescited by 4
  36. 2025MAUSAM: An Observations-focused assessment of Global AI Weather Prediction Models During the South Asian Monsooncited by 4
  37. 2023Inductive biases in deep learning models for weather predictioncited by 3
  38. 2023Temporal Subsampling Diminishes Small Spatial Scales in Recurrent Neural Network Emulators of Geophysical Turbulencecited by 3

50 most cited of 76 All 76 (JSON)