Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction models
Not on the map. Why?
Abstract (arXiv)
We present an ensemble prediction system using a Deep Learning Weather Prediction (DLWP) model that recursively predicts key atmospheric variables with six-hour time resolution. This model uses convolutional neural networks (CNNs) on a cubed sphere grid to produce global forecasts. The approach is computationally efficient, requiring just three minutes on a single GPU to produce a 320-member set of six-week forecasts at 1.4deg resolution. Ensemble spread is primarily produced by randomizing the CNN training process to create a set of 32 DLWP models with slightly different learned weights. Although our DLWP model does not forecast precipitation, it does forecast total column water vapor, and it gives a reasonable 4.5-day deterministic forecast of Hurricane Irma. In addition to simulating mid-latitude weather systems, it spontaneously generates tropical cyclones in a one-year free-running simulation. Averaged globally and over a two-year test set, the ensemble mean RMSE retains skill relative to climatology beyond two-weeks, with anomaly correlation coefficients remaining above 0.6 through six days. Our primary application is to subseasonal-to-seasonal (S2S) forecasting at lead times from two to six weeks. Current forecast systems have low skill in predicting one- or 2-week-average weather patterns at S2S time scales. The continuous ranked probability score (CRPS) and the ranked probability skill score (RPSS) show that the DLWP ensemble is only modestly inferior in performance to the European Centre for Medium Range Weather Forecasts (ECMWF) S2S ensemble over land at lead times of 4 and 5-6 weeks. At shorter lead times, the ECMWF ensemble performs better than DLWP.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). Builds on 7 of its 35 references that are in the map. First posted on arXiv 9 Feb 2021.
Builds on
7 of 35 references.
References · 7
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020Improving data-driven global weather prediction using deep convolutional neural networks on a cubed spherecited by 95
- 2019Physically Interpretable Neural Networks for the Geosciences: Applications to Earth System Variabilitycited by 43
- 2018Improving Subseasonal Forecasting in the Western U.S. with Machine Learningcited by 15
- 2020Evaluation, Tuning and Interpretation of Neural Networks for Meteorological Applicationscited by 7
- 2020Ensemble methods for neural network-based weather forecastscited by 3
Built on by
Citing papers per year: 2021: 4; 2022: 12; 2023: 15; 2024: 24; 2025: 12; 2026: 9.
76 papers.
Sort:
By area:
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2023ClimaX: A foundation model for weather and climatecited by 325
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
- 2022Forecasting Global Weather with Graph Neural Networkscited by 165
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 164
- 2024Mamba-ND: Selective State Space Modeling for Multi-Dimensional Datacited by 84
- 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 78
- 2025FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scalecited by 56
- 2024ChaosBench: A Multi-Channel, Physics-Based Benchmark for Subseasonal-to-Seasonal Climate Predictioncited by 40
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
38 more
- 2023AtmoRep: A stochastic model of atmosphere dynamics using large scale representation learningcited by 35
- 2024On the Foundations of Earth and Climate Foundation Modelscited by 31
- 2024Prithvi WxC: Foundation Model for Weather and Climatecited by 28
- 2023Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Meshcited by 27
- 2024Continuous Ensemble Weather Forecasting with Diffusion modelscited by 27
- 2023ClimateSet: A Large-Scale Climate Model Dataset for Machine Learningcited by 25
- 2024A Practical Probabilistic Benchmark for AI Weather Modelscited by 25
- 2021SubseasonalClimateUSA: A Dataset for Subseasonal Forecasting and Benchmarkingcited by 21
- 2024Probabilistic Emulation of a Global Climate Model with Spherical DYffusioncited by 21
- 2024Coupled Ocean-Atmosphere Dynamics in a Machine Learning Earth System Modelcited by 20
- 2021Combining distribution-based neural networks to predict weather forecast probabilitiescited by 18
- 2022Adaptive Bias Correction for Improved Subseasonal Forecastingcited by 18
- 2024Huge Ensembles Part I: Design of Ensemble Weather Forecasts using Spherical Fourier Neural Operatorscited by 17
- 2022WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline modelscited by 16
- 2021Towards physically consistent data-driven weather forecasting: Integrating data assimilation with equivariance-preserving deep spatial transformerscited by 15
- 2024Validating Deep Learning Weather Forecast Models on Recent High-Impact Extreme Eventscited by 14
- 2022Global Extreme Heat Forecasting Using Neural Weather Modelscited by 13
- 2025CirT: Global Subseasonal-to-Seasonal Forecasting with Geometry-inspired Transformercited by 13
- 2023Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciar'ancited by 12
- 2024Huge Ensembles Part II: Properties of a Huge Ensemble of Hindcasts Generated with Spherical Fourier Neural Operatorscited by 12
- 2024Robustness of AI-based weather forecasts in a changing climatecited by 11
- 2023KoopmanLab: machine learning for solving complex physics equationscited by 9
- 2023DiffESM: Conditional Emulation of Earth System Models with Diffusion Modelscited by 9
- 2024KARINA: An Efficient Deep Learning Model for Global Weather Forecastcited by 9
- 2022Long-term stability and generalization of observationally-constrained stochastic data-driven models for geophysical turbulencecited by 8
- 2024EWMoE: An effective model for global weather forecasting with mixture-of-expertscited by 8
- 2024WeatherReal: A Benchmark Based on In-Situ Observations for Evaluating Weather Modelscited by 8
- 2024FengWu-W2S: A deep learning model for seamless weather-to-subseasonal forecast of global atmospherecited by 8
- 2025AERIS: Argonne Earth Systems Model for Reliable and Skillful Predictionscited by 8
- 2022Probabilistic forecasts of extreme heatwaves using convolutional neural networks in a regime of lack of datacited by 7
- 2025Generative emulation of chaotic dynamics with coherent priorcited by 7
- 2021Learning and Dynamical Models for Sub-seasonal Climate Forecasting: Comparison and Collaborationcited by 6
- 2022Computing the ensemble spread from deterministic weather predictions using conditional generative adversarial networkscited by 5
- 2024Mitigating Time Discretization Challenges with WeatherODE: A Sandwich Physics-Driven Neural ODE for Weather Forecastingcited by 5
- 2025CERA: A Framework for Improved Generalization of Machine Learning Models to Changed Climatescited by 4
- 2025MAUSAM: An Observations-focused assessment of Global AI Weather Prediction Models During the South Asian Monsooncited by 4
- 2023Inductive biases in deep learning models for weather predictioncited by 3
- 2023Temporal Subsampling Diminishes Small Spatial Scales in Recurrent Neural Network Emulators of Geophysical Turbulencecited by 3
50 most cited of 76 All 76 (JSON)
- 2026Neptune: An AI model for Global Ocean Subseasonal Prediction8 Sep 2026
- 2026Do AI Forecast Ensembles Sample the Correct Conditional Distribution?9 Aug 2026
- 2026Timestep-Conditioned Transformers for Global Weather Forecasting6 Aug 2026
- 2026Rescene: band-limited stochastic forcing turns a frozen neural weather operator into a climate emulator30 Jul 2026
- 2026Counterfactual Methods for Detecting Unfairness in Anti-Money Laundering Algorithms6 Jul 2026
- 2026ARCO-Mars: A Unified Cloud-Optimized Archive of Mars Atmosphere Reanalysis19 Jun 2026
- 2026Investigating Inductive Biases for Machine Learning Emulation of Sudden Stratospheric Warmings in Idealised Isca Simulations17 Jun 2026
- 2026Physics-Guided Dual Decoding and Spectral Supervision for Global 3D Hydrometeor Prediction7 Jun 2026
- 2026Probabilistic Transformers for Joint Modeling of Global Weather Dynamics and Decision-Centric Variables7 Jan 2026
- 2025Long-Range Distillation: Distilling 10,000 Years of Simulated Climate into Long Timestep AI Weather Models28 Dec 2025
- 2025Skillful Subseasonal-to-Seasonal Forecasting of Extreme Events with a Multi-Sphere Coupled Probabilistic Model14 Dec 2025
- 2025Real-Time Long Horizon Air Quality Forecasting via Group-Relative Policy Optimization27 Nov 2025
38 more
- 2025Interactive Atmospheric Composition Emulation for Next-Generation Earth System Models12 Oct 2025
- 2025AERIS: Argonne Earth Systems Model for Reliable and Skillful Predictions16 Sep 2025
- 2025MAUSAM: An Observations-focused assessment of Global AI Weather Prediction Models During the South Asian Monsoon2 Sep 2025
- 2025CERA: A Framework for Improved Generalization of Machine Learning Models to Changed Climates15 Aug 2025
- 2025FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scale16 Jul 2025
- 2025A machine learning model for skillful climate system prediction6 May 2025
- 2025Generative emulation of chaotic dynamics with coherent prior19 Apr 2025
- 2025Deep Learning Meets Teleconnections: Improving S2S Predictions for European Winter Weather10 Apr 2025
- 2025CirT: Global Subseasonal-to-Seasonal Forecasting with Geometry-inspired Transformer27 Feb 2025
- 2024Advancing Heatwave Forecasting via Distribution Informed-Graph Neural Networks (DI-GNNs): Integrating Extreme Value Theory with GNNs20 Nov 2024
- 2024FengWu-W2S: A deep learning model for seamless weather-to-subseasonal forecast of global atmosphere15 Nov 2024
- 2024Mitigating Time Discretization Challenges with WeatherODE: A Sandwich Physics-Driven Neural ODE for Weather Forecasting9 Oct 2024
- 2024Continuous Ensemble Weather Forecasting with Diffusion models7 Oct 2024
- 2024Robustness of AI-based weather forecasts in a changing climate27 Sep 2024
- 2024Prithvi WxC: Foundation Model for Weather and Climate20 Sep 2024
- 2024WeatherReal: A Benchmark Based on In-Situ Observations for Evaluating Weather Models14 Sep 2024
- 2024DUNE: A Machine Learning Deep UNet++ based Ensemble Approach to Monthly, Seasonal and Annual Climate Forecasting12 Aug 2024
- 2024Huge Ensembles Part I: Design of Ensemble Weather Forecasts using Spherical Fourier Neural Operators6 Aug 2024
- 2024Huge Ensembles Part II: Properties of a Huge Ensemble of Hindcasts Generated with Spherical Fourier Neural Operators2 Aug 2024
- 2024Ensemble data assimilation to diagnose AI-based weather prediction model: A case with ClimaX version 0.3.125 Jul 2024
- 2024VarteX: Enhancing Weather Forecast through Distributed Variable Representation28 Jun 2024
- 2024Probabilistic Emulation of a Global Climate Model with Spherical DYffusion21 Jun 2024
- 2024Coupled Ocean-Atmosphere Dynamics in a Machine Learning Earth System Model12 Jun 2024
- 2024Prediction Beyond the Medium Range with an Atmosphere-Ocean Model that Combines Physics-based Modeling and Machine Learning29 May 2024
- 2024EWMoE: An effective model for global weather forecasting with mixture-of-experts9 May 2024
- 2024On the Foundations of Earth and Climate Foundation Models7 May 2024
- 2024Validating Deep Learning Weather Forecast Models on Recent High-Impact Extreme Events26 Apr 2024
- 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEs15 Apr 2024
- 2024An ensemble of data-driven weather prediction models for operational sub-seasonal forecasting22 Mar 2024
- 2024KARINA: An Efficient Deep Learning Model for Global Weather Forecast13 Mar 2024
- 2024Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data8 Feb 2024
- 2024ChaosBench: A Multi-Channel, Physics-Based Benchmark for Subseasonal-to-Seasonal Climate Prediction1 Feb 2024
- 2024A Practical Probabilistic Benchmark for AI Weather Models27 Jan 2024
- 2023TPTNet: A Data-Driven Temperature Prediction Model Based on Turbulent Potential Temperature22 Dec 2023
- 2023Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciar'an5 Dec 2023
- 2023ClimateSet: A Large-Scale Climate Model Dataset for Machine Learning7 Nov 2023
- 2023Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Mesh11 Sep 2023
- 2023Efficient Epistemic Uncertainty Estimation in Regression Ensemble Models Using Pairwise-Distance Estimators25 Aug 2023
50 newest of 76 All 76 (JSON)
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2023ClimaX: A foundation model for weather and climatecited by 325
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
- 2022Forecasting Global Weather with Graph Neural Networkscited by 165
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 164
- 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 78
- 2025FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scalecited by 56
- 2024ChaosBench: A Multi-Channel, Physics-Based Benchmark for Subseasonal-to-Seasonal Climate Predictioncited by 40
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2023AtmoRep: A stochastic model of atmosphere dynamics using large scale representation learningcited by 35
12 most cited of 72 All 72 (JSON)
- 2026Neptune: An AI model for Global Ocean Subseasonal Prediction8 Sep 2026
- 2026Do AI Forecast Ensembles Sample the Correct Conditional Distribution?9 Aug 2026
- 2026Timestep-Conditioned Transformers for Global Weather Forecasting6 Aug 2026
- 2026Rescene: band-limited stochastic forcing turns a frozen neural weather operator into a climate emulator30 Jul 2026
- 2026Counterfactual Methods for Detecting Unfairness in Anti-Money Laundering Algorithms6 Jul 2026
- 2026ARCO-Mars: A Unified Cloud-Optimized Archive of Mars Atmosphere Reanalysis19 Jun 2026
- 2026Investigating Inductive Biases for Machine Learning Emulation of Sudden Stratospheric Warmings in Idealised Isca Simulations17 Jun 2026
- 2026Physics-Guided Dual Decoding and Spectral Supervision for Global 3D Hydrometeor Prediction7 Jun 2026
- 2026Probabilistic Transformers for Joint Modeling of Global Weather Dynamics and Decision-Centric Variables7 Jan 2026
- 2025Long-Range Distillation: Distilling 10,000 Years of Simulated Climate into Long Timestep AI Weather Models28 Dec 2025
- 2025Skillful Subseasonal-to-Seasonal Forecasting of Extreme Events with a Multi-Sphere Coupled Probabilistic Model14 Dec 2025
- 2025Real-Time Long Horizon Air Quality Forecasting via Group-Relative Policy Optimization27 Nov 2025
12 newest of 72 All 72 (JSON)