mlsanityData to 7 Oct 2026

Combining distribution-based neural networks to predict weather forecast probabilities

arXiv 2103.14430 ↗First posted 26 Mar 2021stat.ML cs.LG physics.ao-phcited by 18

Not on the map. Why?

Abstract (arXiv)

The success of deep learning techniques over the last decades has opened up a new avenue of research for weather forecasting. Here, we take the novel approach of using a neural network to predict full probability density functions at each point in space and time rather than a single output value, thus producing a probabilistic weather forecast. This enables the calculation of both uncertainty and skill metrics for the neural network predictions, and overcomes the common difficulty of inferring uncertainty from these predictions. This approach is data-driven and the neural network is trained on the WeatherBench dataset (processed ERA5 data) to forecast geopotential and temperature 3 and 5 days ahead. Data exploration leads to the identification of the most important input variables, which are also found to agree with physical reasoning, thereby validating our approach. In order to increase computational efficiency further, each neural network is trained on a small subset of these variables. The outputs are then combined through a stacked neural network, the first time such a technique has been applied to weather data. Our approach is found to be more accurate than some numerical weather prediction models and as accurate as more complex alternative neural networks, with the added benefit of providing key probabilistic information necessary for making informed weather forecasts.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 11 of its 38 references that are in the map. First posted on arXiv 26 Mar 2021.

Builds on

11 of 38 references.

References · 11

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  5. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
  6. 2017Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equationscited by 203
  7. 2018Neural networks for post-processing ensemble weather forecastscited by 95
  8. 2020Improving data-driven global weather prediction using deep convolutional neural networks on a cubed spherecited by 95
  9. 2021Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction modelscited by 76
  10. 2020Deep Learning for Post-Processing Ensemble Weather Forecastscited by 52
  11. 2020A generative adversarial network approach to (ensemble) weather predictioncited by 18

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 6; 2023: 5; 2024: 5; 2025: 1.

18 papers.

Sort:

By area:

  1. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
  2. 2022Forecasting Global Weather with Graph Neural Networkscited by 165
  3. 2023Scaling transformer neural networks for skillful and reliable medium-range weather forecastingcited by 106
  4. 2021Probabilistic Forecasting with Generative Networks via Scoring Rule Minimizationcited by 35
  5. 2022SwinVRNN: A Data-Driven Ensemble Forecasting Model via Learned Distribution Perturbationcited by 31
  6. 2024Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modelingcited by 23
  7. 2022Explainable Artificial Intelligence for Bayesian Neural Networks: Towards trustworthy predictions of ocean dynamicscited by 11
  8. 2023Latent assimilation with implicit neural representations for unknown dynamicscited by 8
  9. 2024EWMoE: An effective model for global weather forecasting with mixture-of-expertscited by 8
  10. 2025AERIS: Argonne Earth Systems Model for Reliable and Skillful Predictionscited by 8
  11. 2022Aggregating distribution forecasts from deep ensemblescited by 5
  12. 2022Computing the ensemble spread from deterministic weather predictions using conditional generative adversarial networkscited by 5
6 more
  1. 2024Defining error accumulation in ML atmospheric simulatorscited by 5
  2. 2024Distilling Machine Learning's Added Value: Pareto Fronts in Atmospheric Applicationscited by 3
  3. 2024Decomposing weather forecasting into advection and convection with neural networkscited by 2
  4. 2022Bayesian neural networks for the probabilistic forecasting of wind direction and speed using ocean datacited by 1
  5. 2023Towards replacing precipitation ensemble predictions systems using machine learningcited by 1
  6. 2023Learning to simulate partially known spatio-temporal dynamics with trainable difference operatorscited by 1