mlsanityData to 7 Oct 2026

Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Model

arXiv 1909.04711 ↗First posted 10 Sep 2019physics.ao-ph cs.LG nlin.CDcited by 45

Not on the map. Why?

Abstract (arXiv)

Stochastic parameterizations account for uncertainty in the representation of unresolved sub-grid processes by sampling from the distribution of possible sub-grid forcings. Some existing stochastic parameterizations utilize data-driven approaches to characterize uncertainty, but these approaches require significant structural assumptions that can limit their scalability. Machine learning models, including neural networks, are able to represent a wide range of distributions and build optimized mappings between a large number of inputs and sub-grid forcings. Recent research on machine learning parameterizations has focused only on deterministic parameterizations. In this study, we develop a stochastic parameterization using the generative adversarial network (GAN) machine learning framework. The GAN stochastic parameterization is trained and evaluated on output from the Lorenz '96 model, which is a common baseline model for evaluating both parameterization and data assimilation techniques. We evaluate different ways of characterizing the input noise for the model and perform model runs with the GAN parameterization at weather and climate timescales. Some of the GAN configurations perform better than a baseline bespoke parameterization at both timescales, and the networks closely reproduce the spatio-temporal correlations and regimes of the Lorenz '96 system. We also find that in general those models which produce skillful forecasts are also associated with the best climate simulations.

Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 10; 2022: 11; 2023: 7; 2024: 9; 2025: 4; 2026: 4.

45 papers.

Sort:

By area:

  1. 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
  2. 2021Will Artificial Intelligence supersede Earth System and Climate Models?cited by 37
  3. 2021Probabilistic Forecasting with Generative Networks via Scoring Rule Minimizationcited by 35
  4. 2022Physically Constrained Generative Adversarial Networks for Improving Precipitation Fields from Earth System Modelscited by 28
  5. 2021Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observationscited by 20
  6. 2024DiffESM: Conditional Emulation of Temperature and Precipitation in Earth System Models with 3D Diffusion Modelscited by 15
  7. 2021A comparison of combined data assimilation and machine learning methods for offline and online model error correctioncited by 13
  8. 2022Online model error correction with neural networks in the incremental 4D-Var frameworkcited by 13
  9. 2021The Need for Ethical, Responsible, and Trustworthy Artificial Intelligence for Environmental Sciencescited by 12
  10. 2023Broadband Ground Motion Synthesis via Generative Adversarial Neural Operators: Development and Validationcited by 12
  11. 2021Controlled abstention neural networks for identifying skillful predictions for regression problemscited by 9
  12. 2022On the modern deep learning approaches for precipitation downscalingcited by 9
33 more
  1. 2022A Causality-Based Learning Approach for Discovering the Underlying Dynamics of Complex Systems from Partial Observations with Stochastic Parameterizationcited by 8
  2. 2023Stochastic Latent Transformer: Efficient Modelling of Stochastically Forced Zonal Jetscited by 8
  3. 2023CEBoosting: Online Sparse Identification of Dynamical Systems with Regime Switching by Causation Entropy Boostingcited by 7
  4. 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilationcited by 7
  5. 2022A Machine Learning Tutorial for Operational Meteorology, Part I: Traditional Machine Learningcited by 6
  6. 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilationcited by 6
  7. 2021Deep Learning Based Cloud Cover Parameterization for ICONcited by 5
  8. 2022Using Probabilistic Machine Learning to Better Model Temporal Patterns in Parameterizations: a case study with the Lorenz 96 modelcited by 5
  9. 2022Embed and Emulate: Learning to estimate parameters of dynamical systems with uncertainty quantificationcited by 5
  10. 2024Defining error accumulation in ML atmospheric simulatorscited by 5
  11. 2021Combining data assimilation and machine learning to estimate parameters of a convective-scale modelcited by 4
  12. 2021Controlled abstention neural networks for identifying skillful predictions for classification problemscited by 3
  13. 2022History-Based, Bayesian, Closure for Stochastic Parameterization: Application to Lorenz '96cited by 3
  14. 2023Statistically Optimal Generative Modeling with Maximum Deviation from the Empirical Distributioncited by 3
  15. 2023Navigating the Noise: Bringing Clarity to ML Parameterization Design with O(100) Ensemblescited by 3
  16. 2025Stochastic and Non-local Closure Modeling for Nonlinear Dynamical Systems via Latent Score-based Generative Modelscited by 3
  17. 2025Controllable Probabilistic Forecasting with Stochastic Decomposition Layerscited by 3
  18. 2021Machine learning-based conditional mean filter: a generalization of the ensemble Kalman filter for nonlinear data assimilationcited by 2
  19. 2023Taylorformer: Probabilistic Modelling for Random Processes including Time Seriescited by 2
  20. 2022Semi-automatic tuning of coupled climate models with multiple intrinsic timescales: lessons learned from the Lorenz96 modelcited by 1
  21. 2022Statistical treatment of convolutional neural network super-resolution of inland surface wind for subgrid-scale variability quantificationcited by 1
  22. 2024Development of an offline and online hybrid model for the Integrated Forecasting Systemcited by 1
  23. 2024Towards Physically Consistent Deep Learning For Climate Model Parameterizationscited by 1
  24. 2025Regularization of ML models for Earth systems by using longer model timestepscited by 1
  25. 2026climt-paraformer: Stable Emulation of Convective Parameterization using a Temporal Memory-aware Transformercited by 1
  26. 2022Don't Waste Data: Transfer Learning to Leverage All Data for Machine-Learnt Climate Model Emulationcited by 0
  27. 2024Machine Learning for Stochastic Parametrisationcited by 0
  28. 2024Paraformer: Parameterization of Sub-grid Scale Processes Using Transformerscited by 0
  29. 2024Improving the Noise Estimation of Latent Neural Stochastic Differential Equationscited by 0
  30. 2025Trajectory learning for ensemble forecasts via the continuous ranked probability score: a Lorenz '96 case studycited by 0
  31. 2026Decomposing Ensemble Spread in Lorenz '96 With Learned Stochastic Parameterizationscited by 0
  32. 2026Do AI Forecast Ensembles Sample the Correct Conditional Distribution?cited by 0
  33. 2026Learning Prognostic Variables for AI Convective Parameterizations via Symbolic Distillationcited by 0