Deep learning to represent sub-grid processes in climate models
Not on the map. Why?
Abstract (arXiv)
The representation of nonlinear sub-grid processes, especially clouds, has been a major source of uncertainty in climate models for decades. Cloud-resolving models better represent many of these processes and can now be run globally but only for short-term simulations of at most a few years because of computational limitations. Here we demonstrate that deep learning can be used to capture many advantages of cloud-resolving modeling at a fraction of the computational cost. We train a deep neural network to represent all atmospheric sub-grid processes in a climate model by learning from a multi-scale model in which convection is treated explicitly. The trained neural network then replaces the traditional sub-grid parameterizations in a global general circulation model in which it freely interacts with the resolved dynamics and the surface-flux scheme. The prognostic multi-year simulations are stable and closely reproduce not only the mean climate of the cloud-resolving simulation but also key aspects of variability, including precipitation extremes and the equatorial wave spectrum. Furthermore, the neural network approximately conserves energy despite not being explicitly instructed to. Finally, we show that the neural network parameterization generalizes to new surface forcing patterns but struggles to cope with temperatures far outside its training manifold. Our results show the feasibility of using deep learning for climate model parameterization. In a broader context, we anticipate that data-driven Earth System Model development could play a key role in reducing climate prediction uncertainty in the coming decade.
Key facts. Cited by 156 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 30; 2022: 26; 2023: 25; 2024: 29; 2025: 28; 2026: 18.
156 papers.
Sort:
By area:
- 2023Neural General Circulation Models for Weather and Climatecited by 232
- 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2021Will Artificial Intelligence supersede Earth System and Climate Models?cited by 37
- 2021Mosaic Flows: A Transferable Deep Learning Framework for Solving PDEs on Unseen Domainscited by 37
- 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 37
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2022MAgNet: Mesh Agnostic Neural PDE Solvercited by 28
- 2024Prithvi WxC: Foundation Model for Weather and Climatecited by 28
- 2022Learning Green's functions associated with time-dependent partial differential equationscited by 25
- 2021Climate-Invariant Machine Learningcited by 24
- 2021ClimART: A Benchmark Dataset for Emulating Atmospheric Radiative Transfer in Weather and Climate Modelscited by 21
38 more
- 2022Differentiable Programming for Earth System Modelingcited by 21
- 2024Probabilistic Emulation of a Global Climate Model with Spherical DYffusioncited by 21
- 2021Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observationscited by 20
- 2022Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flowcited by 20
- 2023AI Foundation Models for Weather and Climate: Applications, Design, and Implementationcited by 19
- 2021Data-driven geophysical forecasting: Simple, low-cost, and accurate baselines with kernel methodscited by 15
- 2021Bridging observation, theory and numerical simulation of the ocean using Machine Learningcited by 15
- 2022Data-driven Control of Agent-based Models: an Equation/Variable-free Machine Learning Approachcited by 15
- 2024DiffESM: Conditional Emulation of Temperature and Precipitation in Earth System Models with 3D Diffusion Modelscited by 15
- 2025Numerical models outperform AI weather forecasts of record-breaking extremescited by 14
- 2021Generating Physically-Consistent Satellite Imagery for Climate Visualizationscited by 13
- 2021A comparison of combined data assimilation and machine learning methods for offline and online model error correctioncited by 13
- 2022Online model error correction with neural networks in the incremental 4D-Var frameworkcited by 13
- 2023Learning About Structural Errors in Models of Complex Dynamical Systemscited by 13
- 2024Knowledge-guided Machine Learning: Current Trends and Future Prospectscited by 13
- 2022Multiscale Neural Operator: Learning Fast and Grid-independent PDE Solverscited by 12
- 2021Controlled abstention neural networks for identifying skillful predictions for regression problemscited by 9
- 2022Physics-Informed Learning of Aerosol Microphysicscited by 9
- 2023DiffESM: Conditional Emulation of Earth System Models with Diffusion Modelscited by 9
- 2023Learning Closed-form Equations for Subgrid-scale Closures from High-fidelity Data: Promises and Challengescited by 9
- 2024A non-intrusive machine learning framework for debiasing long-time coarse resolution climate simulations and quantifying rare events statisticscited by 9
- 2021PCE-PINNs: Physics-Informed Neural Networks for Uncertainty Propagation in Ocean Modelingcited by 8
- 2021Output-weighted and relative entropy loss functions for deep learning precursors of extreme eventscited by 8
- 2022Simulating Liquids with Graph Networkscited by 8
- 2024A Gaussian Process Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equationscited by 8
- 2024NeurIPS 2024 ML4CFD Competition: Harnessing Machine Learning for Computational Fluid Dynamics in Airfoil Designcited by 8
- 2021Using Machine Learning at Scale in HPC Simulations with SmartSim: An Application to Ocean Climate Modelingcited by 7
- 2021Deep Bayesian Active Learning for Accelerating Stochastic Simulationcited by 7
- 2022A Primer on Topological Data Analysis to Support Image Analysis Tasks in Environmental Sciencecited by 7
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilationcited by 7
- 2025Generative emulation of chaotic dynamics with coherent priorcited by 7
- 2021Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test casecited by 6
- 2023A Mass-Conserving-Perceptron for Machine Learning-Based Modeling of Geoscientific Systemscited by 6
- 2024CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilationcited by 6
- 2024CaFA: Global Weather Forecasting with Factorized Attention on Spherecited by 6
- 2024Generating Physical Dynamics under Priorscited by 6
- 2025From Proxies to Fields: Spatiotemporal Reconstruction of Global Radiation from Sparse Sensor Sequencescited by 6
- 2025Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Networkcited by 6
50 most cited of 156 All 156 (JSON)
- 2026Online Reinforcement Learning in the Met Office Unified Model through Distributed Model-Agent Coupling2 Sep 2026
- 2026Physics-Knowledge-Guided Hybrid Neural Learning for Arctic Sea Ice Concentration Evolution and Short-Range Prediction22 Aug 2026
- 2026AI-Integrated Scientific Inquiry: A Practice-Centered Vision for Science Education23 Jul 2026
- 2026Explaining Weather Bulletins via ILP23 Jul 2026
- 2026Subgrid-Scale Parameterization in Burgers' Equation Using Structure-Preserving Neural Networks and Entropy Variables16 Jul 2026
- 2026Domain-Adaptive Climate Downscaling Under Temporal Distribution Shift6 Jul 2026
- 2026Uncertainty quantification via conformal prediction in data assimilation25 Jun 2026
- 2026Investigating Inductive Biases for Machine Learning Emulation of Sudden Stratospheric Warmings in Idealised Isca Simulations17 Jun 2026
- 2026Systematic LLM Translation of Legacy Scientific Code to Differentiable Frameworks: Application to a Land Surface Model4 Jun 2026
- 2026Decomposing Ensemble Spread in Lorenz '96 With Learned Stochastic Parameterizations21 May 2026
- 2026Assessing Emulator Design and Training for Modal Aerosol Microphysics Parameterizations in E3SMv223 Apr 2026
- 2026climt-paraformer: Stable Emulation of Convective Parameterization using a Temporal Memory-aware Transformer22 Apr 2026
38 more
- 2026Hybrid Quantum-Classical Spatiotemporal Forecasting for 3D Cloud Fields31 Mar 2026
- 2026How Can Machine Learning Emulators Best Support Climate Science?20 Mar 2026
- 2026LUMOS: Democratizing SciML Workflows with L0-Regularized Learning for Unified Feature and Parameter Adaptation26 Feb 2026
- 2026Physics-Consistent Diffusion for Efficient Fluid Super-Resolution via Multiscale Residual Correction25 Feb 2026
- 2026AviaSafe: A Physics-Informed Data-Driven Model for Aviation Safety-Critical Cloud Forecasts25 Feb 2026
- 2026Parametrization of subgrid scales in long-term simulations of the shallow-water equations using machine learning and convex limiting30 Jan 2026
- 2025A Diffusion-Based Framework for High-Resolution Precipitation Forecasting over CONUS9 Dec 2025
- 2025Conditional updates of neural network weights for increased out of training performance3 Dec 2025
- 2025Retrofitting Earth System Models with Cadence-Limited Neural Operator Updates2 Dec 2025
- 2025Crowdsourcing the Frontier: Advancing Hybrid Physics-ML Climate Simulation via a 50,000 Kaggle Competition26 Nov 2025
- 2025Bridging Idealized and Operational Models: An Explainable AI Framework for Earth System Emulators14 Oct 2025
- 2025Geo-Aware Models for Stream Temperature Prediction across Different Spatial Regions and Scales10 Oct 2025
- 2025Machine Learning Workflows in Climate Modeling: Design Patterns and Insights from Case Studies30 Sep 2025
- 2025Breaking the Statistical Similarity Trap in Extreme Convection Detection11 Sep 2025
- 2025Numerical models outperform AI weather forecasts of record-breaking extremes21 Aug 2025
- 2025GEN2: A Generative Prediction-Correction Framework for Long-time Emulations of Spatially-Resolved Climate Extremes21 Aug 2025
- 2025FedRAIN-Lite: Federated Reinforcement Algorithms for Improving Idealised Numerical Weather and Climate Models19 Aug 2025
- 2025CERA: A Framework for Improved Generalization of Machine Learning Models to Changed Climates15 Aug 2025
- 2025Resolution Revolution: A Physics-Guided Deep Learning Framework for Spatiotemporal Temperature Reconstruction14 Jul 2025
- 2025Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Network11 Jul 2025
- 2025Stochastic and Non-local Closure Modeling for Nonlinear Dynamical Systems via Latent Score-based Generative Models25 Jun 2025
- 2025Stabilizing PDE--ML coupled systems24 Jun 2025
- 2025Artificial Intelligence for Atmospheric Sciences: A Research Roadmap19 Jun 2025
- 2025NeurIPS 2024 ML4CFD Competition: Results and Retrospective Analysis10 Jun 2025
- 2025From Proxies to Fields: Spatiotemporal Reconstruction of Global Radiation from Sparse Sensor Sequences24 May 2025
- 2025Supporting renewable energy planning and operation with data-driven high-resolution ensemble weather forecast7 May 2025
- 2025Mj"olnir: A Deep Learning Parametrization Framework for Global Lightning Flash Density28 Apr 2025
- 2025Fourier analysis of the physics of transfer learning for data-driven subgrid-scale models of ocean turbulence21 Apr 2025
- 2025Generative emulation of chaotic dynamics with coherent prior19 Apr 2025
- 2025Analogical Learning for Cross-Scenario Generalization: Framework and Application to Intelligent Localization9 Apr 2025
- 2025Generating realistic global precipitation fields from modelled atmospheric circulation1 Apr 2025
- 2025FuXi-RTM: A Physics-Guided Prediction Framework with Radiative Transfer Modeling25 Mar 2025
- 2025Regional climate projections using a deep-learning-based model-ranking and downscaling framework: Application to European climate zones27 Feb 2025
- 2025CondensNet: Enabling stable long-term climate simulations via hybrid deep learning models with adaptive physical constraints18 Feb 2025
- 2024Modeling Continuous Spatial-temporal Dynamics of Turbulent Flow with Test-time Refinement27 Dec 2024
- 2024Paraformer: Parameterization of Sub-grid Scale Processes Using Transformers21 Dec 2024
- 2024Online Test of a Neural Network Deep Convection Parameterization in ARP-GEM129 Oct 2024
- 2024CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation26 Oct 2024
50 newest of 156 All 156 (JSON)
- 2024DiffESM: Conditional Emulation of Temperature and Precipitation in Earth System Models with 3D Diffusion Modelscited by 15
- 2023DiffESM: Conditional Emulation of Earth System Models with Diffusion Modelscited by 9
- 2025Stochastic and Non-local Closure Modeling for Nonlinear Dynamical Systems via Latent Score-based Generative Modelscited by 3
- 2026Physics-Consistent Diffusion for Efficient Fluid Super-Resolution via Multiscale Residual Correctioncited by 0
- 2026Physics-Consistent Diffusion for Efficient Fluid Super-Resolution via Multiscale Residual Correction25 Feb 2026
- 2025Stochastic and Non-local Closure Modeling for Nonlinear Dynamical Systems via Latent Score-based Generative Models25 Jun 2025
- 2024DiffESM: Conditional Emulation of Temperature and Precipitation in Earth System Models with 3D Diffusion Models17 Sep 2024
- 2023DiffESM: Conditional Emulation of Earth System Models with Diffusion Models23 Apr 2023
- 2023Neural General Circulation Models for Weather and Climatecited by 232
- 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2021Will Artificial Intelligence supersede Earth System and Climate Models?cited by 37
- 2021Mosaic Flows: A Transferable Deep Learning Framework for Solving PDEs on Unseen Domainscited by 37
- 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 37
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2022MAgNet: Mesh Agnostic Neural PDE Solvercited by 28
- 2024Prithvi WxC: Foundation Model for Weather and Climatecited by 28
- 2022Learning Green's functions associated with time-dependent partial differential equationscited by 25
- 2021Climate-Invariant Machine Learningcited by 24
- 2021ClimART: A Benchmark Dataset for Emulating Atmospheric Radiative Transfer in Weather and Climate Modelscited by 21
12 most cited of 152 All 152 (JSON)
- 2026Online Reinforcement Learning in the Met Office Unified Model through Distributed Model-Agent Coupling2 Sep 2026
- 2026Physics-Knowledge-Guided Hybrid Neural Learning for Arctic Sea Ice Concentration Evolution and Short-Range Prediction22 Aug 2026
- 2026AI-Integrated Scientific Inquiry: A Practice-Centered Vision for Science Education23 Jul 2026
- 2026Explaining Weather Bulletins via ILP23 Jul 2026
- 2026Subgrid-Scale Parameterization in Burgers' Equation Using Structure-Preserving Neural Networks and Entropy Variables16 Jul 2026
- 2026Domain-Adaptive Climate Downscaling Under Temporal Distribution Shift6 Jul 2026
- 2026Uncertainty quantification via conformal prediction in data assimilation25 Jun 2026
- 2026Investigating Inductive Biases for Machine Learning Emulation of Sudden Stratospheric Warmings in Idealised Isca Simulations17 Jun 2026
- 2026Systematic LLM Translation of Legacy Scientific Code to Differentiable Frameworks: Application to a Land Surface Model4 Jun 2026
- 2026Decomposing Ensemble Spread in Lorenz '96 With Learned Stochastic Parameterizations21 May 2026
- 2026Assessing Emulator Design and Training for Modal Aerosol Microphysics Parameterizations in E3SMv223 Apr 2026
- 2026climt-paraformer: Stable Emulation of Convective Parameterization using a Temporal Memory-aware Transformer22 Apr 2026
12 newest of 152 All 152 (JSON)