Learning Closed-form Equations for Subgrid-scale Closures from High-fidelity Data: Promises and Challenges
Not on the map. Why?
Abstract (arXiv)
There is growing interest in discovering interpretable, closed-form equations for subgrid-scale (SGS) closures/parameterizations of complex processes in Earth systems. Here, we apply a common equation-discovery technique with expansive libraries to learn closures from filtered direct numerical simulations of 2D turbulence and Rayleigh-B'enard convection (RBC). Across common filters (e.g., Gaussian, box), we robustly discover closures of the same form for momentum and heat fluxes. These closures depend on nonlinear combinations of gradients of filtered variables, with constants that are independent of the fluid/flow properties and only depend on filter type/size. We show that these closures are the nonlinear gradient model (NGM), which is derivable analytically using Taylor-series. Indeed, we suggest that with common (physics-free) equation-discovery algorithms, for many common systems/physics, discovered closures are consistent with the leading term of the Taylor-series (except when cutoff filters are used). Like previous studies, we find that large-eddy simulations with NGM closures are unstable, despite significant similarities between the true and NGM-predicted fluxes (correlations > 0.95). We identify two shortcomings as reasons for these instabilities: in 2D, NGM produces zero kinetic energy transfer between resolved and subgrid scales, lacking both diffusion and backscattering. In RBC, potential energy backscattering is poorly predicted. Moreover, we show that SGS fluxes diagnosed from data, presumed the ''truth'' for discovery, depend on filtering procedures and are not unique. Accordingly, to learn accurate, stable closures in future work, we propose several ideas around using physics-informed libraries, loss functions, and metrics. These findings are relevant to closure modeling of any multi-scale system.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 21 of its 182 references that are in the map. First posted on arXiv 8 Jun 2023.
Builds on
21 of 182 references.
References · 21
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2021Machine learning accelerated computational fluid dynamicscited by 461
- 2019Machine Learning for Fluid Mechanicscited by 380
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 360
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 335
- 2020Physics-informed learning of governing equations from scarce datacited by 167
- 2018Deep learning to represent sub-grid processes in climate modelscited by 156
- 2017Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High-Resolution Simulationscited by 51
- 2021Any equation is a forest: Symbolic genetic algorithm for discovering open-form partial differential equations (SGA-PDE)cited by 38
- 2021Discovery of Nonlinear Dynamical Systems using a Runge-Kutta Inspired Dictionary-based Sparse Regression Approachcited by 36
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2023Interpretable Machine Learning for Science with PySR and SymbolicRegression.jlcited by 36
9 more
- 2022Investigating the fidelity of explainable artificial intelligence methods for applications of convolutional neural networks in geosciencecited by 28
- 2022Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flowcited by 20
- 2020Climbing down Charney's ladder: Machine Learning and the post-Dennard era of computational climate sciencecited by 18
- 2020Data-driven super-parameterization using deep learning: Experimentation with multi-scale Lorenz 96 systems and transfer-learningcited by 17
- 2022Explainable Artificial Intelligence for Bayesian Neural Networks: Towards trustworthy predictions of ocean dynamicscited by 11
- 2022Direct data-driven forecast of local turbulent heat flux in Rayleigh-B'enard convectioncited by 10
- 2021Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test casecited by 6
- 2020A machine learning framework for LES closure termscited by 5
- 2020Ensemble Kalman Inversion for Sparse Learning of Dynamical Systems from Time-Averaged Datacited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 4; 2026: 1.
9 papers.
- 2025Hierarchical Implicit Neural Emulatorscited by 9
- 2023Online Calibration of Deep Learning Sub-Models for Hybrid Numerical Modeling Systemscited by 4
- 2024Scalable and Consistent Graph Neural Networks for Distributed Mesh-based Data-driven Modelingcited by 2
- 2025Guided Unconditional and Conditional Generative Models for Super-Resolution and Inference of Quasi-Geostrophic Turbulencecited by 2
- 2026Deep Learning of Solver-Aware Turbulence Closures from Nudged LES Dynamicscited by 2
- 2025Fourier analysis of the physics of transfer learning for data-driven subgrid-scale models of ocean turbulencecited by 1
- 2025An Analytical and AI-discovered Stable, Accurate, and Generalizable Subgrid-scale Closure for Geophysical Turbulencecited by 1
- 2024On the importance of learning non-local dynamics for stable data-driven climate modeling: A 1D gravity wave-QBO testbedcited by 0
- 2024Global Estimation of Subsurface Eddy Kinetic Energy of Mesoscale Eddies Using a Multiple-input Residual Neural Networkcited by 0
- 2026Deep Learning of Solver-Aware Turbulence Closures from Nudged LES Dynamics26 Apr 2026
- 2025An Analytical and AI-discovered Stable, Accurate, and Generalizable Subgrid-scale Closure for Geophysical Turbulence5 Sep 2025
- 2025Guided Unconditional and Conditional Generative Models for Super-Resolution and Inference of Quasi-Geostrophic Turbulence1 Jul 2025
- 2025Hierarchical Implicit Neural Emulators5 Jun 2025
- 2025Fourier analysis of the physics of transfer learning for data-driven subgrid-scale models of ocean turbulence21 Apr 2025
- 2024Global Estimation of Subsurface Eddy Kinetic Energy of Mesoscale Eddies Using a Multiple-input Residual Neural Network14 Dec 2024
- 2024Scalable and Consistent Graph Neural Networks for Distributed Mesh-based Data-driven Modeling2 Oct 2024
- 2024On the importance of learning non-local dynamics for stable data-driven climate modeling: A 1D gravity wave-QBO testbed7 Jul 2024
- 2023Online Calibration of Deep Learning Sub-Models for Hybrid Numerical Modeling Systems17 Nov 2023