Physical invariance in neural networks for subgrid-scale scalar flux modeling
Not on the map. Why?
Abstract (arXiv)
In this paper we present a new strategy to model the subgrid-scale scalar flux in a three-dimensional turbulent incompressible flow using physics-informed neural networks (NNs). When trained from direct numerical simulation (DNS) data, state-of-the-art neural networks, such as convolutional neural networks, may not preserve well known physical priors, which may in turn question their application to real case-studies. To address this issue, we investigate hard and soft constraints into the model based on classical transformation invariances and symmetries derived from physical laws. From simulation-based experiments, we show that the proposed transformation-invariant NN model outperforms both purely data-driven ones as well as parametric state-of-the-art subgrid-scale models. The considered invariances are regarded as regularizers on physical metrics during the a priori evaluation and constrain the distribution tails of the predicted subgrid-scale term to be closer to the DNS. They also increase the stability and performance of the model when used as a surrogate during a large-eddy simulation. Moreover, the transformation-invariant NN is shown to generalize to regimes that have not been seen during the training phase.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 3; 2023: 5; 2024: 1.
13 papers.
Sort:
- 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 137
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2022Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flowcited by 20
- 2021Applying Machine Learning to Study Fluid Mechanicscited by 13
- 2022Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learningcited by 5
- 2023Gradient-free online learning of subgrid-scale dynamics with neural emulatorscited by 5
- 2023OceanBench: The Sea Surface Height Editioncited by 4
- 2023Extreme Event Prediction with Multi-agent Reinforcement Learning-based Parametrization of Atmospheric and Oceanic Turbulencecited by 2
- 2021A posteriori learning of quasi-geostrophic turbulence parametrization: an experiment on integration stepscited by 1
- 2021Frame invariance and scalability of neural operators for partial differential equationscited by 1
- 2023Differentiable Turbulence: Closure as a partial differential equation constrained optimizationcited by 1
- 2024On the importance of learning non-local dynamics for stable data-driven climate modeling: A 1D gravity wave-QBO testbed7 Jul 2024
- 2023Extreme Event Prediction with Multi-agent Reinforcement Learning-based Parametrization of Atmospheric and Oceanic Turbulence1 Dec 2023
- 2023Gradient-free online learning of subgrid-scale dynamics with neural emulators30 Oct 2023
- 2023OceanBench: The Sea Surface Height Edition27 Sep 2023
- 2023Differentiable Turbulence: Closure as a partial differential equation constrained optimization7 Jul 2023
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review18 Mar 2023
- 2022Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow7 Jun 2022
- 2022A posteriori learning for quasi-geostrophic turbulence parametrization8 Apr 2022
- 2022Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning11 Feb 2022
- 2021Frame invariance and scalability of neural operators for partial differential equations28 Dec 2021
- 2021A posteriori learning of quasi-geostrophic turbulence parametrization: an experiment on integration steps12 Nov 2021
- 2021Enhancing Computational Fluid Dynamics with Machine Learning5 Oct 2021
1 more
- 2021Applying Machine Learning to Study Fluid Mechanics5 Oct 2021
- 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 137
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2022Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flowcited by 20
- 2021Applying Machine Learning to Study Fluid Mechanicscited by 13
- 2022Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learningcited by 5
- 2023Gradient-free online learning of subgrid-scale dynamics with neural emulatorscited by 5
- 2023OceanBench: The Sea Surface Height Editioncited by 4
- 2023Extreme Event Prediction with Multi-agent Reinforcement Learning-based Parametrization of Atmospheric and Oceanic Turbulencecited by 2
- 2021A posteriori learning of quasi-geostrophic turbulence parametrization: an experiment on integration stepscited by 1
- 2021Frame invariance and scalability of neural operators for partial differential equationscited by 1
- 2023Differentiable Turbulence: Closure as a partial differential equation constrained optimizationcited by 1
12 most cited of 13 All 13 (JSON)
- 2024On the importance of learning non-local dynamics for stable data-driven climate modeling: A 1D gravity wave-QBO testbed7 Jul 2024
- 2023Extreme Event Prediction with Multi-agent Reinforcement Learning-based Parametrization of Atmospheric and Oceanic Turbulence1 Dec 2023
- 2023Gradient-free online learning of subgrid-scale dynamics with neural emulators30 Oct 2023
- 2023OceanBench: The Sea Surface Height Edition27 Sep 2023
- 2023Differentiable Turbulence: Closure as a partial differential equation constrained optimization7 Jul 2023
- 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review18 Mar 2023
- 2022Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow7 Jun 2022
- 2022A posteriori learning for quasi-geostrophic turbulence parametrization8 Apr 2022
- 2022Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning11 Feb 2022
- 2021Frame invariance and scalability of neural operators for partial differential equations28 Dec 2021
- 2021A posteriori learning of quasi-geostrophic turbulence parametrization: an experiment on integration steps12 Nov 2021
- 2021Enhancing Computational Fluid Dynamics with Machine Learning5 Oct 2021
12 newest of 13 All 13 (JSON)