# Generative Modeling of Turbulence

arXiv: https://arxiv.org/abs/2112.02548 · HTML: https://mlsanity.com/paper/2112.02548/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- Builds on 23 of its 79 references that are in the map.
- First posted on arXiv 5 Dec 2021.

## Builds on (most cited first, 23 of 23)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift](https://mlsanity.com/paper/1502.03167/) (2015)
- [A Style-Based Generator Architecture for Generative Adversarial Networks](https://mlsanity.com/paper/1812.04948/) (2018)
- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [Conditional Generative Adversarial Nets](https://mlsanity.com/paper/1411.1784/) (2014)
- [Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks](https://mlsanity.com/paper/1511.06434/) (2015)
- [ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks](https://mlsanity.com/paper/1809.00219/) (2018)
- [High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs](https://mlsanity.com/paper/1711.11585/) (2017)
- [An overview of gradient descent optimization algorithms](https://mlsanity.com/paper/1609.04747/) (2016)
- [Error bounds for approximations with deep ReLU networks](https://mlsanity.com/paper/1610.01145/) (2016)
- [A guide to convolution arithmetic for deep learning](https://mlsanity.com/paper/1603.07285/) (2016)
- [Understanding Gradient Clipping in Private SGD: A Geometric Perspective](https://mlsanity.com/paper/2006.15429/) (2020)
- [Activation Functions: Comparison of trends in Practice and Research for Deep Learning](https://mlsanity.com/paper/1811.03378/) (2018)
- [A Review on Deep Learning Techniques Applied to Semantic Segmentation](https://mlsanity.com/paper/1704.06857/) (2017)
- [The Real-World-Weight Cross-Entropy Loss Function: Modeling the Costs of Mislabeling](https://mlsanity.com/paper/2001.00570/) (2020)
- [tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid Flow](https://mlsanity.com/paper/1801.09710/) (2018)
- [Machine Learning-augmented Predictive Modeling of Turbulent Separated Flows over Airfoils](https://mlsanity.com/paper/1608.03990/) (2016)
- [Turbulence Enrichment using Physics-informed Generative Adversarial Networks](https://mlsanity.com/paper/2003.01907/) (2020)
- [An Equivalence of Fully Connected Layer and Convolutional Layer](https://mlsanity.com/paper/1712.01252/) (2017)
- [From Deep to Physics-Informed Learning of Turbulence: Diagnostics](https://mlsanity.com/paper/1810.07785/) (2018)
- [A Multi-Pass GAN for Fluid Flow Super-Resolution](https://mlsanity.com/paper/1906.01689/) (2019)
- [A Convenient Infinite Dimensional Framework for Generative Adversarial Learning](https://mlsanity.com/paper/2011.12087/) (2020)

## Built on by (most cited first, 26 of 26)

- [From Zero to Turbulence: Generative Modeling for 3D Flow Simulation](https://mlsanity.com/paper/2306.01776/) (2023)
- [Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problems](https://mlsanity.com/paper/2212.03130/) (2022)
- [A Denoising Diffusion Model for Fluid Field Prediction](https://mlsanity.com/paper/2301.11661/) (2023)
- [Bayesian Conditional Diffusion Models for Versatile Spatiotemporal Turbulence Generation](https://mlsanity.com/paper/2311.07896/) (2023)
- [Learning Distributions of Complex Fluid Simulations with Diffusion Graph Networks](https://mlsanity.com/paper/2504.02843/) (2025)
- [Gaussian Process Priors for Systems of Linear Partial Differential Equations with Constant Coefficients](https://mlsanity.com/paper/2212.14319/) (2022)
- [Constraining Gaussian Processes to Systems of Linear Ordinary Differential Equations](https://mlsanity.com/paper/2208.12515/) (2022)
- [Turbulence Scaling from Deep Learning Diffusion Generative Models](https://mlsanity.com/paper/2311.06112/) (2023)
- [D-Flow SGLD: Source-Space Posterior Sampling for Scientific Inverse Problems with Flow Matching](https://mlsanity.com/paper/2602.21469/) (2026)
- [Generalization capabilities of conditional GAN for turbulent flow under changes of geometry](https://mlsanity.com/paper/2302.09945/) (2023)
- [Machine Learning Visualization Tool for Exploring Parameterized Hydrodynamics](https://mlsanity.com/paper/2406.15509/) (2024)
- [Neural Network Complexity of Chaos and Turbulence](https://mlsanity.com/paper/2211.15382/) (2022)
- [When do World Models Successfully Learn Dynamical Systems?](https://mlsanity.com/paper/2507.04898/) (2025)
- [How well do generative models solve inverse problems? A benchmark study](https://mlsanity.com/paper/2601.23238/) (2026)
- [Neural network based generation of a 1-dimensional stochastic field with turbulent velocity statistics](https://mlsanity.com/paper/2211.11580/) (2022)
- [A multiscale and multicriteria Generative Adversarial Network to synthesize 1-dimensional turbulent fields](https://mlsanity.com/paper/2307.16580/) (2023)
- [The Universal Statistical Structure and Scaling Laws of Chaos and Turbulence](https://mlsanity.com/paper/2311.01358/) (2023)
- [Autoregressive regularized score-based diffusion models for multi-scenarios fluid flow prediction](https://mlsanity.com/paper/2505.24145/) (2025)
- [Comparison of Generative Learning Methods for Turbulence Surrogates](https://mlsanity.com/paper/2411.16417/) (2024)
- [Robustly Invertible Nonlinear Dynamics and the BiLipREN: Contracting Neural Models with Contracting Inverses](https://mlsanity.com/paper/2505.03069/) (2025)
- [Topology Guidance: Controlling the Outputs of Generative Models via Vector Field Topology](https://mlsanity.com/paper/2505.06804/) (2025)
- [Generative Inverse Design with Abstention via Diagonal Flow Matching](https://mlsanity.com/paper/2603.15925/) (2026)
- [Optimal-Transport-Guided Functional Flow Matching for Turbulent Field Generation in Hilbert Space](https://mlsanity.com/paper/2604.05700/) (2026)
- [One Scale at a Time: Scale-Autoregressive Modeling for Fluid Flow Distributions](https://mlsanity.com/paper/2604.11403/) (2026)
- [Inpainting physics: self-supervised learning for context-driven fluid simulation](https://mlsanity.com/paper/2605.08832/) (2026)
- [Spectrally Regularized Latent Flow Matching for Turbulence Generation](https://mlsanity.com/paper/2606.11691/) (2026)

## Abstract (arXiv)

We present a mathematically well founded approach for the synthetic modeling of turbulent flows using generative adversarial networks (GAN). Based on the analysis of chaotic, deterministic systems in terms of ergodicity, we outline a mathematical proof that GAN can actually learn to sample state snapshots form the invariant measure of the chaotic system. Based on this analysis, we study a hierarchy of chaotic systems starting with the Lorenz attractor and then carry on to the modeling of turbulent flows with GAN. As training data, we use fields of velocity fluctuations obtained from large eddy simulations (LES). Two architectures are investigated in detail: we use a deep, convolutional GAN (DCGAN) to synthesise the turbulent flow around a cylinder. We furthermore simulate the flow around a low pressure turbine stator using the pix2pixHD architecture for a conditional DCGAN being conditioned on the position of a rotating wake in front of the stator. The settings of adversarial training and the effects of using specific GAN architectures are explained. We thereby show that GAN are efficient in simulating turbulence in technically challenging flow problems on the basis of a moderate amount of training data. GAN training and inference times significantly fall short when compared with classical numerical methods, in particular LES, while still providing turbulent flows in high resolution. We furthermore analyse the statistical properties of the synthesized and LES flow fields, which agree excellently. We also show the ability of the conditional GAN to generalize over changes of geometry by generating turbulent flow fields for positions of the wake that are not included in the training data.
