Learned Coarse Models for Efficient Turbulence Simulation
Not on the map. Why?
Abstract (arXiv)
Turbulence simulation with classical numerical solvers requires high-resolution grids to accurately resolve dynamics. Here we train learned simulators at low spatial and temporal resolutions to capture turbulent dynamics generated at high resolution. We show that our proposed model can simulate turbulent dynamics more accurately than classical numerical solvers at the comparably low resolutions across various scientifically relevant metrics. Our model is trained end-to-end from data and is capable of learning a range of challenging chaotic and turbulent dynamics at low resolution, including trajectories generated by the state-of-the-art Athena++ engine. We show that our simpler, general-purpose architecture outperforms various more specialized, turbulence-specific architectures from the learned turbulence simulation literature. In general, we see that learned simulators yield unstable trajectories; however, we show that tuning training noise and temporal downsampling solves this problem. We also find that while generalization beyond the training distribution is a challenge for learned models, training noise, added loss constraints, and dataset augmentation can help. Broadly, we conclude that our learned simulator outperforms traditional solvers run on coarser grids, and emphasize that simple design choices can offer stability and robust generalization.
Key facts. Cited by 91 papers in the map (data through 14 Oct 2026). Builds on 29 of its 61 references that are in the map. First posted on arXiv 31 Dec 2021.
Builds on
29 of 61 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2017Adversarial Discriminative Domain Adaptationcited by 1,311
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,133
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
- 2021Machine learning accelerated computational fluid dynamicscited by 471
17 more
- 2017Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equationscited by 373
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 349
- 2018Feature Denoising for Improving Adversarial Robustnesscited by 314
- 2018Graph networks as learnable physics engines for inference and controlcited by 244
- 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 220
- 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 205
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 204
- 2018Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flowscited by 150
- 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 145
- 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 138
- 2016Accelerating Eulerian Fluid Simulation With Convolutional Networkscited by 130
- 2018Deep Fluids: A Generative Network for Parameterized Fluid Simulationscited by 121
- 2017Fader Networks: Manipulating Images by Sliding Attributescited by 118
- 2018Latent-space Physics: Towards Learning the Temporal Evolution of Fluid Flowcited by 97
- 2019DPM: A deep learning PDE augmentation method (with application to large-eddy simulation)cited by 41
- 2020Using Machine Learning to Augment Coarse-Grid Computational Fluid Dynamics Simulationscited by 24
- 2017Liquid Splash Modeling with Neural Networkscited by 16
Built on by
Citing papers per year: 2022: 13; 2023: 23; 2024: 19; 2025: 16; 2026: 20.
91 papers.
Sort:
By area:
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 197
- 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstructioncited by 152
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 128
- 2022MultiScale MeshGraphNetscited by 98
- 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 98
- 2022Clifford Neural Layers for PDE Modelingcited by 92
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
- 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulationcited by 71
- 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 57
- 2024CViT: Continuous Vision Transformer for Operator Learningcited by 51
- 2022Learning to correct spectral methods for simulating turbulent flowscited by 49
38 more
- 2023From Zero to Turbulence: Generative Modeling for 3D Flow Simulationcited by 49
- 2022Learned Turbulence Modelling with Differentiable Fluid Solvers: Physics-based Loss-functions and Optimisation Horizonscited by 39
- 2024AROMA: Preserving Spatial Structure for Latent PDE Modeling with Local Neural Fieldscited by 39
- 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 38
- 2022Physical Design using Differentiable Learned Simulatorscited by 37
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2024DySLIM: Dynamics Stable Learning by Invariant Measure for Chaotic Systemscited by 30
- 2022MAgNet: Mesh Agnostic Neural PDE Solvercited by 28
- 2024Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operatorscited by 27
- 2024Differentiability in Unrolled Training of Neural Physics Simulators on Transient Dynamicscited by 27
- 2024Text2PDE: Latent Diffusion Models for Accessible Physics Simulationcited by 25
- 2025Learning Distributions of Complex Fluid Simulations with Diffusion Graph Networkscited by 25
- 2023A Neural PDE Solver with Temporal Stencil Modelingcited by 22
- 2025Erwin: A Tree-based Hierarchical Transformer for Large-scale Physical Systemscited by 22
- 2025Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaoscited by 21
- 2022Meta-PDE: Learning to Solve PDEs Quickly Without a Meshcited by 18
- 2023Learning Flexible Body Collision Dynamics with Hierarchical Contact Mesh Transformercited by 18
- 2024PhyMPGN: Physics-encoded Message Passing Graph Network for spatiotemporal PDE systemscited by 18
- 2023BubbleML: A Multi-Physics Dataset and Benchmarks for Machine Learningcited by 17
- 2024Adversarial Learning for Neural PDE Solvers with Sparse Datacited by 16
- 2025Force-Free Molecular Dynamics Through Autoregressive Equivariant Networkscited by 15
- 2023Evolve Smoothly, Fit Consistently: Learning Smooth Latent Dynamics For Advection-Dominated Systemscited by 14
- 2024SineNet: Learning Temporal Dynamics in Time-Dependent Partial Differential Equationscited by 14
- 2023Neural Ideal Large Eddy Simulation: Modeling Turbulence with Neural Stochastic Differential Equationscited by 13
- 2024P2C2Net: PDE-Preserved Coarse Correction Network for efficient prediction of spatiotemporal dynamicscited by 13
- 2023Multi-Scale Message Passing Neural PDE Solverscited by 12
- 2023Fluid Simulation on Neural Flow Mapscited by 12
- 2023Coupled Multiwavelet Neural Operator Learning for Coupled Partial Differential Equationscited by 11
- 2025Binned Spectral Power Loss for Improved Prediction of Chaotic Systemscited by 10
- 2024Predicting Change, Not States: An Alternate Framework for Neural PDE Surrogatescited by 8
- 2023Invariant preservation in machine learned PDE solvers via error correctioncited by 7
- 2023Equivariant Neural Simulators for Stochastic Spatiotemporal Dynamicscited by 6
- 2025Neural Emulator Superiority: When Machine Learning for PDEs Surpasses its Training Datacited by 6
- 2023Gradient-free online learning of subgrid-scale dynamics with neural emulatorscited by 5
- 2025Discovering Physics Laws of Dynamical Systems via Invariant Function Learningcited by 5
- 2025PeSANet: Physics-encoded Spectral Attention Network for Simulating PDE-Governed Complex Systemscited by 5
- 2025SlotPi: Physics-informed Object-centric Reasoning Modelscited by 5
- 2023Adaptive learning of effective dynamics: Adaptive real-time, online modeling for complex systemscited by 4
50 most cited of 91 All 91 (JSON)
- 2026F3NO: Frequency-Decomposed Finite-Time Flow-map Neural Operators with Cross-Scale Conditioning7 Oct 2026
- 2026Shaping the Wind: Nested Potentials for Kinematically Admissible Urban Wind Prediction4 Oct 2026
- 2026Scale-Split Neural Operator for Memory- and Data-Efficient 3D Turbulence Prediction30 Sep 2026
- 2026Staying on the Attractor: Supervising Neural Surrogates of 3D Turbulence Where They Leave It26 Sep 2026
- 2026One-Step Generative Surrogate Models via Block-Triangular Joint Drifting22 Sep 2026
- 2026A Variational Optimal Transport Operator on Incompressible Flow12 Sep 2026
- 2026Learning PDE Time-Stepping with Neural Cellular Automata31 Aug 2026
- 2026Eigenanalysis framework for autoregressive neural emulators of multi-scale chaotic dynamics17 Aug 2026
- 2026Fluid-DiT: Graph-Free Diffusion Transformers for Fluid Flow Simulations Learning7 Aug 2026
- 2026TIDE: A Physically Diverse 3D Turbulence Benchmark Dataset for Advancing Scientific Machine Learning4 Aug 2026
- 2026Physics-Preserving Latent Compression for Zero-Shot Resolution Transfer in 3D Turbulence19 Jun 2026
- 2026First-Order Trajectory Matching: Fast Ensemble Predictions of Chaotic, Turbulent, Stochastic Systems9 Jun 2026
38 more
- 2026Controlling Transient Amplification Improves Long-horizon Rollouts9 May 2026
- 2026Deep Wave Network for Modeling Multi-Scale Physical Dynamics5 May 2026
- 2026Acceleration of horizontal numerical advection for atmospheric modeling through surrogate modeling with temporal coarse-graining30 Apr 2026
- 2026One Scale at a Time: Scale-Autoregressive Modeling for Fluid Flow Distributions13 Apr 2026
- 2026Adaptive Diffusion Posterior Sampling for Data and Model Fusion of Complex Nonlinear Dynamical Systems13 Mar 2026
- 2026SGNO: Spectral Generator Neural Operators for Stable Long Horizon PDE Rollouts21 Feb 2026
- 2026The Observer Effect in World Models: Invasive Adaptation Corrupts Latent Physics12 Feb 2026
- 2026Towards Spatio-Temporal Extrapolation of Phase-Field Simulations with Convolution-Only Neural Networks8 Jan 2026
- 2025NORi: An ML-Augmented Ocean Boundary Layer Parameterization4 Dec 2025
- 2025Neural Emulator Superiority: When Machine Learning for PDEs Surpasses its Training Data27 Oct 2025
- 2025Accelerating Data Generation for Nonlinear temporal PDEs via homologous perturbation in solution space24 Oct 2025
- 2025Reduced-order modeling of Hamiltonian dynamics based on symplectic neural networks16 Aug 2025
- 2025SlotPi: Physics-informed Object-centric Reasoning Models12 Jun 2025
- 2025A Two-Phase Deep Learning Framework for Adaptive Time-Stepping in High-Speed Flow Modeling9 Jun 2025
- 2025Hierarchical-embedding autoencoder with a predictor (HEAP) as efficient architecture for learning long-term evolution of complex multi-scale physical systems24 May 2025
- 2025PeSANet: Physics-encoded Spectral Attention Network for Simulating PDE-Governed Complex Systems3 May 2025
- 2025Force-Free Molecular Dynamics Through Autoregressive Equivariant Networks31 Mar 2025
- 2025Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaos24 Mar 2025
- 2025Learning Distributions of Complex Fluid Simulations with Diffusion Graph Networks19 Mar 2025
- 2025Erwin: A Tree-based Hierarchical Transformer for Large-scale Physical Systems24 Feb 2025
- 2025Learning Effective Dynamics across Spatio-Temporal Scales of Complex Flows11 Feb 2025
- 2025Discovering Physics Laws of Dynamical Systems via Invariant Function Learning6 Feb 2025
- 2025Binned Spectral Power Loss for Improved Prediction of Chaotic Systems1 Feb 2025
- 2025MultiPDENet: PDE-embedded Learning with Multi-time-stepping for Accelerated Flow Simulation27 Jan 2025
- 2024Predicting Change, Not States: An Alternate Framework for Neural PDE Surrogates17 Dec 2024
- 2024P2C2Net: PDE-Preserved Coarse Correction Network for efficient prediction of spatiotemporal dynamics29 Oct 2024
- 2024Improved deep learning of chaotic dynamical systems with multistep penalty losses8 Oct 2024
- 2024PhyMPGN: Physics-encoded Message Passing Graph Network for spatiotemporal PDE systems2 Oct 2024
- 2024Text2PDE: Latent Diffusion Models for Accessible Physics Simulation2 Oct 2024
- 2024Rational-WENO: A lightweight, physically-consistent three-point weighted essentially non-oscillatory scheme13 Sep 2024
- 2024Adversarial Learning for Neural PDE Solvers with Sparse Data4 Sep 2024
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations9 Jul 2024
- 2024PAPM: A Physics-aware Proxy Model for Process Systems7 Jul 2024
- 2024Divide And Conquer: Learning Chaotic Dynamical Systems With Multistep Penalty Neural Ordinary Differential Equations30 Jun 2024
- 2024ConDiff: A Challenging Dataset for Neural Solvers of Partial Differential Equations7 Jun 2024
- 2024AROMA: Preserving Spatial Structure for Latent PDE Modeling with Local Neural Fields4 Jun 2024
- 2024Accelerating Simulation of Two-Phase Flows with Neural PDE Surrogates27 May 2024
- 2024CViT: Continuous Vision Transformer for Operator Learning22 May 2024
50 newest of 91 All 91 (JSON)
- 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstructioncited by 152
- 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulationcited by 71
- 2024Text2PDE: Latent Diffusion Models for Accessible Physics Simulationcited by 25
- 2025Learning Distributions of Complex Fluid Simulations with Diffusion Graph Networkscited by 25
- 2025Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaoscited by 21
- 2026One Scale at a Time: Scale-Autoregressive Modeling for Fluid Flow Distributionscited by 0
- 2026Fluid-DiT: Graph-Free Diffusion Transformers for Fluid Flow Simulations Learningcited by 0
- 2026Fluid-DiT: Graph-Free Diffusion Transformers for Fluid Flow Simulations Learning7 Aug 2026
- 2026One Scale at a Time: Scale-Autoregressive Modeling for Fluid Flow Distributions13 Apr 2026
- 2025Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaos24 Mar 2025
- 2025Learning Distributions of Complex Fluid Simulations with Diffusion Graph Networks19 Mar 2025
- 2024Text2PDE: Latent Diffusion Models for Accessible Physics Simulation2 Oct 2024
- 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulation4 Sep 2023
- 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstruction26 Nov 2022
- 2025SlotPi: Physics-informed Object-centric Reasoning Modelscited by 5
- 2025SlotPi: Physics-informed Object-centric Reasoning Models12 Jun 2025
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 197
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 128
- 2022MultiScale MeshGraphNetscited by 98
- 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 98
- 2022Clifford Neural Layers for PDE Modelingcited by 92
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
- 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 57
- 2024CViT: Continuous Vision Transformer for Operator Learningcited by 51
- 2022Learning to correct spectral methods for simulating turbulent flowscited by 49
- 2023From Zero to Turbulence: Generative Modeling for 3D Flow Simulationcited by 49
- 2022Learned Turbulence Modelling with Differentiable Fluid Solvers: Physics-based Loss-functions and Optimisation Horizonscited by 39
12 most cited of 82 All 82 (JSON)
- 2026F3NO: Frequency-Decomposed Finite-Time Flow-map Neural Operators with Cross-Scale Conditioning7 Oct 2026
- 2026Shaping the Wind: Nested Potentials for Kinematically Admissible Urban Wind Prediction4 Oct 2026
- 2026Scale-Split Neural Operator for Memory- and Data-Efficient 3D Turbulence Prediction30 Sep 2026
- 2026Staying on the Attractor: Supervising Neural Surrogates of 3D Turbulence Where They Leave It26 Sep 2026
- 2026One-Step Generative Surrogate Models via Block-Triangular Joint Drifting22 Sep 2026
- 2026A Variational Optimal Transport Operator on Incompressible Flow12 Sep 2026
- 2026Learning PDE Time-Stepping with Neural Cellular Automata31 Aug 2026
- 2026Eigenanalysis framework for autoregressive neural emulators of multi-scale chaotic dynamics17 Aug 2026
- 2026TIDE: A Physically Diverse 3D Turbulence Benchmark Dataset for Advancing Scientific Machine Learning4 Aug 2026
- 2026Physics-Preserving Latent Compression for Zero-Shot Resolution Transfer in 3D Turbulence19 Jun 2026
- 2026First-Order Trajectory Matching: Fast Ensemble Predictions of Chaotic, Turbulent, Stochastic Systems9 Jun 2026
- 2026Controlling Transient Amplification Improves Long-horizon Rollouts9 May 2026
12 newest of 82 All 82 (JSON)