mlsanityData to 7 Oct 2026

Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulation

arXiv 2309.01745 ↗First posted 4 Sep 2023cs.LG physics.flu-dyncited by 65

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Simulating turbulent flows is crucial for a wide range of applications, and machine learning-based solvers are gaining increasing relevance. However, achieving temporal stability when generalizing to longer rollout horizons remains a persistent challenge for learned PDE solvers. In this work, we analyze if fully data-driven fluid solvers that utilize an autoregressive rollout based on conditional diffusion models are a viable option to address this challenge. We investigate accuracy, posterior sampling, spectral behavior, and temporal stability, while requiring that methods generalize to flow parameters beyond the training regime. To quantitatively and qualitatively benchmark the performance of various flow prediction approaches, three challenging 2D scenarios including incompressible and transonic flows, as well as isotropic turbulence are employed. We find that even simple diffusion-based approaches can outperform multiple established flow prediction methods in terms of accuracy and temporal stability, while being on par with state-of-the-art stabilization techniques like unrolling at training time. Such traditional architectures are superior in terms of inference speed, however, the probabilistic nature of diffusion approaches allows for inferring multiple predictions that align with the statistics of the underlying physics. Overall, our benchmark contains three carefully chosen data sets that are suitable for probabilistic evaluation alongside various established flow prediction architectures.

Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 65 of its 91 references that are in the map. First posted on arXiv 4 Sep 2023.

Builds on

65 of 91 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug
  2. 2023DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecasting3 Jun
  3. 2023A Denoising Diffusion Model for Fluid Field Prediction27 Jan
  4. 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstruction26 Nov

Other references · 61

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  6. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  7. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  8. 2020Denoising Diffusion Implicit Modelscited by 9,655
  9. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  10. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  11. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  12. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
38 more
  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  3. 2022A ConvNet for the 2020scited by 3,545
  4. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  5. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  6. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  7. 2022Video Diffusion Modelscited by 2,280
  8. 2018Group Normalizationcited by 1,514
  9. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  10. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  11. 2022Denoising Diffusion Restoration Modelscited by 951
  12. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  13. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  14. 2021Score-based Generative Modeling in Latent Spacecited by 634
  15. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
  16. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
  17. 2021Machine learning accelerated computational fluid dynamicscited by 461
  18. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
  19. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
  20. 2022Message Passing Neural PDE Solverscited by 368
  21. 2018Efficient Attention: Attention with Linear Complexitiescited by 366
  22. 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 306
  23. 2022Flexible Diffusion Modeling of Long Videoscited by 294
  24. 2016Generating Images with Perceptual Similarity Metrics based on Deep Networkscited by 221
  25. 2016Unrolled Generative Adversarial Networkscited by 208
  26. 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
  27. 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 201
  28. 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 195
  29. 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
  30. 2018Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flowscited by 147
  31. 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 137
  32. 2022Diffusion Models for Video Prediction and Infillingcited by 134
  33. 2020Learning to Control PDEs with Differentiable Physicscited by 131
  34. 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
  35. 2018Deep Fluids: A Generative Network for Parameterized Fluid Simulationscited by 121
  36. 2020Transformers for Modeling Physical Systemscited by 105
  37. 2018Latent-space Physics: Towards Learning the Temporal Evolution of Fluid Flowcited by 97
  38. 2021Learned Coarse Models for Efficient Turbulence Simulationcited by 90

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 11; 2025: 25; 2026: 29.

65 papers.

Sort:

By area:

  1. 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
  2. 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modelingcited by 36
  3. 2025PDE-Transformer: Efficient and Versatile Transformers for Physics Simulationscited by 29
  4. 2024Wavelet Diffusion Neural Operatorcited by 28
  5. 2025Generative Latent Neural PDE Solver using Flow Matchingcited by 28
  6. 2024Continuous Ensemble Weather Forecasting with Diffusion modelscited by 27
  7. 2024Differentiability in Unrolled Training of Neural Physics Simulators on Transient Dynamicscited by 25
  8. 2024Probabilistic Emulation of a Global Climate Model with Spherical DYffusioncited by 21
  9. 2025Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaoscited by 21
  10. 2025DISCO: learning to DISCover an evolution Operator for multi-physics-agnostic predictioncited by 21
  11. 2025Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulationcited by 19
  12. 2024Zero-Shot Uncertainty Quantification using Diffusion Probabilistic Modelscited by 14
38 more
  1. 2024Elucidating the Design Choice of Probability Paths in Flow Matching for Forecastingcited by 12
  2. 2025Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex Dynamicscited by 12
  3. 2025Diffusion-Based Hierarchical Graph Neural Networks for Simulating Nonlinear Solid Mechanicscited by 10
  4. 2024Predicting Change, Not States: An Alternate Framework for Neural PDE Surrogatescited by 8
  5. 2025FLEX: A Backbone for Diffusion-Based Modeling of Spatio-temporal Physical Systemscited by 8
  6. 2025BARNN: A Bayesian Autoregressive and Recurrent Neural Networkcited by 5
  7. 2025Geometric and Physical Constraints Synergistically Enhance Neural PDE Surrogatescited by 5
  8. 2026Probabilistic Retrofitting of Learned Simulatorscited by 5
  9. 2025FD-Bench: A Modular and Fair Benchmark for Data-driven Fluid Simulationcited by 4
  10. 2025Predicting partially observable dynamical systems via diffusion models with a multiscale inference schemecited by 4
  11. 2025Lazy Diffusion: Mitigating spectral collapse in generative diffusion-based stable autoregressive emulation of turbulent flowscited by 4
  12. 2026Particle-Guided Diffusion Models for Partial Differential Equationscited by 4
  13. 2026Flow Learners for PDEs: Toward a Physics-to-Physics Paradigm for Scientific Computingcited by 4
  14. 2026FlowRefiner: Flow Matching-Based Iterative Refinement for 3D Turbulent Flow Simulationcited by 4
  15. 2025When do World Models Successfully Learn Dynamical Systems?cited by 3
  16. 2026Adaptive Diffusion Posterior Sampling for Data and Model Fusion of Complex Nonlinear Dynamical Systemscited by 3
  17. 2026Controlling Transient Amplification Improves Long-horizon Rolloutscited by 3
  18. 2025Autoregressive regularized score-based diffusion models for multi-scenarios fluid flow predictioncited by 2
  19. 2025Point-wise Diffusion Models for Physical Systems with Shape Variations: Application to Spatio-temporal and Large-scale systemcited by 2
  20. 2025Improved probabilistic regression using diffusion modelscited by 2
  21. 2025PAINT: Parallel-in-time Neural Twins for Dynamical System Reconstructioncited by 2
  22. 2025PRISMA: Improving the Accuracy-Latency Frontier of Diffusion-based PDE Solvers Using Physics-Informed Spectral Attentioncited by 2
  23. 2025Efficient Generative Transformer Operators For Million-Point PDEscited by 2
  24. 2026Divergence-Free Diffusion Models for Incompressible Fluid Flowscited by 2
  25. 2026Hierarchy of extreme-event predictability in turbulence revealed by machine learningcited by 2
  26. 2026PDEInvBench: A Comprehensive Dataset and Design Space Exploration of Neural Networks for PDE Inverse Problemscited by 2
  27. 2026StocBench: A Benchmark for Generative Modeling of Stochastic Dynamicscited by 2
  28. 2024MelissaDL x Breed: Towards Data-Efficient On-line Supervised Training of Multi-parametric Surrogates with Active Learningcited by 1
  29. 2024Comparison of Generative Learning Methods for Turbulence Surrogatescited by 1
  30. 2025PIRF: Physics-Informed Reward Fine-Tuning for Diffusion Modelscited by 1
  31. 2025Efficient probabilistic surrogate modeling techniques for partially-observed large-scale dynamical systemscited by 1
  32. 2026Towards Infinitely Long Neural Simulations: Self-Refining Neural Surrogate Models for Dynamical Systemscited by 1
  33. 2026Stochastic Lifting for Generating Trajectories of Stochastic Physical Systemscited by 1
  34. 2026First-Order Trajectory Matching: Fast Ensemble Predictions of Chaotic, Turbulent, Stochastic Systemscited by 1
  35. 2026TIDE: A Physically Diverse 3D Turbulence Benchmark Dataset for Advancing Scientific Machine Learningcited by 1
  36. 2025PLAID: A Unified Data Model for Machine Learning on Heterogeneous Physics Simulationscited by 0
  37. 2025Video Prediction of Dynamic Physical Simulations With Pixel-Space Spatiotemporal Transformerscited by 0
  38. 2025Learning Temporally Consistent Turbulence Between Sparse Snapshots via Diffusion Modelscited by 0

50 most cited of 65 All 65 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Rectified Flows for Fast Multiscale Fluid Flow Modeling
  2. 2023Bayesian Conditional Diffusion Models for Versatile Spatiotemporal Turbulence Generation
  3. 2026One Scale at a Time: Scale-Autoregressive Modeling for Fluid Flow Distributions
  4. 2024On conditional diffusion models for PDE simulations
  5. 2026Memory-Conditioned Flow-Matching for Stable Autoregressive PDE Rollouts
  6. 2025Physics-aware generative models for turbulent fluid flows through energy-consistent stochastic interpolants
  7. 2026DiffusionRollout: Uncertainty-Aware Rollout Planning in Long-Horizon PDE Solving
  8. 2025Guiding diffusion models to reconstruct flow fields from sparse data