Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulation
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Simulating turbulent flows is crucial for a wide range of applications, and machine learning-based solvers are gaining increasing relevance. However, achieving temporal stability when generalizing to longer rollout horizons remains a persistent challenge for learned PDE solvers. In this work, we analyze if fully data-driven fluid solvers that utilize an autoregressive rollout based on conditional diffusion models are a viable option to address this challenge. We investigate accuracy, posterior sampling, spectral behavior, and temporal stability, while requiring that methods generalize to flow parameters beyond the training regime. To quantitatively and qualitatively benchmark the performance of various flow prediction approaches, three challenging 2D scenarios including incompressible and transonic flows, as well as isotropic turbulence are employed. We find that even simple diffusion-based approaches can outperform multiple established flow prediction methods in terms of accuracy and temporal stability, while being on par with state-of-the-art stabilization techniques like unrolling at training time. Such traditional architectures are superior in terms of inference speed, however, the probabilistic nature of diffusion approaches allows for inferring multiple predictions that align with the statistics of the underlying physics. Overall, our benchmark contains three carefully chosen data sets that are suitable for probabilistic evaluation alongside various established flow prediction architectures.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 65 of its 91 references that are in the map. First posted on arXiv 4 Sep 2023.
Builds on
65 of 91 references.
Closest ancestors · 4
Same direction, newest first
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug
- 2023DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecasting3 Jun
- 2023A Denoising Diffusion Model for Fluid Field Prediction27 Jan
- 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstruction26 Nov
Other references · 61
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
38 more
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022A ConvNet for the 2020scited by 3,545
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2022Video Diffusion Modelscited by 2,280
- 2018Group Normalizationcited by 1,514
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2022Denoising Diffusion Restoration Modelscited by 951
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2021Score-based Generative Modeling in Latent Spacecited by 634
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
- 2021Machine learning accelerated computational fluid dynamicscited by 461
- 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
- 2022Message Passing Neural PDE Solverscited by 368
- 2018Efficient Attention: Attention with Linear Complexitiescited by 366
- 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 306
- 2022Flexible Diffusion Modeling of Long Videoscited by 294
- 2016Generating Images with Perceptual Similarity Metrics based on Deep Networkscited by 221
- 2016Unrolled Generative Adversarial Networkscited by 208
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 203
- 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 201
- 2021Conditional Image Generation with Score-Based Diffusion Modelscited by 195
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2018Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flowscited by 147
- 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 137
- 2022Diffusion Models for Video Prediction and Infillingcited by 134
- 2020Learning to Control PDEs with Differentiable Physicscited by 131
- 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
- 2018Deep Fluids: A Generative Network for Parameterized Fluid Simulationscited by 121
- 2020Transformers for Modeling Physical Systemscited by 105
- 2018Latent-space Physics: Towards Learning the Temporal Evolution of Fluid Flowcited by 97
- 2021Learned Coarse Models for Efficient Turbulence Simulationcited by 90
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2024: 11; 2025: 25; 2026: 29.
65 papers.
Sort:
By area:
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
- 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modelingcited by 36
- 2025PDE-Transformer: Efficient and Versatile Transformers for Physics Simulationscited by 29
- 2024Wavelet Diffusion Neural Operatorcited by 28
- 2025Generative Latent Neural PDE Solver using Flow Matchingcited by 28
- 2024Continuous Ensemble Weather Forecasting with Diffusion modelscited by 27
- 2024Differentiability in Unrolled Training of Neural Physics Simulators on Transient Dynamicscited by 25
- 2024Probabilistic Emulation of a Global Climate Model with Spherical DYffusioncited by 21
- 2025Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaoscited by 21
- 2025DISCO: learning to DISCover an evolution Operator for multi-physics-agnostic predictioncited by 21
- 2025Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulationcited by 19
- 2024Zero-Shot Uncertainty Quantification using Diffusion Probabilistic Modelscited by 14
38 more
- 2024Elucidating the Design Choice of Probability Paths in Flow Matching for Forecastingcited by 12
- 2025Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex Dynamicscited by 12
- 2025Diffusion-Based Hierarchical Graph Neural Networks for Simulating Nonlinear Solid Mechanicscited by 10
- 2024Predicting Change, Not States: An Alternate Framework for Neural PDE Surrogatescited by 8
- 2025FLEX: A Backbone for Diffusion-Based Modeling of Spatio-temporal Physical Systemscited by 8
- 2025BARNN: A Bayesian Autoregressive and Recurrent Neural Networkcited by 5
- 2025Geometric and Physical Constraints Synergistically Enhance Neural PDE Surrogatescited by 5
- 2026Probabilistic Retrofitting of Learned Simulatorscited by 5
- 2025FD-Bench: A Modular and Fair Benchmark for Data-driven Fluid Simulationcited by 4
- 2025Predicting partially observable dynamical systems via diffusion models with a multiscale inference schemecited by 4
- 2025Lazy Diffusion: Mitigating spectral collapse in generative diffusion-based stable autoregressive emulation of turbulent flowscited by 4
- 2026Particle-Guided Diffusion Models for Partial Differential Equationscited by 4
- 2026Flow Learners for PDEs: Toward a Physics-to-Physics Paradigm for Scientific Computingcited by 4
- 2026FlowRefiner: Flow Matching-Based Iterative Refinement for 3D Turbulent Flow Simulationcited by 4
- 2025When do World Models Successfully Learn Dynamical Systems?cited by 3
- 2026Adaptive Diffusion Posterior Sampling for Data and Model Fusion of Complex Nonlinear Dynamical Systemscited by 3
- 2026Controlling Transient Amplification Improves Long-horizon Rolloutscited by 3
- 2025Autoregressive regularized score-based diffusion models for multi-scenarios fluid flow predictioncited by 2
- 2025Point-wise Diffusion Models for Physical Systems with Shape Variations: Application to Spatio-temporal and Large-scale systemcited by 2
- 2025Improved probabilistic regression using diffusion modelscited by 2
- 2025PAINT: Parallel-in-time Neural Twins for Dynamical System Reconstructioncited by 2
- 2025PRISMA: Improving the Accuracy-Latency Frontier of Diffusion-based PDE Solvers Using Physics-Informed Spectral Attentioncited by 2
- 2025Efficient Generative Transformer Operators For Million-Point PDEscited by 2
- 2026Divergence-Free Diffusion Models for Incompressible Fluid Flowscited by 2
- 2026Hierarchy of extreme-event predictability in turbulence revealed by machine learningcited by 2
- 2026PDEInvBench: A Comprehensive Dataset and Design Space Exploration of Neural Networks for PDE Inverse Problemscited by 2
- 2026StocBench: A Benchmark for Generative Modeling of Stochastic Dynamicscited by 2
- 2024MelissaDL x Breed: Towards Data-Efficient On-line Supervised Training of Multi-parametric Surrogates with Active Learningcited by 1
- 2024Comparison of Generative Learning Methods for Turbulence Surrogatescited by 1
- 2025PIRF: Physics-Informed Reward Fine-Tuning for Diffusion Modelscited by 1
- 2025Efficient probabilistic surrogate modeling techniques for partially-observed large-scale dynamical systemscited by 1
- 2026Towards Infinitely Long Neural Simulations: Self-Refining Neural Surrogate Models for Dynamical Systemscited by 1
- 2026Stochastic Lifting for Generating Trajectories of Stochastic Physical Systemscited by 1
- 2026First-Order Trajectory Matching: Fast Ensemble Predictions of Chaotic, Turbulent, Stochastic Systemscited by 1
- 2026TIDE: A Physically Diverse 3D Turbulence Benchmark Dataset for Advancing Scientific Machine Learningcited by 1
- 2025PLAID: A Unified Data Model for Machine Learning on Heterogeneous Physics Simulationscited by 0
- 2025Video Prediction of Dynamic Physical Simulations With Pixel-Space Spatiotemporal Transformerscited by 0
- 2025Learning Temporally Consistent Turbulence Between Sparse Snapshots via Diffusion Modelscited by 0
50 most cited of 65 All 65 (JSON)
- 2026FLARE: Flow Matching with Local Axis-Angle Representations for Stochastic Micromagnetic Evolution28 Sep 2026
- 2026Staying on the Attractor: Supervising Neural Surrogates of 3D Turbulence Where They Leave It26 Sep 2026
- 2026One-Step Generative Surrogate Models via Block-Triangular Joint Drifting22 Sep 2026
- 2026StocBench: A Benchmark for Generative Modeling of Stochastic Dynamics23 Aug 2026
- 2026Dynamics-Aware Weighting for Deep Learning Forecasts of Chaotic Systems23 Aug 2026
- 2026TIDE: A Physically Diverse 3D Turbulence Benchmark Dataset for Advancing Scientific Machine Learning4 Aug 2026
- 2026Round-Trip Consistency: Bidirectional Diffusion Models Can Predict Their Own Rollout Errors1 Aug 2026
- 2026Spatio-Temporal Prediction of Unsteady Airfoil Aerodynamics Using Augmented Graph Neural Ordinary Differential Equations with Exogenous Controls17 Jul 2026
- 2026Diffusion-corrected Autoregressive Fourier Neural Operator for Droplet Evolution Prediction25 Jun 2026
- 2026Multiscale Hypersonic Boundary Layer Reconstruction via Spectral Binning and Subdomain-wise Conditional Diffusion12 Jun 2026
- 2026First-Order Trajectory Matching: Fast Ensemble Predictions of Chaotic, Turbulent, Stochastic Systems9 Jun 2026
- 2026Stochastic Lifting for Generating Trajectories of Stochastic Physical Systems28 May 2026
38 more
- 2026PDEInvBench: A Comprehensive Dataset and Design Space Exploration of Neural Networks for PDE Inverse Problems25 May 2026
- 2026Wavelet Flow Matching for Multi-Scale Physics Emulation15 May 2026
- 2026Martingale Neural Operators: Learning Stochastic Marginals via Doob-Meyer Factorization15 May 2026
- 2026Controlling Transient Amplification Improves Long-horizon Rollouts9 May 2026
- 2026Autoregressive One-Step Generative Modeling for Dynamical System Forecasting7 May 2026
- 2026Target Parameterization in Diffusion Models for Nonlinear Spatiotemporal System Identification19 Apr 2026
- 2026FlowRefiner: Flow Matching-Based Iterative Refinement for 3D Turbulent Flow Simulation18 Apr 2026
- 2026Bias-Constrained Diffusion Schedules for PDE Emulations: Reconstruction Error Minimization and Efficient Unrolled Training9 Apr 2026
- 2026Flow Learners for PDEs: Toward a Physics-to-Physics Paradigm for Scientific Computing2 Apr 2026
- 2026Towards Infinitely Long Neural Simulations: Self-Refining Neural Surrogate Models for Dynamical Systems18 Mar 2026
- 2026Hierarchy of extreme-event predictability in turbulence revealed by machine learning14 Mar 2026
- 2026Adaptive Diffusion Posterior Sampling for Data and Model Fusion of Complex Nonlinear Dynamical Systems13 Mar 2026
- 2026Probabilistic Retrofitting of Learned Simulators2 Mar 2026
- 2026Surrogate models for Rock-Fluid Interaction: A Grid-Size-Invariant Approach25 Feb 2026
- 2026Generative Neural Operators through Diffusion Last Layer4 Feb 2026
- 2026Particle-Guided Diffusion Models for Partial Differential Equations30 Jan 2026
- 2026Divergence-Free Diffusion Models for Incompressible Fluid Flows27 Jan 2026
- 2025Learning Temporally Consistent Turbulence Between Sparse Snapshots via Diffusion Models31 Dec 2025
- 2025Lazy Diffusion: Mitigating spectral collapse in generative diffusion-based stable autoregressive emulation of turbulent flows10 Dec 2025
- 2025Efficient Generative Transformer Operators For Million-Point PDEs4 Dec 2025
- 2025PRISMA: Improving the Accuracy-Latency Frontier of Diffusion-based PDE Solvers Using Physics-Informed Spectral Attention1 Dec 2025
- 2025Predicting partially observable dynamical systems via diffusion models with a multiscale inference scheme24 Nov 2025
- 2025Efficient probabilistic surrogate modeling techniques for partially-observed large-scale dynamical systems6 Nov 2025
- 2025Video Prediction of Dynamic Physical Simulations With Pixel-Space Spatiotemporal Transformers23 Oct 2025
- 2025PAINT: Parallel-in-time Neural Twins for Dynamical System Reconstruction14 Oct 2025
- 2025Improved probabilistic regression using diffusion models6 Oct 2025
- 2025PIRF: Physics-Informed Reward Fine-Tuning for Diffusion Models24 Sep 2025
- 2025Point-wise Diffusion Models for Physical Systems with Shape Variations: Application to Spatio-temporal and Large-scale system2 Aug 2025
- 2025When do World Models Successfully Learn Dynamical Systems?7 Jul 2025
- 2025Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulation3 Jul 2025
- 2025Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex Dynamics24 Jun 2025
- 2025Diffusion-Based Hierarchical Graph Neural Networks for Simulating Nonlinear Solid Mechanics6 Jun 2025
- 2025Geometric and Physical Constraints Synergistically Enhance Neural PDE Surrogates5 Jun 2025
- 2025PDE-Transformer: Efficient and Versatile Transformers for Physics Simulations30 May 2025
- 2025Autoregressive regularized score-based diffusion models for multi-scenarios fluid flow prediction30 May 2025
- 2025FD-Bench: A Modular and Fair Benchmark for Data-driven Fluid Simulation25 May 2025
- 2025FLEX: A Backbone for Diffusion-Based Modeling of Spatio-temporal Physical Systems23 May 2025
- 2025PLAID: A Unified Data Model for Machine Learning on Heterogeneous Physics Simulations5 May 2025
50 newest of 65 All 65 (JSON)
- 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modelingcited by 36
- 2024Wavelet Diffusion Neural Operatorcited by 28
- 2025Generative Latent Neural PDE Solver using Flow Matchingcited by 28
- 2025Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaoscited by 21
- 2025Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulationcited by 19
- 2024Zero-Shot Uncertainty Quantification using Diffusion Probabilistic Modelscited by 14
- 2024Elucidating the Design Choice of Probability Paths in Flow Matching for Forecastingcited by 12
- 2025Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex Dynamicscited by 12
- 2025FLEX: A Backbone for Diffusion-Based Modeling of Spatio-temporal Physical Systemscited by 8
- 2025Predicting partially observable dynamical systems via diffusion models with a multiscale inference schemecited by 4
- 2025Lazy Diffusion: Mitigating spectral collapse in generative diffusion-based stable autoregressive emulation of turbulent flowscited by 4
- 2026Particle-Guided Diffusion Models for Partial Differential Equationscited by 4
12 most cited of 29 All 29 (JSON)
- 2026StocBench: A Benchmark for Generative Modeling of Stochastic Dynamics23 Aug 2026
- 2026Round-Trip Consistency: Bidirectional Diffusion Models Can Predict Their Own Rollout Errors1 Aug 2026
- 2026Diffusion-corrected Autoregressive Fourier Neural Operator for Droplet Evolution Prediction25 Jun 2026
- 2026Multiscale Hypersonic Boundary Layer Reconstruction via Spectral Binning and Subdomain-wise Conditional Diffusion12 Jun 2026
- 2026Wavelet Flow Matching for Multi-Scale Physics Emulation15 May 2026
- 2026Target Parameterization in Diffusion Models for Nonlinear Spatiotemporal System Identification19 Apr 2026
- 2026FlowRefiner: Flow Matching-Based Iterative Refinement for 3D Turbulent Flow Simulation18 Apr 2026
- 2026Bias-Constrained Diffusion Schedules for PDE Emulations: Reconstruction Error Minimization and Efficient Unrolled Training9 Apr 2026
- 2026Generative Neural Operators through Diffusion Last Layer4 Feb 2026
- 2026Particle-Guided Diffusion Models for Partial Differential Equations30 Jan 2026
- 2026Divergence-Free Diffusion Models for Incompressible Fluid Flows27 Jan 2026
- 2025Learning Temporally Consistent Turbulence Between Sparse Snapshots via Diffusion Models31 Dec 2025
12 newest of 29 All 29 (JSON)
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
- 2025PDE-Transformer: Efficient and Versatile Transformers for Physics Simulationscited by 29
- 2024Continuous Ensemble Weather Forecasting with Diffusion modelscited by 27
- 2024Differentiability in Unrolled Training of Neural Physics Simulators on Transient Dynamicscited by 25
- 2024Probabilistic Emulation of a Global Climate Model with Spherical DYffusioncited by 21
- 2025DISCO: learning to DISCover an evolution Operator for multi-physics-agnostic predictioncited by 21
- 2025Diffusion-Based Hierarchical Graph Neural Networks for Simulating Nonlinear Solid Mechanicscited by 10
- 2024Predicting Change, Not States: An Alternate Framework for Neural PDE Surrogatescited by 8
- 2025BARNN: A Bayesian Autoregressive and Recurrent Neural Networkcited by 5
- 2025Geometric and Physical Constraints Synergistically Enhance Neural PDE Surrogatescited by 5
- 2026Probabilistic Retrofitting of Learned Simulatorscited by 5
- 2025FD-Bench: A Modular and Fair Benchmark for Data-driven Fluid Simulationcited by 4
12 most cited of 35 All 35 (JSON)
- 2026FLARE: Flow Matching with Local Axis-Angle Representations for Stochastic Micromagnetic Evolution28 Sep 2026
- 2026Staying on the Attractor: Supervising Neural Surrogates of 3D Turbulence Where They Leave It26 Sep 2026
- 2026One-Step Generative Surrogate Models via Block-Triangular Joint Drifting22 Sep 2026
- 2026Dynamics-Aware Weighting for Deep Learning Forecasts of Chaotic Systems23 Aug 2026
- 2026TIDE: A Physically Diverse 3D Turbulence Benchmark Dataset for Advancing Scientific Machine Learning4 Aug 2026
- 2026Spatio-Temporal Prediction of Unsteady Airfoil Aerodynamics Using Augmented Graph Neural Ordinary Differential Equations with Exogenous Controls17 Jul 2026
- 2026First-Order Trajectory Matching: Fast Ensemble Predictions of Chaotic, Turbulent, Stochastic Systems9 Jun 2026
- 2026Stochastic Lifting for Generating Trajectories of Stochastic Physical Systems28 May 2026
- 2026PDEInvBench: A Comprehensive Dataset and Design Space Exploration of Neural Networks for PDE Inverse Problems25 May 2026
- 2026Martingale Neural Operators: Learning Stochastic Marginals via Doob-Meyer Factorization15 May 2026
- 2026Controlling Transient Amplification Improves Long-horizon Rollouts9 May 2026
- 2026Autoregressive One-Step Generative Modeling for Dynamical System Forecasting7 May 2026
12 newest of 35 All 35 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Rectified Flows for Fast Multiscale Fluid Flow Modeling
- 2023Bayesian Conditional Diffusion Models for Versatile Spatiotemporal Turbulence Generation
- 2026One Scale at a Time: Scale-Autoregressive Modeling for Fluid Flow Distributions
- 2024On conditional diffusion models for PDE simulations
- 2026Memory-Conditioned Flow-Matching for Stable Autoregressive PDE Rollouts
- 2025Physics-aware generative models for turbulent fluid flows through energy-consistent stochastic interpolants
- 2026DiffusionRollout: Uncertainty-Aware Rollout Planning in Long-Horizon PDE Solving
- 2025Guiding diffusion models to reconstruct flow fields from sparse data