Bias-Constrained Diffusion Schedules for PDE Emulations: Reconstruction Error Minimization and Efficient Unrolled Training
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Conditional Diffusion Models are powerful surrogates for emulating complex spatiotemporal dynamics, yet they often fail to match the accuracy of deterministic neural emulators for high-precision tasks. In this work, we address two critical limitations of autoregressive PDE diffusion models: their sub-optimal single-step accuracy and the prohibitive computational cost of unrolled training. First, we characterize the relationship between the noise schedule, the reconstruction error reduction rate and the diffusion exposure bias, demonstrating that standard schedules lead to suboptimal reconstruction error. Leveraging this insight, we propose an textitAdaptive Noise Schedule framework that minimizes inference reconstruction error by dynamically constraining the model's exposure bias. We further show that this optimized schedule enables a fast textitProxy Unrolled Training method to stabilize long-term rollouts without the cost of full Markov Chain sampling. Both proposed methods enable significant improvements in short-term accuracy and long-term stability over diffusion and deterministic baselines on diverse benchmarks, including forced Navier-Stokes, Kuramoto-Sivashinsky and Transonic Flow.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 34 of its 36 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
34 of 36 references.
Closest ancestors · 9
Same direction, newest first
- 2025Guiding diffusion models to reconstruct flow fields from sparse data22 Oct
- 2025Swift: An Autoregressive Consistency Model for Efficient Weather Forecasting30 Sep
- 2024On conditional diffusion models for PDE simulations21 Oct
- 2024Physics-Informed Diffusion Models21 Mar
- 2023Uncertainty-aware Surrogate Models for Airfoil Flow Simulations with Denoising Diffusion Probabilistic Models8 Dec
- 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulation4 Sep
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug
- 2023DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecasting3 Jun
- 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstruction26 Nov
Other references · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2022Video Diffusion Modelscited by 2,305
- 2023Consistency Modelscited by 1,822
- 2021Variational Diffusion Modelscited by 1,153
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2017The Perception-Distortion Tradeoffcited by 587
- 2023Universal Guidance for Diffusion Modelscited by 437
13 more
- 2023Simple diffusion: End-to-end diffusion for high resolution imagescited by 422
- 2022Message Passing Neural PDE Solverscited by 386
- 2022Perception Prioritized Training of Diffusion Modelscited by 303
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
- 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 177
- 2019Generalization in Generation: A closer look at Exposure Biascited by 123
- 2023Elucidating the Exposure Bias in Diffusion Modelscited by 101
- 2023Score-based Data Assimilationcited by 96
- 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 77
- 2023Alleviating Exposure Bias in Diffusion Models through Sampling with Shifted Time Stepscited by 73
- 2023Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistentcited by 58
- 2023From Zero to Turbulence: Generative Modeling for 3D Flow Simulationcited by 49
- 2022Learned Turbulence Modelling with Differentiable Fluid Solvers: Physics-based Loss-functions and Optimisation Horizonscited by 39
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Generative Latent Neural PDE Solver using Flow Matching
- 2026DiffusionRollout: Uncertainty-Aware Rollout Planning in Long-Horizon PDE Solving
- 2026Learning to Discretize: Diffusion-Based Adaptive Mesh with Spectral Guidance
- 2026Memory-Conditioned Flow-Matching for Stable Autoregressive PDE Rollouts
- 2025Rectified Flows for Fast Multiscale Fluid Flow Modeling
- 2025A-FloPS: Accelerating Diffusion Models via Adaptive Flow Path Sampler
- 2024Text2PDE: Latent Diffusion Models for Accessible Physics Simulation
- 2026Mitigating the Contractivity Trap in Diffusion ODEs via Stein Stabilization