Adaptivity and Convergence of Probability Flow ODEs in Diffusion Generative Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Score-based generative models, which transform noise into data by learning to reverse a diffusion process, have become a cornerstone of modern generative AI. This paper contributes to establishing theoretical guarantees for the probability flow ODE, a widely used diffusion-based sampler known for its practical efficiency. While a number of prior works address its general convergence theory, it remains unclear whether the probability flow ODE sampler can adapt to the low-dimensional structures commonly present in natural image data. We demonstrate that, with accurate score function estimation, the probability flow ODE sampler achieves a convergence rate of O(k/T) in total variation distance (ignoring logarithmic factors), where k is the intrinsic dimension of the target distribution and T is the number of iterations. This dimension-free convergence rate improves upon existing results that scale with the typically much larger ambient dimension, highlighting the ability of the probability flow ODE sampler to exploit intrinsic low-dimensional structures in the target distribution for faster sampling.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 21 of its 45 references that are in the map. First posted on arXiv 31 Jan 2025.
Builds on
21 of 45 references.
Closest ancestors · 20
Same direction, newest first
- 2025Low-dimensional adaptation of diffusion models: Convergence in total variation22 Jan
- 2024Denoising diffusion probabilistic models are optimally adaptive to unknown low dimensionality24 Oct
- 2024Unified Convergence Analysis for Score-Based Diffusion Models with Deterministic Samplers18 Oct
- 2024Linear Convergence of Diffusion Models Under the Manifold Hypothesis11 Oct
- 2024O(d/T) Convergence Theory for Diffusion Probabilistic Models under Minimal Assumptions27 Sep
- 2024Convergence of Diffusion Models Under the Manifold Hypothesis in High-Dimensions27 Sep
- 2024Breaking the Curse of Dimensionality: Diffusion Models Efficiently Learn Low-Dimensional Distributions4 Sep
- 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models5 Aug
- 2024Convergence Analysis of Probability Flow ODE for Score-based Generative Models15 Apr
- 2024Accelerating Convergence of Score-Based Diffusion Models, Provably6 Mar
- 2024Score-based Diffusion Models via Stochastic Differential Equations -- a Technical Tutorial12 Feb
- 2024Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distances31 Jan
8 more
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
- 2023Error Bounds for Flow Matching Methods26 May
- 2023The probability flow ODE is provably fast19 May
- 2023Restoration-Degradation Beyond Linear Diffusions: A Non-Asymptotic Analysis For DDIM-Type Samplers6 Mar
- 2023Diffusion Models are Minimax Optimal Distribution Estimators3 Mar
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
- 2020Denoising Diffusion Implicit Models6 Oct
Other references · 1
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
Built on by
Citing papers per year: 2025: 3; 2026: 5.
8 papers.
- 2025Faster Diffusion Models via Higher-Order Approximationcited by 16
- 2026High-accuracy sampling for diffusion models and log-concave distributionscited by 16
- 2025Fast Convergence for High-Order ODE Solvers in Diffusion Probabilistic Modelscited by 9
- 2026Blind denoising diffusion models and the blessings of dimensionalitycited by 9
- 2025Sublinear iterations can suffice even for DDPMscited by 7
- 2026Provable diffusion-based posterior sampling for linear inverse problems via DDIMcited by 4
- 2026Diffusion Models Adapt to Low-Dimensional Structure Under Flexible Coefficient Choicescited by 1
- 2026Learning a Flow to Self-Supervised Representationscited by 0
- 2026Learning a Flow to Self-Supervised Representations24 Sep 2026
- 2026Provable diffusion-based posterior sampling for linear inverse problems via DDIM21 Jul 2026
- 2026Diffusion Models Adapt to Low-Dimensional Structure Under Flexible Coefficient Choices22 Jun 2026
- 2026Blind denoising diffusion models and the blessings of dimensionality10 Feb 2026
- 2026High-accuracy sampling for diffusion models and log-concave distributions1 Feb 2026
- 2025Sublinear iterations can suffice even for DDPMs6 Nov 2025
- 2025Faster Diffusion Models via Higher-Order Approximation30 Jun 2025
- 2025Fast Convergence for High-Order ODE Solvers in Diffusion Probabilistic Models16 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2026Probability flow ODEs in score-based and reflected diffusion models
- 2025Minimax Optimality of the Probability Flow ODE for Diffusion Models
- 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models
- 2026A Unified Measure-Theoretic View of Diffusion, Score-Based, and Flow Matching Generative Models
- 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavity
- 2023Exploring the Optimal Choice for Generative Processes in Diffusion Models: Ordinary vs Stochastic Differential Equations
- 2021A Variational Perspective on Diffusion-Based Generative Models and Score Matching
- 2025An Introduction to Flow Matching and Diffusion Models