mlsanityData to 14 Oct 2026

Minimax Optimality of the Probability Flow ODE for Diffusion Models

arXiv 2503.09583 ↗First posted 12 Mar 2025cs.LG cs.IT math.ITcited by 23

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Score-based diffusion models have become a foundational paradigm for modern generative modeling, demonstrating exceptional capability in generating samples from complex high-dimensional distributions. Despite the dominant adoption of probability flow ODE-based samplers in practice due to their superior sampling efficiency and precision, rigorous statistical guarantees for these methods have remained elusive in the literature. This work develops the first end-to-end theoretical framework for deterministic ODE-based samplers that establishes near-minimax optimal guarantees under mild assumptions on target data distributions. Specifically, focusing on subgaussian distributions with β-H"older smooth densities for β≤ 2, we propose a smooth regularized score estimator that simultaneously controls both the L2 score error and the associated mean Jacobian error. Leveraging this estimator within a refined convergence analysis of the ODE-based sampling process, we demonstrate that the resulting sampler achieves the minimax rate in total variation distance, modulo logarithmic factors. Notably, our theory comprehensively accounts for all sources of error in the sampling process and does not require strong structural conditions such as density lower bounds or Lipschitz/smooth scores on target distributions, thereby covering a broad range of practical data distributions.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 40 of its 79 references that are in the map. First posted on arXiv 12 Mar 2025.

Builds on

40 of 79 references.

Closest ancestors · 31

Same direction, newest first

  1. 2025Regularization can make diffusion models more efficient13 Feb
  2. 2025Low-dimensional adaptation of diffusion models: Convergence in total variation22 Jan
  3. 2024Statistical guarantees for denoising reflected diffusion models3 Nov
  4. 2024Provable Acceleration for Diffusion Models under Minimal Assumptions30 Oct
  5. 2024Denoising diffusion probabilistic models are optimally adaptive to unknown low dimensionality24 Oct
  6. 2024Instance-dependent Convergence Theory for Diffusion Models17 Oct
  7. 2024Linear Convergence of Diffusion Models Under the Manifold Hypothesis11 Oct
  8. 2024Stochastic Runge-Kutta Methods: Provable Acceleration of Diffusion Models7 Oct
  9. 2024O(d/T) Convergence Theory for Diffusion Probabilistic Models under Minimal Assumptions27 Sep
  10. 2024From optimal score matching to optimal sampling11 Sep
  11. 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models5 Aug
  12. 2024Reverse Transition Kernel: A Flexible Framework to Accelerate Diffusion Inference26 May
19 more
  1. 2024Adapting to Unknown Low-Dimensional Structures in Score-Based Diffusion Models23 May
  2. 2024Learning general Gaussian mixtures with efficient score matching29 Apr
  3. 2024Learning Mixtures of Gaussians Using Diffusion Models29 Apr
  4. 2024Convergence Analysis of Probability Flow ODE for Score-based Generative Models15 Apr
  5. 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization11 Apr
  6. 2024Accelerating Convergence of Score-Based Diffusion Models, Provably6 Mar
  7. 2024Minimax Optimality of Score-based Diffusion Models: Beyond the Density Lower Bound Assumptions23 Feb
  8. 2024Score-based Diffusion Models via Stochastic Differential Equations -- a Technical Tutorial12 Feb
  9. 2024A Good Score Does not Lead to A Good Generative Model10 Jan
  10. 2023Closed-Form Diffusion Models19 Oct
  11. 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localization7 Aug
  12. 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models15 Jun
  13. 2022Convergence of the Inexact Langevin Algorithm in KL Divergence with Application to Score-based Generative Models2 Nov
  14. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
  15. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
  16. 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
  17. 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
  18. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  19. 2020Denoising Diffusion Implicit Models6 Oct

Other references · 9

  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  2. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  3. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  4. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
  5. 2022Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problemcited by 236
  6. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  7. 2020Generative Modeling with Denoising Auto-Encoders and Langevin Samplingcited by 119
  8. 2024Optimal score estimation via empirical Bayes smoothingcited by 61
  9. 2023Analysis of learning a flow-based generative model from limited sample complexitycited by 38

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 13.

23 papers.

Sort:

By area:

  1. 2025Dimension-Free Convergence of Diffusion Models for Approximate Gaussian Mixturescited by 23
  2. 2025Breaking AR's Sampling Bottleneck: Provable Acceleration via Diffusion Language Modelscited by 23
  3. 2026Confidence-Based Decoding is Provably Efficient for Diffusion Language Modelscited by 18
  4. 2025Faster Diffusion Models via Higher-Order Approximationcited by 16
  5. 2025Stage-wise Dynamics of Classifier-Free Guidance in Diffusion Modelscited by 16
  6. 2026Adaptation to Intrinsic Dependence in Diffusion Language Modelscited by 10
  7. 2025Provable Efficiency of Guidance in Diffusion Models for General Data Distributioncited by 8
  8. 2025Towards a unified framework for guided diffusion modelscited by 8
  9. 2025Distribution estimation via Flow Matching with Lipschitz guaranteescited by 6
  10. 2026Diffusion Models with Heavy-Tailed Targets: Score Estimation and Sampling Guaranteescited by 5
  11. 2025Fast Score-Based Sampling via Log-Concave Reductionscited by 4
  12. 2025Dimension-free error estimate for diffusion model and optimal schedulingcited by 3
11 more
  1. 2026Diffusion Models Are Statistically Optimal for Learning Low-Dimensional Multi-Modal Distributionscited by 3
  2. 2025From Conditional to Unconditional Independence: Testing Conditional Independence via Transport Mapscited by 2
  3. 2026Variation-aware Flexible 3D Gaussian Editingcited by 2
  4. 2026Denoising growth complexity: Data geometry and certified schedules for diffusion samplingcited by 2
  5. 2026ConvergeFlow: Language Flow with Provable Convergence to Token Embeddingscited by 2
  6. 2026Why DDIM Hallucinates More Than DDPM: A Theoretical Analysis of Reverse Dynamicscited by 1
  7. 2026Diffusion Models for Adaptive Sequential Data Generationcited by 1
  8. 2026Diffusion Models Adapt to Low-Dimensional Structure Under Flexible Coefficient Choicescited by 1
  9. 2026Robustness of Diffusion Models under Distribution Shiftcited by 0
  10. 2026Learning a Flow to Self-Supervised Representationscited by 0
  11. 2026Counterfactual Generation via Flow Matching: Coupling-Sensitive End-to-End Ratescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Adaptivity and Convergence of Probability Flow ODEs in Diffusion Generative Models
  2. 2026Probability flow ODEs in score-based and reflected diffusion models
  3. 2023The probability flow ODE is provably fast
  4. 2025Non-asymptotic error bounds for probability flow ODEs under weak log-concavity
  5. 2024Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distances
  6. 2025Convergence of Deterministic and Stochastic Diffusion-Model Samplers: A Simple Analysis in Wasserstein Distance
  7. 2024Unified Convergence Analysis for Score-Based Diffusion Models with Deterministic Samplers
  8. 2023Restoration-Degradation Beyond Linear Diffusions: A Non-Asymptotic Analysis For DDIM-Type Samplers