Probability flow ODEs in score-based and reflected diffusion models
On the map: Diffusion models → Diffusion foundations and sampling also fits: Flow matching, time series and science
Abstract (arXiv)
Probability-flow ordinary differential equations (PF-ODEs) are widely used as deterministic samplers for score-based diffusion models. Their usual justification is that the Fokker--Planck equation of a diffusion can be rewritten as a continuity equation driven by the score function of the forward diffusion. This identity does not, however, guarantee that the resulting velocity field generates a well-posed flow. We provide theoretical insights into the design of such deterministic samplers for generative models based on diffusions and reflected diffusions. We identify sufficient conditions for a regular Lagrangian PF-ODE flow to exist; reverse sampling and invertibility require two-sided divergence control. For learned scores, sampler stability is controlled by an unweighted velocity error, exposing a mismatch with density-weighted score matching and motivating architectural control of Jacobians, divergence, growth, and compression. Under the manifold hypothesis, positive-time regularization justifies an early-stopped PF-ODE while constants deteriorate near the data endpoint; an explicit sphere example shows that the exact deterministic flow becomes singular as the noise level vanishes even though the diffusion marginals remain well defined. These theoretical insights translate into concrete design principles for stable, invertible, and constraint-preserving diffusion samplers. We illustrate the practical relevance of these design principles using controlled numerical experiments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 12 of its 22 references that are in the map. First posted on arXiv 2 Oct 2026.
Builds on
12 of 22 references.
Closest ancestors · 11
Same direction, newest first
- 2025Lipschitz-Guided Design of Interpolation Schedules in Generative Models1 Sep
- 2024Linear Convergence of Diffusion Models Under the Manifold Hypothesis11 Oct
- 2024Convergence of Diffusion Models Under the Manifold Hypothesis in High-Dimensions27 Sep
- 2024Global Well-posedness and Convergence Analysis of Score-based Generative Models via Sharp Lipschitz Estimates25 May
- 2024Convergence Analysis of Probability Flow ODE for Score-based Generative Models15 Apr
- 2024Neural Network-Based Score Estimation in Diffusion Models: Optimization and Generalization28 Jan
- 2023Diffusion Models for Constrained Domains11 Apr
- 2023Reflected Diffusion Models10 Apr
- 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
- 2021Maximum Likelihood Training of Score-Based Diffusion Models22 Jan
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
Other references · 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models
- 2025Adaptivity and Convergence of Probability Flow ODEs in Diffusion Generative Models
- 2025Minimax Optimality of the Probability Flow ODE for Diffusion Models
- 2026A Unified Measure-Theoretic View of Diffusion, Score-Based, and Flow Matching Generative Models
- 2025Fast Convergence for High-Order ODE Solvers in Diffusion Probabilistic Models
- 2026A Tutorial on Diffusion Theory: From Differential Equations to Diffusion Models
- 2024Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distances
- 2025A PDE Perspective on Generative Diffusion Models