New algorithms for sampling and diffusion models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Drawing from the theory of stochastic differential equations, we introduce a novel sampling method for known distributions and a new algorithm for diffusion generative models with unknown distributions. Our approach is inspired by the concept of the reverse diffusion process, widely adopted in diffusion generative models. Additionally, we derive the explicit convergence rate based on the smooth ODE flow. For diffusion generative models and sampling, we establish a dimension-free particle approximation convergence result. Numerical experiments demonstrate the effectiveness of our method. Notably, unlike the traditional Langevin method, our sampling method does not require any regularity assumptions about the density function of the target distribution. Furthermore, we also apply our method to optimization problems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 16 of its 34 references that are in the map. First posted on arXiv 14 Jun 2024.
Builds on
16 of 34 references.
Closest ancestors · 8
Same direction, newest first
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization11 Apr
- 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions3 Nov
- 2022Convergence of score-based generative modeling for general data distributions26 Sep
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 8
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2023Reverse Diffusion Monte Carlocited by 41
- 2023Convergence of flow-based generative models via proximal gradient descent in Wasserstein spacecited by 34
- 2024Stochastic Localization via Iterative Posterior Samplingcited by 27
- 2023Gaussian Interpolation Flowscited by 17
- 2023Diffusion Methods for Generating Transition Pathscited by 8
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026A Tutorial on Diffusion Theory: From Differential Equations to Diffusion Models
- 2022An optimal control perspective on diffusion-based generative modeling
- 2024On the Trajectory Regularity of ODE-based Diffusion Sampling
- 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models
- 2023A Geometric Perspective on Diffusion Models
- 2025Information-Theoretic Proofs for Diffusion Sampling
- 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models
- 2025A Reverse-BSDE Diffusion Sampler