Fast Score-Based Sampling via Log-Concave Reductions
Not on the map. Why?
Abstract (arXiv)
Sampling based on score diffusions has led to striking empirical results, and has attracted considerable attention from various research communities. It depends on availability of (approximate) Stein score functions for various levels of additive noise. We show how in some generality, the availability of scores allows the general problem to be ``reduced'' to sampling from an adaptively constructed sequence of K strongly log-concave (SLC) sub-problems. The reduction is simple, constructive and algorithm-independent, so that any SLC sampler can be used as a subroutine. Various bounds on score-based sampling complexity follow directly: for instance, high-accuracy SLC samplers yield tildeO(K √d operatornamepolylog(1/varepsilon)) guarantees for accuracy varepsilon in dimension d, where randomized midpoint SLC schemes yield tildeO(K d1/3 operatornamepoly(1/varepsilon)) guarantees. When the original distribution itself is SLC, we prove that K ≤ 1 + log2(kappa), thereby obtaining the first efficient procedure with logarithmic dependence on condition number kappa; for general distributions, the quantity K depends on the geometry of score Hessian across the trajectory. Our analysis is direct and simple, involving techniques and insights complementary to those in standard analyses of discretized diffusions.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 33 of its 55 references that are in the map. First posted on arXiv 30 Dec 2025.
Builds on
33 of 55 references.
References · 33
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 440
- 2022Convergence of denoising diffusion models under the manifold hypothesiscited by 237
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localizationcited by 230
- 2019Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Sufficescited by 224
- 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptionscited by 215
21 more
- 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 206
- 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 195
- 2022Convergence of score-based generative modeling for general data distributionscited by 179
- 2022Convergence for score-based generative modeling with polynomial complexitycited by 176
- 2023The probability flow ODE is provably fastcited by 145
- 2018Log-concave sampling: Metropolis-Hastings algorithms are fastcited by 117
- 2023Error Bounds for Flow Matching Methodscited by 88
- 2017Convergence of Langevin MCMC in KL-divergencecited by 86
- 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Modelscited by 84
- 2019The Randomized Midpoint Method for Log-Concave Samplingcited by 77
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimizationcited by 72
- 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Modelscited by 64
- 2019Fast mixing of Metropolized Hamiltonian Monte Carlo: Benefits of multi-step gradientscited by 51
- 2023Faster high-accuracy log-concave sampling via algorithmic warm startscited by 44
- 2024Faster Diffusion Sampling with Randomized Midpoints: Sequential and Parallelcited by 29
- 2025Minimax Optimality of the Probability Flow ODE for Diffusion Modelscited by 23
- 2024Reverse Transition Kernel: A Flexible Framework to Accelerate Diffusion Inferencecited by 22
- 2019An Efficient Sampling Algorithm for Non-smooth Composite Potentialscited by 19
- 2025Learning normalized image densities via dual score matchingcited by 17
- 2023A Simple Proof of the Mixing of Metropolis-Adjusted Langevin Algorithm under Smoothness and Isoperimetrycited by 7
- 2024Provably Efficient Posterior Sampling for Sparse Linear Regression via Measure Decompositioncited by 5
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026High-accuracy sampling for diffusion models and log-concave distributionscited by 13
- 2026High-accuracy and dimension-free sampling with diffusionscited by 7
- 2026Denoising growth complexity: Data geometry and certified schedules for diffusion samplingcited by 2
- 2026Nonparametric undirected graphical model selection using diffusion modelscited by 0
- 2026Denoising growth complexity: Data geometry and certified schedules for diffusion sampling28 Jul 2026
- 2026Nonparametric undirected graphical model selection using diffusion models7 Jun 2026
- 2026High-accuracy sampling for diffusion models and log-concave distributions1 Feb 2026
- 2026High-accuracy and dimension-free sampling with diffusions15 Jan 2026