Improved sampling algorithms and functional inequalities for non-log-concave distributions
Not on the map. Why?
Abstract (arXiv)
We study the problem of sampling from a distribution μ with density propto e-V for some potential function V:mathbb Rd→ mathbb R with query access to V and nabla V. We start with the following standard assumptions: (1) V is L-smooth. (2) The second moment EX~ μ[|X|2]≤ M. Recently, He and Zhang (COLT'25) showed that the query complexity of this problem is at least left(fracLMdεright)Omega(d) where ε is the desired accuracy in total variation distance, and the Poincar'e constant can be unbounded. Meanwhile, another common assumption in the study of diffusion based samplers (see e.g., the work of Chen, Chewi, Li, Li, Salim and Zhang (ICLR'23)) strengthens (1) to the following: (1*) The potential function of *every* distribution along the Ornstein-Uhlenbeck process starting from μ is L-smooth. We show that under the assumptions (1*) and (2), the query complexity of sampling from μ can be poly(L,d)· left(fracLd+Mε2right)O(L+1), which is polynomial in d and frac1ε when L=O(1) and M=poly(d). This improves the algorithm with quasi-polynomial query complexity developed by Huang et al. (COLT'24). Our results imply that the seemingly moderate strengthening from (1) to (1*) yields an exponential gap in the query complexity. Furthermore, we show that together with the assumption (1*) and the stronger moment assumption that |X| is λ-sub-Gaussian for X~μ, the Poincar'e constant of μ is at most O(λ)2(L+1). We also establish a modified log-Sobolev inequality for μ under these conditions. As an application of our technique, we obtain a new estimate of the modified log-Sobolev constant for a specific class of mixtures of strongly log-concave distributions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 31 references that are in the map. First posted on arXiv 15 Jul 2025.
Builds on
21 of 31 references.
References · 21
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localizationcited by 235
- 2019Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Sufficescited by 227
- 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptionscited by 219
- 2022Convergence of score-based generative modeling for general data distributionscited by 181
- 2023The probability flow ODE is provably fastcited by 146
- 2017Convergence of Langevin MCMC in KL-divergencecited by 88
- 2020Structured Logconcave Sampling with a Restricted Gaussian Oraclecited by 86
- 2019The Randomized Midpoint Method for Log-Concave Samplingcited by 78
- 2023Restoration-Degradation Beyond Linear Diffusions: A Non-Asymptotic Analysis For DDIM-Type Samplerscited by 74
- 2022Improved analysis for a proximal algorithm for samplingcited by 73
- 2023Reverse Diffusion Monte Carlocited by 41
9 more
- 2017Beyond Log-concavity: Provable Guarantees for Sampling Multi-modal Distributions using Simulated Tempering Langevin Monte Carlocited by 33
- 2023Towards a Complete Analysis of Langevin Monte Carlo: Beyond Poincar'e Inequalitycited by 31
- 2024Faster Diffusion Sampling with Randomized Midpoints: Sequential and Parallelcited by 29
- 2024Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave Samplingcited by 23
- 2022A Proximal Algorithm for Samplingcited by 22
- 2024Zeroth-Order Sampling Methods for Non-Log-Concave Distributions: Alleviating Metastability by Denoising Diffusioncited by 19
- 2024Faster Sampling without Isoperimetry via Diffusion-based Monte Carlocited by 15
- 2024Fast Convergence of Phi-Divergence Along the Unadjusted Langevin Algorithm and Proximal Samplercited by 11
- 2024Rapid Mixing at the Uniqueness Thresholdcited by 4
Built on by
Not cited yet.