Smoothed Score Queries and the Complexity of Sampling
Not on the map. Why?
Abstract (arXiv)
We study the query complexity of sampling from high-dimensional Gaussian distributions using gradient information. In the standard oracle model, exact gradients expose only matrix-vector products with the precision matrix, leading to polynomial approximation barriers and a characteristic (√kappa) dependence on the condition number. We show that this barrier disappears when the sampler is allowed to query smoothed scores, namely gradients of the logarithms of the Gaussian-convolved densities. For a Gaussian target with precision matrix (Lambda), a smoothed-score query at noise level (τ) gives access to the resolvent ((Lambda+τ-1I)-1). Combining geometrically spaced noise levels with sinc-quadrature rational approximation, we obtain a sampler with q=O!left(bigl(logkappa+log(e√ d/δrm TV)bigr)log(e√ d/δrm TV)right) smoothed-score queries for total variation error (δrm TV), improving the condition-number dependence from (√kappa) to logarithmic. We also study finite-bit gradient oracles. Using coordinatewise quantization of the transformed smoothed-score answers and a final dithering step, we obtain a sampling scheme whose total communicated gradient information is polylogarithmic in (kappa); in particular, for fixed dimension and accuracy, the bit complexity is (O(log2kappa)). To complement these upper bounds, we introduce a channel-synthesis, or reverse-Shannon, converse technique for sampling lower bounds. This converts total-variation simulation guarantees into communication requirements and yields an (Omega(logkappa)) lower bound on the required gradient information. Together, these results identify smoothed scores as a provably more informative oracle for sampling and give nearly matching upper and lower bounds for its finite-bit complexity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 30 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
14 of 30 references.
References · 14
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
- 2023The probability flow ODE is provably fastcited by 146
- 2024Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distancescited by 56
- 2024Instance-dependent Convergence Theory for Diffusion Modelscited by 21
- 2021The query complexity of sampling from strongly log-concave distributions in one dimensioncited by 18
- 2017Stability of the Lanczos Method for Matrix Function Approximationcited by 16
- 2025Optimal Convergence Analysis of DDPM for General Distributionscited by 16
- 2026High-accuracy sampling for diffusion models and log-concave distributionscited by 16
- 2022Fisher information lower bounds for samplingcited by 12
- 2023Query lower bounds for log-concave samplingcited by 12
2 more
- 2025Sublinear iterations can suffice even for DDPMscited by 7
- 2026Query Lower Bounds for Diffusion Samplingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Lower Bounds for Parallel Diffusion Sampling
- 2025Sampling Binary Data by Denoising through Score Functions
- 2025From Score Matching to Diffusion: A Fine-Grained Error Analysis in the Gaussian Setting
- 2024The Unreasonable Effectiveness of Gaussian Score Approximation for Diffusion Models and its Applications
- 2025Optimal Denoising in Score-Based Generative Models: The Role of Data Regularity
- 2026Denoising growth complexity: Data geometry and certified schedules for diffusion sampling
- 2022Convergence for score-based generative modeling with polynomial complexity
- 2023Learning Mixtures of Gaussians Using the DDPM Objective