R'enyi-infinity constrained sampling with d3 membership queries
Not on the map. Why?
Abstract (arXiv)
Uniform sampling over a convex body is a fundamental algorithmic problem, yet the convergence in KL or R'enyi divergence of most samplers remains poorly understood. In this work, we propose a constrained proximal sampler, a principled and simple algorithm that possesses elegant convergence guarantees. Leveraging the uniform ergodicity of this sampler, we show that it converges in the R'enyi-infinity divergence (mathcal R_∞) with no query complexity overhead when starting from a warm start. This is the strongest of commonly considered performance metrics, implying rates in mathcal Rq, mathsfKL convergence as special cases. By applying this sampler within an annealing scheme, we propose an algorithm which can approximately sample varepsilon-close to the uniform distribution on convex bodies in mathcal R_∞-divergence with widetildeO(d3, polylog frac1varepsilon) query complexity. This improves on all prior results in mathcal Rq, mathsfKL-divergences, without resorting to any algorithmic modifications or post-processing of the sample. It also matches the prior best known complexity in total variation distance.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 30 of its 73 references that are in the map. First posted on arXiv 17 Jul 2024.
Builds on
30 of 73 references.
References · 30
- 2018Pyro: Deep Universal Probabilistic Programmingcited by 380
- 2019Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Sufficescited by 227
- 2018Analysis of Langevin Monte Carlo via convex optimizationcited by 127
- 2018Log-concave sampling: Metropolis-Hastings algorithms are fastcited by 118
- 2017Convergence of Langevin MCMC in KL-divergencecited by 88
- 2020Structured Logconcave Sampling with a Restricted Gaussian Oraclecited by 86
- 2022Improved analysis for a proximal algorithm for samplingcited by 73
- 2020Optimal dimension dependence of the Metropolis-Adjusted Langevin Algorithmcited by 57
- 2020Wasserstein Control of Mirror Langevin Monte Carlocited by 55
- 2020Efficient constrained sampling via the mirror-Langevin algorithmcited by 55
- 2022Private Convex Optimization via Exponential Mechanismcited by 49
- 2023Faster high-accuracy log-concave sampling via algorithmic warm startscited by 45
18 more
- 2017Sampling from a log-concave distribution with compact support with proximal Langevin Monte Carlocited by 43
- 2020Convergence of Langevin Monte Carlo in Chi-Squared and Renyi Divergencecited by 42
- 2019Improved Bounds for Discretization of Langevin Diffusions: Near-Optimal Rates without Convexitycited by 39
- 2021The Mirror Langevin Algorithm Converges with Vanishing Biascited by 37
- 2017Convergence Rate of Riemannian Hamiltonian Monte Carlo and Faster Polytope Volume Computationcited by 32
- 2023Towards a Complete Analysis of Langevin Monte Carlo: Beyond Poincar'e Inequalitycited by 31
- 2022Sampling with Riemannian Hamiltonian Monte Carlo in a Constrained Spacecited by 28
- 2023Improved Discretization Analysis for Underdamped Langevin Monte Carlocited by 28
- 2020Faster Differentially Private Samplers via R'enyi Divergence Analysis of Discretized Langevin MCMCcited by 27
- 2021The Langevin Monte Carlo algorithm in the non-smooth log-concave casecited by 26
- 2020Riemannian Langevin Algorithm for Solving Semidefinite Programscited by 22
- 2024In-and-Out: Algorithmic Diffusion for Sampling Convex Bodiescited by 19
- 2017Fast MCMC sampling algorithms on polytopescited by 17
- 2023When does Metropolized Hamiltonian Monte Carlo provably outperform Metropolis-adjusted Langevin algorithm?cited by 15
- 2022Private Convex Optimization in General Normscited by 13
- 2023Fast sampling from constrained spaces using the Metropolis-adjusted Mirror Langevin algorithmcited by 11
- 2022Condition-number-independent convergence rate of Riemannian Hamiltonian Monte Carlo with numerical integratorscited by 10
- 2023Sampling with Barriers: Faster Mixing via Lewis Weightscited by 7
Built on by
Citing papers per year: 2026: 3.
3 papers.