Algorithmic Aspects of the Log-Laplace Transform and a Non-Euclidean Proximal Sampler
Not on the map. Why?
Abstract (arXiv)
The development of efficient sampling algorithms catering to non-Euclidean geometries has been a challenging endeavor, as discretization techniques which succeed in the Euclidean setting do not readily carry over to more general settings. We develop a non-Euclidean analog of the recent proximal sampler of [LST21], which naturally induces regularization by an object known as the log-Laplace transform (LLT) of a density. We prove new mathematical properties (with an algorithmic flavor) of the LLT, such as strong convexity-smoothness duality and an isoperimetric inequality, which are used to prove a mixing time on our proximal sampler matching [LST21] under a warm start. As our main application, we show our warm-started sampler improves the value oracle complexity of differentially private convex optimization in ℓp and Schatten-p norms for p ∈ [1, 2] to match the Euclidean setting [GLL22], while retaining state-of-the-art excess risk bounds [GLLST23]. We find our investigation of the LLT to be a promising proof-of-concept of its utility as a tool for designing samplers, and outline directions for future exploration.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 39 of its 107 references that are in the map. First posted on arXiv 13 Feb 2023.
Builds on
39 of 107 references.
References · 39
- 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 208
- 2013Optimal rates for zero-order convex optimization: the power of two function evaluationscited by 198
- 2019Private Stochastic Convex Optimization with Optimal Ratescited by 186
- 2020Private Stochastic Convex Optimization: Optimal Rates in Linear Timecited by 153
- 2016High-dimensional Bayesian inference via the Unadjusted Langevin Algorithmcited by 146
- 2017Underdamped Langevin MCMC: A non-asymptotic analysiscited by 133
- 2018Differentially Private Empirical Risk Minimization Revisited: Faster and More Generalcited by 128
- 2018Analysis of Langevin Monte Carlo via convex optimizationcited by 127
- 2018Log-concave sampling: Metropolis-Hastings algorithms are fastcited by 118
- 2020Structured Logconcave Sampling with a Restricted Gaussian Oraclecited by 86
- 2021Private Stochastic Convex Optimization: Optimal Rates in ℓ1 Geometrycited by 83
- 2019The Randomized Midpoint Method for Log-Concave Samplingcited by 78
27 more
- 2022Improved analysis for a proximal algorithm for samplingcited by 73
- 2018Mirrored Langevin Dynamicscited by 61
- 2020Optimal dimension dependence of the Metropolis-Adjusted Langevin Algorithmcited by 57
- 2020Wasserstein Control of Mirror Langevin Monte Carlocited by 55
- 2020Efficient constrained sampling via the mirror-Langevin algorithmcited by 55
- 2019Fast mixing of Metropolized Hamiltonian Monte Carlo: Benefits of multi-step gradientscited by 51
- 2021Non-Euclidean Differentially Private Stochastic Convex Optimization: Optimal Rates in Linear Timecited by 51
- 2022Private Convex Optimization via Exponential Mechanismcited by 49
- 2013Proximal Markov chain Monte Carlo algorithmscited by 46
- 2017Sampling from a log-concave distribution with compact support with proximal Langevin Monte Carlocited by 43
- 2021The Mirror Langevin Algorithm Converges with Vanishing Biascited by 37
- 2020Robust Sub-Gaussian Principal Component Analysis and Width-Independent Schatten Packingcited by 35
- 2019Proximal Langevin Algorithm: Rapid Convergence Under Isoperimetrycited by 34
- 2017Convergence Rate of Riemannian Hamiltonian Monte Carlo and Faster Polytope Volume Computationcited by 32
- 2019Optimal Convergence Rate of Hamiltonian Monte Carlo for Strongly Logconcave Distributionscited by 28
- 2022Convergence of the Riemannian Langevin Algorithmcited by 25
- 2021A Proximal Algorithm for Sampling from Non-smooth Potentialscited by 24
- 2018Acceleration through Optimistic No-Regret Dynamicscited by 22
- 2020Logsmooth Gradient Concentration and Tighter Runtimes for Metropolized Hamiltonian Monte Carlocited by 22
- 2019An Efficient Sampling Algorithm for Non-smooth Composite Potentialscited by 19
- 2021Lower Bounds on Metropolized Sampling Methods for Well-Conditioned Distributionscited by 19
- 2020Relative Lipschitzness in Extragradient Methods and a Direct Recipe for Accelerationcited by 18
- 2022Localization Schemes: A Framework for Proving Mixing Bounds for Markov Chainscited by 16
- 2022Private Convex Optimization in General Normscited by 13
- 2022A Slightly Improved Bound for the KLS Constantcited by 10
- 2022Condition-number-independent convergence rate of Riemannian Hamiltonian Monte Carlo with numerical integratorscited by 10
- 2021The entropic barrier is n-self-concordantcited by 6
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 2; 2026: 3.
10 papers.
- 2023Faster high-accuracy log-concave sampling via algorithmic warm startscited by 45
- 2024In-and-Out: Algorithmic Diffusion for Sampling Convex Bodiescited by 19
- 2023Fast sampling from constrained spaces using the Metropolis-adjusted Mirror Langevin algorithmcited by 11
- 2024A Separation in Heavy-Tailed Sampling: Gaussian vs. Stable Oracles for Proximal Samplerscited by 6
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithmscited by 4
- 2025Mirror Mean-Field Langevin Dynamicscited by 3
- 2025Oracle-based Uniform Sampling from Convex Bodiescited by 3
- 2026High-accuracy log-concave sampling with stochastic queriescited by 2
- 2026Functional Stochastic Localizationcited by 0
- 2026Reflected Proximal Dynamics for Accelerated High-Accuracy Log-Concave Samplingcited by 0
- 2026Reflected Proximal Dynamics for Accelerated High-Accuracy Log-Concave Sampling12 Oct 2026
- 2026High-accuracy log-concave sampling with stochastic queries15 Feb 2026
- 2026Functional Stochastic Localization3 Feb 2026
- 2025Oracle-based Uniform Sampling from Convex Bodies3 Oct 2025
- 2025Mirror Mean-Field Langevin Dynamics5 May 2025
- 2024A Separation in Heavy-Tailed Sampling: Gaussian vs. Stable Oracles for Proximal Samplers27 May 2024
- 2024In-and-Out: Algorithmic Diffusion for Sampling Convex Bodies2 May 2024
- 2023Fast sampling from constrained spaces using the Metropolis-adjusted Mirror Langevin algorithm14 Dec 2023
- 2023Non-Log-Concave and Nonsmooth Sampling via Langevin Monte Carlo Algorithms25 May 2023
- 2023Faster high-accuracy log-concave sampling via algorithmic warm starts20 Feb 2023