Error bounds for particle gradient descent, and extensions of the log-Sobolev and Talagrand inequalities
Not on the map. Why?
Abstract (arXiv)
We prove non-asymptotic error bounds for particle gradient descent (PGD, Kuntz et al., 2023), a recently introduced algorithm for maximum likelihood estimation of large latent variable models obtained by discretizing a gradient flow of the free energy. We begin by showing that the flow converges exponentially fast to the free energy's minimizers for models satisfying a condition that generalizes both the log-Sobolev and the Polyak--Lojasiewicz inequalities (LSI and PLI, respectively). We achieve this by extending a result well-known in the optimal transport literature (that the LSI implies the Talagrand inequality) and its counterpart in the optimization literature (that the PLI implies the so-called quadratic growth condition), and applying the extension to our new setting. We also generalize the Bakry--'Emery Theorem and show that the LSI/PLI extension holds for models with strongly concave log-likelihoods. For such models, we further control PGD's discretization error and obtain the non-asymptotic error bounds. While we are motivated by the study of PGD, we believe that the inequalities and results we extend may be of independent interest.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 20 of its 68 references that are in the map. First posted on arXiv 4 Mar 2024.
Builds on
20 of 68 references.
References · 20
- 2019An Introduction to Variational Autoencoderscited by 1,000
- 2021Score-based Generative Modeling in Latent Spacecited by 636
- 2016Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Lojasiewicz Conditioncited by 539
- 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 507
- 2018A Mean Field View of the Landscape of Two-Layers Neural Networkscited by 466
- 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 208
- 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 197
- 2016High-dimensional Bayesian inference via the Unadjusted Langevin Algorithmcited by 146
- 2014Statistical guarantees for the EM algorithm: From population to sample-based analysiscited by 133
- 2017Convergence of Langevin MCMC in KL-divergencecited by 88
- 2019On the geometry of Stein variational gradient descentcited by 82
- 2019The Randomized Midpoint Method for Log-Concave Samplingcited by 78
8 more
- 2022Particle algorithms for maximum likelihood training of latent variable modelscited by 26
- 2021Diffusion Priors In Variational Autoencoderscited by 25
- 2020On the Ergodicity, Bias and Asymptotic Normality of Randomized Midpoint Sampling Methodcited by 23
- 2020Homeomorphic-Invariance of EM: Non-Asymptotic Convergence in KL Divergence for Exponential Families via Mirror Descentcited by 18
- 2023Interacting Particle Langevin Algorithm for Maximum Marginal Likelihood Estimationcited by 17
- 2023Momentum Particle Maximum Likelihoodcited by 12
- 2023Tuning-Free Maximum Likelihood Training of Latent Variable Models via Coin Bettingcited by 11
- 2023Gradient flows for empirical Bayes in high-dimensional linear modelscited by 4
Built on by
Citing papers per year: 2024: 4; 2025: 4; 2026: 5.
13 papers.
Sort:
By area:
- 2024Proximal Interacting Particle Langevin Algorithmscited by 8
- 2024Particle Semi-Implicit Variational Inferencecited by 7
- 2024Kinetic Interacting Particle Langevin Monte Carlocited by 7
- 2025Sequential Monte Carlo approximations of Wasserstein--Fisher--Rao gradient flowscited by 5
- 2025Learning Latent Energy-Based Models via Interacting Particle Langevin Dynamicscited by 5
- 2025Training Latent Diffusion Models with Interacting Particle Algorithmscited by 4
- 2025Learning Latent Variable Models via Jarzynski-adjusted Langevin Algorithmcited by 3
- 2026Consistency Regularised Gradient Flows for Inverse Problemscited by 2
- 2024Fast convergence of the Expectation Maximization algorithm under a logarithmic Sobolev inequalitycited by 1
- 2026Wasserstein Contraction of Coordinate Ascent Variational Inferencecited by 1
- 2026Momentum SVGD-EM for Accelerated Maximum Marginal Likelihood Estimationcited by 0
- 2026Particle-based Generalised Stochastic Optimisationcited by 0
- 2026Stability of Finite-Batch Particle Mean-Field Variational Inference Beyond Strong Convexity11 Aug 2026
- 2026Particle-based Generalised Stochastic Optimisation3 Aug 2026
- 2026Wasserstein Contraction of Coordinate Ascent Variational Inference28 May 2026
- 2026Consistency Regularised Gradient Flows for Inverse Problems8 May 2026
- 2026Momentum SVGD-EM for Accelerated Maximum Marginal Likelihood Estimation9 Mar 2026
- 2025Learning Latent Energy-Based Models via Interacting Particle Langevin Dynamics14 Oct 2025
- 2025Sequential Monte Carlo approximations of Wasserstein--Fisher--Rao gradient flows6 Jun 2025
- 2025Learning Latent Variable Models via Jarzynski-adjusted Langevin Algorithm23 May 2025
- 2025Training Latent Diffusion Models with Interacting Particle Algorithms18 May 2025
- 2024Fast convergence of the Expectation Maximization algorithm under a logarithmic Sobolev inequality25 Jul 2024
- 2024Kinetic Interacting Particle Langevin Monte Carlo8 Jul 2024
- 2024Particle Semi-Implicit Variational Inference30 Jun 2024
1 more
- 2024Proximal Interacting Particle Langevin Algorithms20 Jun 2024
- 2024Proximal Interacting Particle Langevin Algorithmscited by 8
- 2024Particle Semi-Implicit Variational Inferencecited by 7
- 2024Kinetic Interacting Particle Langevin Monte Carlocited by 7
- 2025Sequential Monte Carlo approximations of Wasserstein--Fisher--Rao gradient flowscited by 5
- 2025Learning Latent Energy-Based Models via Interacting Particle Langevin Dynamicscited by 5
- 2025Learning Latent Variable Models via Jarzynski-adjusted Langevin Algorithmcited by 3
- 2024Fast convergence of the Expectation Maximization algorithm under a logarithmic Sobolev inequalitycited by 1
- 2026Wasserstein Contraction of Coordinate Ascent Variational Inferencecited by 1
- 2026Momentum SVGD-EM for Accelerated Maximum Marginal Likelihood Estimationcited by 0
- 2026Particle-based Generalised Stochastic Optimisationcited by 0
- 2026Stability of Finite-Batch Particle Mean-Field Variational Inference Beyond Strong Convexitycited by 0
- 2026Stability of Finite-Batch Particle Mean-Field Variational Inference Beyond Strong Convexity11 Aug 2026
- 2026Particle-based Generalised Stochastic Optimisation3 Aug 2026
- 2026Wasserstein Contraction of Coordinate Ascent Variational Inference28 May 2026
- 2026Momentum SVGD-EM for Accelerated Maximum Marginal Likelihood Estimation9 Mar 2026
- 2025Learning Latent Energy-Based Models via Interacting Particle Langevin Dynamics14 Oct 2025
- 2025Sequential Monte Carlo approximations of Wasserstein--Fisher--Rao gradient flows6 Jun 2025
- 2025Learning Latent Variable Models via Jarzynski-adjusted Langevin Algorithm23 May 2025
- 2024Fast convergence of the Expectation Maximization algorithm under a logarithmic Sobolev inequality25 Jul 2024
- 2024Kinetic Interacting Particle Langevin Monte Carlo8 Jul 2024
- 2024Particle Semi-Implicit Variational Inference30 Jun 2024
- 2024Proximal Interacting Particle Langevin Algorithms20 Jun 2024