mlsanityData to 14 Oct 2026

Error bounds for particle gradient descent, and extensions of the log-Sobolev and Talagrand inequalities

arXiv 2403.02004 ↗First posted 4 Mar 2024cs.LG math.FA math.OCcited by 13

Not on the map. Why?

Abstract (arXiv)

We prove non-asymptotic error bounds for particle gradient descent (PGD, Kuntz et al., 2023), a recently introduced algorithm for maximum likelihood estimation of large latent variable models obtained by discretizing a gradient flow of the free energy. We begin by showing that the flow converges exponentially fast to the free energy's minimizers for models satisfying a condition that generalizes both the log-Sobolev and the Polyak--Lojasiewicz inequalities (LSI and PLI, respectively). We achieve this by extending a result well-known in the optimal transport literature (that the LSI implies the Talagrand inequality) and its counterpart in the optimization literature (that the PLI implies the so-called quadratic growth condition), and applying the extension to our new setting. We also generalize the Bakry--'Emery Theorem and show that the LSI/PLI extension holds for models with strongly concave log-likelihoods. For such models, we further control PGD's discretization error and obtain the non-asymptotic error bounds. While we are motivated by the study of PGD, we believe that the inequalities and results we extend may be of independent interest.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 20 of its 68 references that are in the map. First posted on arXiv 4 Mar 2024.

Builds on

20 of 68 references.

References · 20

  1. 2019An Introduction to Variational Autoencoderscited by 1,000
  2. 2021Score-based Generative Modeling in Latent Spacecited by 636
  3. 2016Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Lojasiewicz Conditioncited by 539
  4. 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 507
  5. 2018A Mean Field View of the Landscape of Two-Layers Neural Networkscited by 466
  6. 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 208
  7. 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 197
  8. 2016High-dimensional Bayesian inference via the Unadjusted Langevin Algorithmcited by 146
  9. 2014Statistical guarantees for the EM algorithm: From population to sample-based analysiscited by 133
  10. 2017Convergence of Langevin MCMC in KL-divergencecited by 88
  11. 2019On the geometry of Stein variational gradient descentcited by 82
  12. 2019The Randomized Midpoint Method for Log-Concave Samplingcited by 78
8 more
  1. 2022Particle algorithms for maximum likelihood training of latent variable modelscited by 26
  2. 2021Diffusion Priors In Variational Autoencoderscited by 25
  3. 2020On the Ergodicity, Bias and Asymptotic Normality of Randomized Midpoint Sampling Methodcited by 23
  4. 2020Homeomorphic-Invariance of EM: Non-Asymptotic Convergence in KL Divergence for Exponential Families via Mirror Descentcited by 18
  5. 2023Interacting Particle Langevin Algorithm for Maximum Marginal Likelihood Estimationcited by 17
  6. 2023Momentum Particle Maximum Likelihoodcited by 12
  7. 2023Tuning-Free Maximum Likelihood Training of Latent Variable Models via Coin Bettingcited by 11
  8. 2023Gradient flows for empirical Bayes in high-dimensional linear modelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 4; 2026: 5.

13 papers.

Sort:

By area: