mlsanityData to 7 Oct 2026

Quantitative Local Convergence of Mean-Field Stein Variational Gradient Flow

arXiv 2605.09456 ↗First posted 10 May 2026stat.ML cs.LG math.APcited by 1

Not on the map. Why?

Abstract (arXiv)

Stein Variational Gradient Descent (SVGD) is a deterministic interacting-particle method for sampling from a target probability measure given access to its score function. In the mean-field and continuous-time limit, it is known that the flow converges weakly toward the target, but no quantitative rate is known for the last iterate. In this paper, we establish quantitative local convergence in strong norms for this dynamics, when the interaction kernel is of Riesz type on the d-dimensional torus. Specifically, assuming that the initial density and the target are smooth and close in L2-norm, we obtain explicit polynomial convergence rates in L2-norm that depend on the dimension and on the regularity parameters of the kernel, the initialization and the target. We further show that these rates are sharp in certain regimes, and support the theory with numerical experiments. In the edge case of kernels with a Coulomb singularity, we recover the global exponential convergence result established in prior work. Our analysis is inspired by recent results on Wasserstein gradient flows of kernel mean discrepancies.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 21 references that are in the map. First posted on arXiv 10 May 2026.

Builds on

14 of 21 references.

References · 14

  1. 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 498
  2. 2017Stein Variational Gradient Descent as Gradient Flowcited by 149
  3. 2019On the geometry of Stein variational gradient descentcited by 82
  4. 2020SVGD as a kernelized Wasserstein gradient flow of the chi-squared divergencecited by 64
  5. 2020A Non-Asymptotic Analysis for Stein Variational Gradient Descentcited by 61
  6. 2018Scaling limit of the Stein variational gradient descent: the mean field regimecited by 35
  7. 2021A Convergence Theory for SVGD in the Population Limit under Talagrand's Inequality T1cited by 21
  8. 2018Stochastic Gradient MCMC with Repulsive Forcescited by 18
  9. 2021Stein Variational Gradient Descent: many-particle and long-time asymptoticscited by 15
  10. 2024Improved Finite-Particle Convergence Rates for Stein Variational Gradient Descentcited by 13
  11. 2026Quantitative Convergence of Wasserstein Gradient Flows of Kernel Mean Discrepanciescited by 8
  12. 2022A Note on the Convergence of Mirrored Stein Variational Gradient Descent under (L0,L1)-Smoothness Conditioncited by 4
2 more
  1. 2026Finite-Particle Rates for Regularized Stein Variational Gradient Descentcited by 3
  2. 2024Long-time asymptotics of noisy SVGD outside the population limitcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.