mlsanityData to 13 Oct 2026

Birth-death dynamics for sampling: Global convergence, approximations and their asymptotics

arXiv 2211.00450 ↗First posted 1 Nov 2022math.AP math.PR stat.MLcited by 30

Not on the map. Why?

Abstract (arXiv)

Motivated by the challenge of sampling Gibbs measures with nonconvex potentials, we study a continuum birth-death dynamics. We improve results in previous works [51,57] and provide weaker hypotheses under which the probability density of the birth-death governed by Kullback-Leibler divergence or by chi2 divergence converge exponentially fast to the Gibbs equilibrium measure, with a universal rate that is independent of the potential barrier. To build a practical numerical sampler based on the pure birth-death dynamics, we consider an interacting particle system, which is inspired by the gradient flow structure and the classical Fokker-Planck equation and relies on kernel-based approximations of the measure. Using the technique of Gamma-convergence of gradient flows, we show that on the torus, smooth and bounded positive solutions of the kernelized dynamics converge on finite time intervals, to the pure birth-death dynamics as the kernel bandwidth shrinks to zero. Moreover we provide quantitative estimates on the bias of minimizers of the energy corresponding to the kernelized dynamics. Finally we prove the long-time asymptotic results on the convergence of the asymptotic states of the kernelized dynamics towards the Gibbs measure.

Key facts. Cited by 30 papers in the map (data through 13 Oct 2026). Builds on 23 of its 84 references that are in the map. First posted on arXiv 1 Nov 2022.

Builds on

23 of 84 references.

References · 23

  1. 2016Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithmcited by 502
  2. 2019Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Sufficescited by 224
  3. 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 207
  4. 2015Non-asymptotic convergence analysis for the Unadjusted Langevin Algorithmcited by 195
  5. 2017Stein Variational Gradient Descent as Gradient Flowcited by 151
  6. 2015Optimal Entropy-Transport problems and a new Hellinger-Kantorovich distance between positive measurescited by 138
  7. 2018Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernelcited by 131
  8. 2019Maximum Mean Discrepancy Gradient Flowcited by 125
  9. 2018Sampling as optimization in the space of measures: The Langevin dynamics as a composite optimization problemcited by 123
  10. 2022Variational inference via Wasserstein gradient flowscited by 84
  11. 2019On the geometry of Stein variational gradient descentcited by 82
  12. 2020SVGD as a kernelized Wasserstein gradient flow of the chi-squared divergencecited by 64
11 more
  1. 2022Mean-Field Langevin Dynamics: Exponential Convergence and Annealingcited by 60
  2. 2021Kernel Stein Discrepancy Descentcited by 57
  3. 2019Accelerating Langevin Sampling with Birth-deathcited by 45
  4. 2018Scaling limit of the Stein variational gradient descent: the mean field regimecited by 35
  5. 2019Analysis of a Two-Layer Neural Network via Displacement Convexitycited by 27
  6. 2015The Bouncy Particle Sampler: A Non-Reversible Rejection-Free Markov Chain Monte Carlo Methodcited by 26
  7. 2019Global convergence of neuron birth-death dynamicscited by 22
  8. 2016A consensus-based model for global optimization and its mean-field limitcited by 21
  9. 2022Polyak-L ojasiewicz inequality on the space of measures and convergence of mean-field birth-death processescited by 6
  10. 2022Second Order Ensemble Langevin Method for Sampling and Inverse Problemscited by 6
  11. 2018On optimal transport of matrix-valued measurescited by 4

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2022: 1; 2023: 6; 2024: 10; 2025: 9; 2026: 4.

30 papers.

Sort:

By area:

  1. 2023Learning Gaussian Mixtures Using the Wasserstein-Fisher-Rao Gradient Flowcited by 25
  2. 2023Sampling via Gradient Flows in the Space of Probability Measurescited by 20
  3. 2025Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approachcited by 18
  4. 2023An Explicit Expansion of the Kullback-Leibler Divergence along its Fisher-Rao Gradient Flowcited by 16
  5. 2023A connection between Tempering and Entropic Mirror Descentcited by 16
  6. 2022Two-Scale Gradient Descent Ascent Dynamics Finds Mixed Nash Equilibria of Continuous Games: A Mean-Field Perspectivecited by 13
  7. 2024Fisher-Rao Gradient Flow: Geodesic Convexity and Functional Inequalitiescited by 13
  8. 2024Stein transport for Bayesian inferencecited by 11
  9. 2025Weighted quantization using MMD: From mean field to mean shift via gradient flowscited by 10
  10. 2024Efficient, Multimodal, and Derivative-Free Bayesian Inference With Fisher-Rao Gradient Flowscited by 9
  11. 2024Interaction-Force Transport Gradient Flowscited by 7
  12. 2024Kernel Approximation of Fisher-Rao Gradient Flowscited by 7
18 more
  1. 2025Hellinger-Kantorovich Gradient Flows: Global Exponential Decay of Entropy Functionalscited by 7
  2. 2025Sequential Monte Carlo approximations of Wasserstein--Fisher--Rao gradient flowscited by 5
  3. 2023Accelerate Langevin Sampling with Birth-Death Process and Exploration Componentcited by 4
  4. 2024Ensemble-Based Annealed Importance Samplingcited by 4
  5. 2024Inclusive KL Gradient Flows: Otto-Wasserstein, Fisher-Rao-Gaussian, and Local-Estimator Dynamicscited by 4
  6. 2024Connections between sequential Bayesian inference and evolutionary dynamicscited by 4
  7. 2025New affine invariant ensemble samplers and their dimensional scalingcited by 4
  8. 2025A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flowscited by 4
  9. 2023Multi-Objective Optimization via Wasserstein-Fisher-Rao Gradient Flowcited by 3
  10. 2024A Fisher-Rao gradient flow for entropic mean-field min-max gamescited by 3
  11. 2024A Particle Algorithm for Mean-Field Variational Inferencecited by 3
  12. 2025Stable Derivative Free Gaussian Mixture Variational Inference for Bayesian Inverse Problemscited by 3
  13. 2025Gradient Flow Sampler-based Distributionally Robust Optimizationcited by 2
  14. 2025An operator splitting analysis of Wasserstein--Fisher--Rao gradient flowscited by 2
  15. 2026On propagation of chaos for the Fisher-Rao gradient flow in entropic mean-field optimizationcited by 0
  16. 2026Properties and limitations of geometric tempering for gradient flow dynamicscited by 0
  17. 2026Nesterov acceleration in optimizing over probability measurescited by 0
  18. 2026Preservation of Log-Concavity and Convergence of Wasserstein-Fisher-Rao Gradient Flowscited by 0