Fisher information dissipation for time inhomogeneous stochastic differential equations
Not on the map. Why?
Abstract (arXiv)
We provide a Lyapunov convergence analysis for time-inhomogeneous variable coefficient stochastic differential equations (SDEs). Three typical examples include overdamped, irreversible drift, and underdamped Langevin dynamics. We first formula the probability transition equation of Langevin dynamics as a modified gradient flow of the Kullback-Leibler divergence in the probability space with respect to time-dependent optimal transport metrics. This formulation contains both gradient and non-gradient directions depending on a class of time-dependent target distribution. We then select a time-dependent relative Fisher information functional as a Lyapunov functional. We develop a time-dependent Hessian matrix condition, which guarantees the convergence of the probability density function of the SDE. We verify the proposed conditions for several time-inhomogeneous Langevin dynamics. For the overdamped Langevin dynamics, we prove the O(t-1/2) convergence in L1 distance for the simulated annealing dynamics with a strongly convex potential function. For the irreversible drift Langevin dynamics, we prove an improved convergence towards the target distribution in an asymptotic regime. We also verify the convergence condition for the underdamped Langevin dynamics. Numerical examples demonstrate the convergence results for the time-dependent Langevin dynamics.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 15 of its 59 references that are in the map. First posted on arXiv 1 Feb 2024.
Builds on
15 of 59 references.
References · 15
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
- 2014Theoretical guarantees for approximate sampling from smooth and log-concave densitiescited by 206
- 2015A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insightscited by 203
- 2017Underdamped Langevin MCMC: A non-asymptotic analysiscited by 131
- 2019The Randomized Midpoint Method for Log-Concave Samplingcited by 77
- 2022Mean-Field Langevin Dynamics: Exponential Convergence and Annealingcited by 60
- 2017Beyond Log-concavity: Provable Guarantees for Sampling Multi-modal Distributions using Simulated Tempering Langevin Monte Carlocited by 33
- 2023Improved Discretization Analysis for Underdamped Langevin Monte Carlocited by 26
- 2019First-order optimization algorithms via inertial systems with Hessian driven dampingcited by 22
- 2020State-Dependent Temperature Control for Langevin Diffusionscited by 17
- 2017Nonreversible Langevin Samplers: Splitting Schemes, Analysis and Implementationcited by 8
- 2021Simulated annealing from continuum to discretization: a convergence analysis via the Eyring--Kramers lawcited by 5
Built on by
Citing papers per year: 2025: 2.
2 papers.