mlsanityData to 7 Oct 2026

Convergence of Kinetic Langevin Monte Carlo on Lie groups

arXiv 2403.12012 ↗First posted 18 Mar 2024math.ST cs.LG cs.NAcited by 6

Not on the map. Why?

Abstract (arXiv)

Explicit, momentum-based dynamics for optimizing functions defined on Lie groups was recently constructed, based on techniques such as variational optimization and left trivialization. We appropriately add tractable noise to the optimization dynamics to turn it into a sampling dynamics, leveraging the advantageous feature that the trivialized momentum variable is Euclidean despite that the potential function lives on a manifold. We then propose a Lie-group MCMC sampler, by delicately discretizing the resulting kinetic-Langevin-type sampling dynamics. The Lie group structure is exactly preserved by this discretization. Exponential convergence with explicit convergence rate for both the continuous dynamics and the discrete sampler are then proved under W2 distance. Only compactness of the Lie group and geodesically L-smoothness of the potential function are needed. To the best of our knowledge, this is the first convergence result for kinetic Langevin on curved spaces, and also the first quantitative result that requires no convexity or, at least not explicitly, any common relaxation such as isoperimetry.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 11 of its 37 references that are in the map. First posted on arXiv 18 Mar 2024.

Builds on

11 of 37 references.

References · 11

  1. 2019Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Groupcited by 133
  2. 2017Underdamped Langevin MCMC: A non-asymptotic analysiscited by 131
  3. 2023Faster high-accuracy log-concave sampling via algorithmic warm startscited by 44
  4. 2023Improved Discretization Analysis for Underdamped Langevin Monte Carlocited by 26
  5. 2021Sqrt(d) Dimension Dependence of Langevin Monte Carlocited by 25
  6. 2022Convergence of the Riemannian Langevin Algorithmcited by 23
  7. 2020Fast Convergence of Langevin Dynamics on Manifold: Geodesics meet Log-Sobolevcited by 16
  8. 2018Towards Riemannian Accelerated Gradient Methodscited by 12
  9. 2020Variational Optimization on Lie Groups, with Examples of Leading (Generalized) Eigenvalue Problemscited by 12
  10. 2022Momentum Stiefel Optimizer, with Applications to Suitably-Orthogonal Attention, and Optimal Transportcited by 10
  11. 2024Efficient Sampling on Riemannian Manifolds via Langevin MCMCcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 2; 2026: 1.

6 papers.