# Variational Symplectic Accelerated Optimization on Lie Groups

arXiv: https://arxiv.org/abs/2103.14166 · HTML: https://mlsanity.com/paper/2103.14166/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 25 Mar 2021.

## Built on by (most cited first, 4 of 4)

- [Momentum Stiefel Optimizer, with Applications to Suitably-Orthogonal Attention, and Optimal Transport](https://mlsanity.com/paper/2205.14173/) (2022)
- [Projected Neural Differential Equations for Learning Constrained Dynamics](https://mlsanity.com/paper/2410.23667/) (2024)
- [A Discrete Variational Derivation of Accelerated Methods in Optimization](https://mlsanity.com/paper/2106.02700/) (2021)
- [Momentum-based gradient descent methods for Lie groups](https://mlsanity.com/paper/2404.09363/) (2024)

## Abstract (arXiv)

There has been significant interest in generalizations of the Nesterov accelerated gradient descent algorithm due to its improved performance guarantee compared to the standard gradient descent algorithm, and its applicability to large scale optimization problems arising in deep learning. A particularly fruitful approach is based on numerical discretizations of differential equations that describe the continuous time limit of the Nesterov algorithm, and a generalization involving time-dependent Bregman Lagrangian and Hamiltonian dynamics that converges at an arbitrarily fast rate to the minimum. We develop a Lie group variational discretization based on an extended path space formulation of the Bregman Lagrangian on Lie groups, and analyze its computational properties with two examples in attitude determination and vision-based localization.