A Continuous-time Perspective for Modeling Acceleration in Riemannian Optimization
Not on the map. Why?
Abstract (arXiv)
We propose a novel second-order ODE as the continuous-time limit of a Riemannian accelerated gradient-based method on a manifold with curvature bounded from below. This ODE can be seen as a generalization of the ODE derived for Euclidean spaces, and can also serve as an analysis tool. We study the convergence behavior of this ODE for different classes of functions, such as geodesically convex, strongly-convex and weakly-quasi-convex. We demonstrate how such an ODE can be discretized using a semi-implicit and Nesterov-inspired numerical integrator, that empirically yields stable algorithms which are faithful to the continuous-time analysis and exhibit accelerated convergence.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 8; 2023: 4; 2024: 6; 2025: 4; 2026: 1.
25 papers.
Sort:
- 2021On Riemannian Stochastic Approximation Schemes with Fixed Step-Sizecited by 12
- 2022Differentially private Riemannian optimizationcited by 12
- 2022First-Order Algorithms for Min-Max Optimization in Geodesic Metric Spacescited by 10
- 2023Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learningcited by 10
- 2022Sion's Minimax Theorem in Geodesic Metric Spaces and a Riemannian Extragradient Algorithmcited by 9
- 2021Revisiting the Role of Euler Numerical Integration on Acceleration and Stability in Convex Optimizationcited by 6
- 2022Shape And Structure Preserving Differential Privacycited by 6
- 2023Minimizing Dynamic Regret on Geodesic Metric Spacescited by 6
- 2022Riemannian accelerated gradient methods via extrapolationcited by 5
- 2024Federated Learning on Riemannian Manifolds with Differential Privacycited by 5
- 2024Projected Neural Differential Equations for Learning Constrained Dynamicscited by 5
- 2022Accelerated Riemannian Optimization: Handling Constraints with a Prox to Bound Geometric Penaltiescited by 4
13 more
- 2023Riemannian Projection-free Online Learningcited by 4
- 2025Decentralized Online Riemannian Optimization Beyond Hadamard Manifoldscited by 4
- 2024A Framework for Bilevel Optimization on Riemannian Manifoldscited by 3
- 2025Online Optimization on Hadamard Manifolds: Curvature Independent Regret Bounds on Horospherically Convex Objectivescited by 3
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problemscited by 2
- 2025Accelerated Markov Chain Monte Carlo Algorithms on Discrete Statescited by 2
- 2022Riemannian Stochastic Gradient Method for Nested Composition Optimizationcited by 1
- 2022Rieoptax: Riemannian Optimization in JAXcited by 1
- 2023Extragradient Type Methods for Riemannian Variational Inequality Problemscited by 1
- 2024Quantitative Convergences of Lie Group Momentum Optimizerscited by 1
- 2024Learning-Rate-Free Stochastic Optimization over Riemannian Manifoldscited by 1
- 2026Decentralized Online Riemannian Optimization for Strongly Geodesically Convex Functionscited by 1
- 2024Generalized Continuous-Time Models for Nesterov's Accelerated Gradient Methodscited by 0
- 2026Decentralized Online Riemannian Optimization for Strongly Geodesically Convex Functions22 Jul 2026
- 2025Online Optimization on Hadamard Manifolds: Curvature Independent Regret Bounds on Horospherically Convex Objectives14 Sep 2025
- 2025Decentralized Online Riemannian Optimization Beyond Hadamard Manifolds9 Sep 2025
- 2025Accelerated Markov Chain Monte Carlo Algorithms on Discrete States19 May 2025
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problems20 Mar 2025
- 2024Projected Neural Differential Equations for Learning Constrained Dynamics31 Oct 2024
- 2024Generalized Continuous-Time Models for Nesterov's Accelerated Gradient Methods2 Sep 2024
- 2024Learning-Rate-Free Stochastic Optimization over Riemannian Manifolds4 Jun 2024
- 2024Quantitative Convergences of Lie Group Momentum Optimizers30 May 2024
- 2024Federated Learning on Riemannian Manifolds with Differential Privacy15 Apr 2024
- 2024A Framework for Bilevel Optimization on Riemannian Manifolds6 Feb 2024
- 2023Extragradient Type Methods for Riemannian Variational Inequality Problems25 Sep 2023
13 more
- 2023Riemannian Projection-free Online Learning30 May 2023
- 2023Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning20 Feb 2023
- 2023Minimizing Dynamic Regret on Geodesic Metric Spaces17 Feb 2023
- 2022Accelerated Riemannian Optimization: Handling Constraints with a Prox to Bound Geometric Penalties26 Nov 2022
- 2022Rieoptax: Riemannian Optimization in JAX10 Oct 2022
- 2022Shape And Structure Preserving Differential Privacy21 Sep 2022
- 2022Riemannian accelerated gradient methods via extrapolation13 Aug 2022
- 2022Riemannian Stochastic Gradient Method for Nested Composition Optimization19 Jul 2022
- 2022First-Order Algorithms for Min-Max Optimization in Geodesic Metric Spaces4 Jun 2022
- 2022Differentially private Riemannian optimization19 May 2022
- 2022Sion's Minimax Theorem in Geodesic Metric Spaces and a Riemannian Extragradient Algorithm13 Feb 2022
- 2021Revisiting the Role of Euler Numerical Integration on Acceleration and Stability in Convex Optimization23 Feb 2021
- 2021On Riemannian Stochastic Approximation Schemes with Fixed Step-Size15 Feb 2021
- 2021On Riemannian Stochastic Approximation Schemes with Fixed Step-Sizecited by 12
- 2022Differentially private Riemannian optimizationcited by 12
- 2022First-Order Algorithms for Min-Max Optimization in Geodesic Metric Spacescited by 10
- 2023Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learningcited by 10
- 2022Sion's Minimax Theorem in Geodesic Metric Spaces and a Riemannian Extragradient Algorithmcited by 9
- 2021Revisiting the Role of Euler Numerical Integration on Acceleration and Stability in Convex Optimizationcited by 6
- 2022Shape And Structure Preserving Differential Privacycited by 6
- 2023Minimizing Dynamic Regret on Geodesic Metric Spacescited by 6
- 2022Riemannian accelerated gradient methods via extrapolationcited by 5
- 2024Federated Learning on Riemannian Manifolds with Differential Privacycited by 5
- 2024Projected Neural Differential Equations for Learning Constrained Dynamicscited by 5
- 2022Accelerated Riemannian Optimization: Handling Constraints with a Prox to Bound Geometric Penaltiescited by 4
12 most cited of 25 All 25 (JSON)
- 2026Decentralized Online Riemannian Optimization for Strongly Geodesically Convex Functions22 Jul 2026
- 2025Online Optimization on Hadamard Manifolds: Curvature Independent Regret Bounds on Horospherically Convex Objectives14 Sep 2025
- 2025Decentralized Online Riemannian Optimization Beyond Hadamard Manifolds9 Sep 2025
- 2025Accelerated Markov Chain Monte Carlo Algorithms on Discrete States19 May 2025
- 2025Efficient Bayesian Computation Using Plug-and-Play Priors for Poisson Inverse Problems20 Mar 2025
- 2024Projected Neural Differential Equations for Learning Constrained Dynamics31 Oct 2024
- 2024Generalized Continuous-Time Models for Nesterov's Accelerated Gradient Methods2 Sep 2024
- 2024Learning-Rate-Free Stochastic Optimization over Riemannian Manifolds4 Jun 2024
- 2024Quantitative Convergences of Lie Group Momentum Optimizers30 May 2024
- 2024Federated Learning on Riemannian Manifolds with Differential Privacy15 Apr 2024
- 2024A Framework for Bilevel Optimization on Riemannian Manifolds6 Feb 2024
- 2023Extragradient Type Methods for Riemannian Variational Inequality Problems25 Sep 2023
12 newest of 25 All 25 (JSON)