Optimization flows landing on the Stiefel manifold
Not on the map. Why?
Abstract (arXiv)
We study a continuous-time system that solves optimization problems over the set of orthonormal matrices, which is also known as the Stiefel manifold. The resulting optimization flow follows a path that is not always on the manifold but asymptotically lands on the manifold. We introduce a generalized Stiefel manifold to which we extend the canonical metric of the Stiefel manifold. We show that the vector field of the proposed flow can be interpreted as the sum of a Riemannian gradient on a generalized Stiefel manifold and a normal vector. Moreover, we prove that the proposed flow globally converges to the set of critical points, and any local minimum and isolated critical point is asymptotically stable.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Feb 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 1; 2026: 4.
10 papers.
- 2025PoLAR: Polar-Decomposed Low-Rank Adapter Representationcited by 20
- 2023Infeasible Deterministic, Stochastic, and Variance-Reduction Algorithms for Optimization under Orthogonality Constraintscited by 18
- 2023Orthogonal Directions Constrained Gradient Method: from non-linear equality constraints to Stiefel manifoldcited by 14
- 2024Optimization without Retraction on the Random Generalized Stiefel Manifoldcited by 7
- 2024Stiefel Flow Matching for Moment-Constrained Structure Elucidationcited by 5
- 2026Low-Rank Adaptation Redux for Large Modelscited by 3
- 2024Bounds on the geodesic distances on the Stiefel manifold for a family of Riemannian metricscited by 2
- 2026Scalable Variational Bayesian Fine-Tuning of LLMs via Orthogonalized Low-Rank Adapterscited by 2
- 2026A second-order method landing on the Stiefel manifold via Newtonunicodex2013Schulz iterationcited by 0
- 2026Optimization over the intersection of manifoldscited by 0
- 2026Optimization over the intersection of manifolds21 May 2026
- 2026A second-order method landing on the Stiefel manifold via Newtonunicodex2013Schulz iteration4 May 2026
- 2026Low-Rank Adaptation Redux for Large Models23 Apr 2026
- 2026Scalable Variational Bayesian Fine-Tuning of LLMs via Orthogonalized Low-Rank Adapters3 Apr 2026
- 2025PoLAR: Polar-Decomposed Low-Rank Adapter Representation3 Jun 2025
- 2024Stiefel Flow Matching for Moment-Constrained Structure Elucidation17 Dec 2024
- 2024Bounds on the geodesic distances on the Stiefel manifold for a family of Riemannian metrics25 Jul 2024
- 2024Optimization without Retraction on the Random Generalized Stiefel Manifold2 May 2024
- 2023Infeasible Deterministic, Stochastic, and Variance-Reduction Algorithms for Optimization under Orthogonality Constraints29 Mar 2023
- 2023Orthogonal Directions Constrained Gradient Method: from non-linear equality constraints to Stiefel manifold16 Mar 2023