Muon on the Stiefel Manifold Admits an Exact Closed-Form Update
Not on the map. Why?
Abstract (arXiv)
We study Muon, a recently proposed matrix-aware optimization method, in the context of the Stiefel manifold. This manifold consists of matrices with orthonormal columns and is ubiquitous in machine learning and scientific computing. Existing extensions of Muon to this manifold rely on heuristic, approximate, or iterative updates with varying computational efficiency. We show that the corresponding Stiefel Muon update admits an exact closed-form solution and use this result to develop Skewon, a practical algorithm for orthogonality-constrained optimization with an efficient implementation. We further establish first-order convergence guarantees for Skewon in the smooth non-convex setting.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 21 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
8 of 21 references.
References · 8
- 2025The Polar Express: Optimal Matrix Sign Methods and Their Application to the Muon Algorithmcited by 110
- 2025PoLAR: Polar-Decomposed Low-Rank Adapter Representationcited by 20
- 2025LoRA meets Riemannion: Muon Optimizer for Parametrization-independent Low-Rank Adapterscited by 13
- 2026Insights on Muon from Simple Quadraticscited by 13
- 2026Manifold constrained steepest descent for smooth and closed-set optimizationcited by 8
- 2026Intrinsic Muon: Spectral Optimization on Riemannian Matrix Manifoldscited by 6
- 2026OrthoFuse: Training-free Riemannian Fusion of Orthogonal Style-Concept Adapters for Diffusion Modelscited by 2
- 2026Tensorion: A Tensor-Aware Generalization of the Muon Optimizercited by 1
Built on by
Not cited yet.