# Multipliers Correction Methods for Optimization Problems over the Stiefel Manifold

arXiv: https://arxiv.org/abs/2011.14781 · HTML: https://mlsanity.com/paper/2011.14781/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Nov 2020.

## Built on by (most cited first, 4 of 4)

- [Decentralized Optimization Over the Stiefel Manifold by an Approximate Augmented Lagrangian Function](https://mlsanity.com/paper/2112.14949/) (2021)
- [A Variance-Reduced Stochastic Gradient Tracking Algorithm for Decentralized Optimization with Orthogonality Constraints](https://mlsanity.com/paper/2208.13643/) (2022)
- [Enhancing Distributional Robustness in Principal Component Analysis by Wasserstein Distances](https://mlsanity.com/paper/2503.02494/) (2025)
- [A Support-Set Algorithm for Optimization Problems with Nonnegative and Orthogonal Constraints](https://mlsanity.com/paper/2511.03443/) (2025)

## Abstract (arXiv)

We propose a class of multipliers correction methods to minimize a differentiable function over the Stiefel manifold. The proposed methods combine a function value reduction step with a proximal correction step. The former one searches along an arbitrary descent direction in the Euclidean space instead of a vector in the tangent space of the Stiefel manifold. Meanwhile, the latter one minimizes a first-order proximal approximation of the objective function in the range space of the current iterate to make Lagrangian multipliers associated with orthogonality constraints symmetric at any accumulation point. The global convergence has been established for the proposed methods. Preliminary numerical experiments demonstrate that the new methods significantly outperform other state-of-the-art first-order approaches in solving various kinds of testing problems.