# ADMM for Nonsmooth Composite Optimization under Orthogonality Constraints

arXiv: https://arxiv.org/abs/2405.15129 · HTML: https://mlsanity.com/paper/2405.15129/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 May 2024.

## Built on by (most cited first, 1 of 1)

- [ADMM for Structured Fractional Minimization](https://mlsanity.com/paper/2411.07496/) (2024)

## Abstract (arXiv)

We consider a class of structured, nonconvex, nonsmooth optimization problems under orthogonality constraints, where the objectives combine a smooth function, a nonsmooth concave function, and a nonsmooth weakly convex function. This class of problems finds diverse applications in statistical learning and data science. Existing methods for addressing these problems often fail to exploit the specific structure of orthogonality constraints, struggle with nonsmooth functions, or result in suboptimal oracle complexity. We propose sf OADMM, an Alternating Direction Method of Multipliers (ADMM) designed to solve this class of problems using efficient proximal linearized strategies. Two specific variants of sf OADMM are explored: one based on Euclidean Projection (sf OADMM-EP) and the other on Riemannian Retraction (sf OADMM-RR). Under mild assumptions, we prove that sf OADMM converges to a critical point of the problem with an ergodic convergence rate of O(1/ε3). Additionally, we establish a polynomial convergence rate or super-exponential convergence rate for sf OADMM, depending on the specific setting, under the Kurdyka-Lojasiewicz (KL) inequality. To the best of our knowledge, this is textitthe first non-ergodic convergence result for this class of nonconvex nonsmooth optimization problems. Numerical experiments demonstrate that the proposed algorithm achieves state-of-the-art performance. Keywords: Orthogonality Constraints; Nonconvex Optimization; Nonsmooth Composite Optimization; ADMM; Convergence Analysis