Nonnegative Low-rank Matrix Recovery Can Have Spurious Local Minima
Not on the map. Why?
Abstract (arXiv)
Low-rank matrix recovery is well-known to exhibit benign nonconvexity under the restricted isometry property (RIP): every second-order critical point is globally optimal, so local methods provably recover the ground truth. Motivated by the strong empirical performance of projected gradient methods for nonnegative low-rank recovery problems, we investigate whether this benign geometry persists when the factor matrices are constrained to be elementwise nonnegative. In the simple setting of a rank-1 nonnegative ground truth, we confirm that benign nonconvexity holds in the fully-observed case with RIP constant δ=0. This benign nonconvexity, however, is unstable. It fails to extend to the partially-observed case with any arbitrarily small RIP constant δ>0, and to higher-rank ground truths rstar>1, regardless of how much the search rank r≥ rstar is overparameterized. Together, these results undermine the standard stability-based explanation for the empirical success of nonconvex methods and suggest that fundamentally different tools are needed to analyze nonnegative low-rank recovery.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 6 May 2025.
Builds on
19 of 30 references.
References · 19
- 2018Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overviewcited by 160
- 2017No Spurious Local Minima in Nonconvex Low Rank Problems: A Unified Geometric Analysiscited by 129
- 2016Matrix Completion has No Spurious Local Minimumcited by 125
- 2014Guaranteed Matrix Completion via Non-convex Factorizationcited by 82
- 2016Global Optimality of Local Search for Low Rank Matrix Recoverycited by 82
- 2014PageRank beyond the Webcited by 51
- 2016Non-square matrix sensing without spurious local minima via the Burer-Monteiro approachcited by 38
- 2017Global Optimality in Low-rank Matrix Optimizationcited by 36
- 2019Sharp Restricted Isometry Bounds for the Inexistence of Spurious Local Minima in Nonconvex Matrix Recoverycited by 27
- 2020Cutoff for exact recovery of Gaussian mixture modelscited by 18
- 2016On the low-rank approach for semidefinite programs arising in synchronization and community detectioncited by 17
- 2018Escaping Saddle Points in Constrained Optimizationcited by 14
7 more
- 2022Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterizationcited by 13
- 2023Statistically Optimal K-means Clustering via Nonnegative Low-rank Semidefinite Programmingcited by 9
- 2018How Much Restricted Isometry is Needed In Nonconvex Matrix Recovery?cited by 8
- 2021Finding stationary points on bounded-rank matrices: A geometric hurdle and a smooth remedycited by 6
- 2018Convergence to Second-Order Stationarity for Constrained Non-Convex Optimizationcited by 5
- 2021Sharp Global Guarantees for Nonconvex Low-rank Recovery in the Noisy Overparameterized Regimecited by 5
- 2019A Trust Region Method for Finding Second-Order Stationarity in Linearly Constrained Non-Convex Optimizationcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.