mlsanityData to 14 Oct 2026

Nonnegative Low-rank Matrix Recovery Can Have Spurious Local Minima

arXiv 2505.03717 ↗First posted 6 May 2025math.OC cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Low-rank matrix recovery is well-known to exhibit benign nonconvexity under the restricted isometry property (RIP): every second-order critical point is globally optimal, so local methods provably recover the ground truth. Motivated by the strong empirical performance of projected gradient methods for nonnegative low-rank recovery problems, we investigate whether this benign geometry persists when the factor matrices are constrained to be elementwise nonnegative. In the simple setting of a rank-1 nonnegative ground truth, we confirm that benign nonconvexity holds in the fully-observed case with RIP constant δ=0. This benign nonconvexity, however, is unstable. It fails to extend to the partially-observed case with any arbitrarily small RIP constant δ>0, and to higher-rank ground truths rstar>1, regardless of how much the search rank r≥ rstar is overparameterized. Together, these results undermine the standard stability-based explanation for the empirical success of nonconvex methods and suggest that fundamentally different tools are needed to analyze nonnegative low-rank recovery.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 6 May 2025.

Builds on

19 of 30 references.

References · 19

  1. 2018Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overviewcited by 160
  2. 2017No Spurious Local Minima in Nonconvex Low Rank Problems: A Unified Geometric Analysiscited by 129
  3. 2016Matrix Completion has No Spurious Local Minimumcited by 125
  4. 2014Guaranteed Matrix Completion via Non-convex Factorizationcited by 82
  5. 2016Global Optimality of Local Search for Low Rank Matrix Recoverycited by 82
  6. 2014PageRank beyond the Webcited by 51
  7. 2016Non-square matrix sensing without spurious local minima via the Burer-Monteiro approachcited by 38
  8. 2017Global Optimality in Low-rank Matrix Optimizationcited by 36
  9. 2019Sharp Restricted Isometry Bounds for the Inexistence of Spurious Local Minima in Nonconvex Matrix Recoverycited by 27
  10. 2020Cutoff for exact recovery of Gaussian mixture modelscited by 18
  11. 2016On the low-rank approach for semidefinite programs arising in synchronization and community detectioncited by 17
  12. 2018Escaping Saddle Points in Constrained Optimizationcited by 14
7 more
  1. 2022Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterizationcited by 13
  2. 2023Statistically Optimal K-means Clustering via Nonnegative Low-rank Semidefinite Programmingcited by 9
  3. 2018How Much Restricted Isometry is Needed In Nonconvex Matrix Recovery?cited by 8
  4. 2021Finding stationary points on bounded-rank matrices: A geometric hurdle and a smooth remedycited by 6
  5. 2018Convergence to Second-Order Stationarity for Constrained Non-Convex Optimizationcited by 5
  6. 2021Sharp Global Guarantees for Nonconvex Low-rank Recovery in the Noisy Overparameterized Regimecited by 5
  7. 2019A Trust Region Method for Finding Second-Order Stationarity in Linearly Constrained Non-Convex Optimizationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.