Exact Guarantees on the Absence of Spurious Local Minima for Non-negative Rank-1 Robust Principal Component Analysis
Not on the map. Why?
Abstract (arXiv)
This work is concerned with the non-negative rank-1 robust principal component analysis (RPCA), where the goal is to recover the dominant non-negative principal components of a data matrix precisely, where a number of measurements could be grossly corrupted with sparse and arbitrary large noise. Most of the known techniques for solving the RPCA rely on convex relaxation methods by lifting the problem to a higher dimension, which significantly increase the number of variables. As an alternative, the well-known Burer-Monteiro approach can be used to cast the RPCA as a non-convex and non-smooth ℓ1 optimization problem with a significantly smaller number of variables. In this work, we show that the low-dimensional formulation of the symmetric and asymmetric positive rank-1 RPCA based on the Burer-Monteiro approach has benign landscape, i.e., 1) it does not have any spurious local solution, 2) has a unique global solution, and 3) its unique global solution coincides with the true components. An implication of this result is that simple local search algorithms are guaranteed to achieve a zero global optimality gap when directly applied to the low-dimensional formulation. Furthermore, we provide strong deterministic and probabilistic guarantees for the exact recovery of the true principal components. In particular, it is shown that a constant fraction of the measurements could be grossly corrupted and yet they would not create any spurious local solution.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 4; 2024: 2.
13 papers.
Sort:
- 2021Sign-RIP: A Robust Restricted Isometry Property for Low-rank Matrix Recoverycited by 10
- 2022Noisy Low-rank Matrix Optimization: Geometry of Local Minima and Convergence Ratecited by 8
- 2021Factorization Approach for Low-complexity Matrix Completion Problems: Exponential Number of Spurious Solutions and Failure of Gradient Methodscited by 6
- 2022Simple Alternating Minimization Provably Solves Complete Dictionary Learningcited by 6
- 2022Semidefinite Programming versus Burer-Monteiro Factorization for Matrix Sensingcited by 5
- 2023Over-parametrization via Lifting for Low-rank Matrix Sensing: Conversion of Spurious Solutions to Strict Saddle Pointscited by 5
- 2023Personalized Dictionary Learning for Heterogeneous Datasetscited by 5
- 2022Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decompositioncited by 4
- 2022Blessing of Nonconvexity in Deep Linear Models: Depth Flattens the Optimization Landscape Around the True Solutioncited by 3
- 2023Can Learning Be Explained By Local Optimality In Robust Low-rank Matrix Recovery?cited by 2
- 2023Algorithmic Regularization in Tensor Optimization: Towards a Lifted Approach in Matrix Sensingcited by 1
- 2024Absence of spurious solutions far from ground truth: A low-rank analysis with high-order lossescited by 1
- 2024ℓ1-norm rank-one symmetric matrix factorization has no spurious second-order stationary points7 Oct 2024
- 2024Absence of spurious solutions far from ground truth: A low-rank analysis with high-order losses10 Mar 2024
- 2023Algorithmic Regularization in Tensor Optimization: Towards a Lifted Approach in Matrix Sensing24 Oct 2023
- 2023Personalized Dictionary Learning for Heterogeneous Datasets24 May 2023
- 2023Can Learning Be Explained By Local Optimality In Robust Low-rank Matrix Recovery?21 Feb 2023
- 2023Over-parametrization via Lifting for Low-rank Matrix Sensing: Conversion of Spurious Solutions to Strict Saddle Points15 Feb 2023
- 2022Simple Alternating Minimization Provably Solves Complete Dictionary Learning23 Oct 2022
- 2022Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition1 Oct 2022
- 2022Semidefinite Programming versus Burer-Monteiro Factorization for Matrix Sensing15 Aug 2022
- 2022Blessing of Nonconvexity in Deep Linear Models: Depth Flattens the Optimization Landscape Around the True Solution15 Jul 2022
- 2022Noisy Low-rank Matrix Optimization: Geometry of Local Minima and Convergence Rate8 Mar 2022
- 2021Factorization Approach for Low-complexity Matrix Completion Problems: Exponential Number of Spurious Solutions and Failure of Gradient Methods19 Oct 2021
1 more
- 2021Sign-RIP: A Robust Restricted Isometry Property for Low-rank Matrix Recoverycited by 10
- 2022Noisy Low-rank Matrix Optimization: Geometry of Local Minima and Convergence Ratecited by 8
- 2021Factorization Approach for Low-complexity Matrix Completion Problems: Exponential Number of Spurious Solutions and Failure of Gradient Methodscited by 6
- 2022Simple Alternating Minimization Provably Solves Complete Dictionary Learningcited by 6
- 2022Semidefinite Programming versus Burer-Monteiro Factorization for Matrix Sensingcited by 5
- 2023Over-parametrization via Lifting for Low-rank Matrix Sensing: Conversion of Spurious Solutions to Strict Saddle Pointscited by 5
- 2023Personalized Dictionary Learning for Heterogeneous Datasetscited by 5
- 2022Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decompositioncited by 4
- 2022Blessing of Nonconvexity in Deep Linear Models: Depth Flattens the Optimization Landscape Around the True Solutioncited by 3
- 2023Can Learning Be Explained By Local Optimality In Robust Low-rank Matrix Recovery?cited by 2
- 2023Algorithmic Regularization in Tensor Optimization: Towards a Lifted Approach in Matrix Sensingcited by 1
- 2024Absence of spurious solutions far from ground truth: A low-rank analysis with high-order lossescited by 1
12 most cited of 13 All 13 (JSON)
- 2024ℓ1-norm rank-one symmetric matrix factorization has no spurious second-order stationary points7 Oct 2024
- 2024Absence of spurious solutions far from ground truth: A low-rank analysis with high-order losses10 Mar 2024
- 2023Algorithmic Regularization in Tensor Optimization: Towards a Lifted Approach in Matrix Sensing24 Oct 2023
- 2023Personalized Dictionary Learning for Heterogeneous Datasets24 May 2023
- 2023Can Learning Be Explained By Local Optimality In Robust Low-rank Matrix Recovery?21 Feb 2023
- 2023Over-parametrization via Lifting for Low-rank Matrix Sensing: Conversion of Spurious Solutions to Strict Saddle Points15 Feb 2023
- 2022Simple Alternating Minimization Provably Solves Complete Dictionary Learning23 Oct 2022
- 2022Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition1 Oct 2022
- 2022Semidefinite Programming versus Burer-Monteiro Factorization for Matrix Sensing15 Aug 2022
- 2022Blessing of Nonconvexity in Deep Linear Models: Depth Flattens the Optimization Landscape Around the True Solution15 Jul 2022
- 2022Noisy Low-rank Matrix Optimization: Geometry of Local Minima and Convergence Rate8 Mar 2022
- 2021Factorization Approach for Low-complexity Matrix Completion Problems: Exponential Number of Spurious Solutions and Failure of Gradient Methods19 Oct 2021
12 newest of 13 All 13 (JSON)