How Many Samples is a Good Initial Point Worth in Low-rank Matrix Recovery?
Not on the map. Why?
Abstract (arXiv)
Given a sufficiently large amount of labeled data, the non-convex low-rank matrix recovery problem contains no spurious local minima, so a local optimization algorithm is guaranteed to converge to a global minimum starting from any initial guess. However, the actual amount of data needed by this theoretical guarantee is very pessimistic, as it must prevent spurious local minima from existing anywhere, including at adversarial locations. In contrast, prior work based on good initial guesses have more realistic data requirements, because they allow spurious local minima to exist outside of a neighborhood of the solution. In this paper, we quantify the relationship between the quality of the initial guess and the corresponding reduction in data requirements. Using the restricted isometry constant as a surrogate for sample complexity, we compute a sharp threshold number of samples needed to prevent each specific point on the optimization landscape from becoming a spurious local minimum. Optimizing the threshold over regions of the landscape, we see that for initial points around the ground truth, a linear improvement in the quality of the initial guess amounts to a constant factor improvement in the sample complexity.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 4; 2023: 1; 2024: 1.
10 papers.
- 2021On the computational and statistical complexity of over-parameterized matrix sensingcited by 31
- 2022Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterizationcited by 13
- 2021Fundamental limits for rank-one matrix estimation with groupwise heteroskedasticitycited by 8
- 2021Sharp Restricted Isometry Property Bounds for Low-rank Matrix Recovery Problems with Corrupted Measurementscited by 7
- 2022Noisy Low-rank Matrix Optimization: Geometry of Local Minima and Convergence Ratecited by 7
- 2022Semidefinite Programming versus Burer-Monteiro Factorization for Matrix Sensingcited by 5
- 2021Sharp Global Guarantees for Nonconvex Low-rank Recovery in the Noisy Overparameterized Regimecited by 3
- 2022Nonconvex Matrix Factorization is Geodesically Convex: Global Landscape Analysis for Fixed-rank Matrix Optimization From a Riemannian Perspectivecited by 3
- 2023Algorithmic Regularization in Tensor Optimization: Towards a Lifted Approach in Matrix Sensingcited by 1
- 2024Absence of spurious solutions far from ground truth: A low-rank analysis with high-order lossescited by 1
- 2024Absence of spurious solutions far from ground truth: A low-rank analysis with high-order losses10 Mar 2024
- 2023Algorithmic Regularization in Tensor Optimization: Towards a Lifted Approach in Matrix Sensing24 Oct 2023
- 2022Nonconvex Matrix Factorization is Geodesically Convex: Global Landscape Analysis for Fixed-rank Matrix Optimization From a Riemannian Perspective29 Sep 2022
- 2022Semidefinite Programming versus Burer-Monteiro Factorization for Matrix Sensing15 Aug 2022
- 2022Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterization5 Jul 2022
- 2022Noisy Low-rank Matrix Optimization: Geometry of Local Minima and Convergence Rate8 Mar 2022
- 2021Fundamental limits for rank-one matrix estimation with groupwise heteroskedasticity22 Jun 2021
- 2021Sharp Restricted Isometry Property Bounds for Low-rank Matrix Recovery Problems with Corrupted Measurements18 May 2021
- 2021Sharp Global Guarantees for Nonconvex Low-rank Recovery in the Noisy Overparameterized Regime21 Apr 2021
- 2021On the computational and statistical complexity of over-parameterized matrix sensing27 Jan 2021