List-Decodable Subspace Recovery: Dimension Independent Error in Polynomial Time
Not on the map. Why?
Abstract (arXiv)
In list-decodable subspace recovery, the input is a collection of n points α n (for some α ll 1/2) of which are drawn i.i.d. from a distribution D with a isotropic rank r covariance Pi_* (the inliers) and the rest are arbitrary, potential adversarial outliers. The goal is to recover a O(1/α) size list of candidate covariances that contains a hatPi close to Pi_*. Two recent independent works (Raghavendra-Yau, Bakshi-Kothari 2020) gave the first efficient algorithm for this problem. These results, however, obtain an error that grows with the dimension (linearly in [RY] and logarithmically in BK) at the cost of quasi-polynomial running time) and rely on certifiable anti-concentration - a relatively strict condition satisfied essentially only by the Gaussian distribution. In this work, we improve on these results on all three fronts: dimension-independent error via a faster fixed-polynomial running time under less restrictive distributional assumptions. Specifically, we give a poly(1/α) dO(1) time algorithm that outputs a list containing a hatPi satisfying |hatPi -Pi_*|F ≤ O(1/α). Our result only needs D to have certifiably hypercontractive degree 2 polynomials. As a result, in addition to Gaussians, our algorithm applies to the uniform distribution on the hypercube and q-ary cubes and arbitrary product distributions with subgaussian marginals. Prior work (Raghavendra and Yau, 2020) had identified such distributions as potential hard examples as such distributions do not exhibit strong enough anti-concentration. When D satisfies certifiable anti-concentration, we obtain a stronger error guarantee of |hatPi-Pi_*|F ≤ η for any arbitrary η > 0 in dO(poly(1/α) + log (1/η)) time.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 1; 2023: 2.
7 papers.
- 2021Robust and Differentially Private Mean Estimationcited by 66
- 2021Private Robust Estimation by Stabilizing Convex Relaxationscited by 38
- 2023A New Approach to Learning Linear Dynamical Systemscited by 23
- 2021Clustering Mixture Models in Almost-Linear Time via List-Decodable Mean Estimationcited by 21
- 2022List-Decodable Covariance Estimationcited by 8
- 2021Semi-verified PAC Learning from the Crowdcited by 4
- 2023Beyond Moments: Robustly Learning Affine Transformations with Asymptotically Optimal Errorcited by 4
- 2023Beyond Moments: Robustly Learning Affine Transformations with Asymptotically Optimal Error23 Feb 2023
- 2023A New Approach to Learning Linear Dynamical Systems23 Jan 2023
- 2022List-Decodable Covariance Estimation22 Jun 2022
- 2021Private Robust Estimation by Stabilizing Convex Relaxations7 Dec 2021
- 2021Clustering Mixture Models in Almost-Linear Time via List-Decodable Mean Estimation16 Jun 2021
- 2021Semi-verified PAC Learning from the Crowd13 Jun 2021
- 2021Robust and Differentially Private Mean Estimation18 Feb 2021