SQ Lower Bounds for Random Sparse Planted Vector Problem
Not on the map. Why?
Abstract (arXiv)
Consider the setting where a ρ-sparse Rademacher vector is planted in a random d-dimensional subspace of Rn. A classical question is how to recover this planted vector given a random basis in this subspace. A recent result by [ZSWB21] showed that the Lattice basis reduction algorithm can recover the planted vector when n≥ d+1. Although the algorithm is not expected to tolerate inverse polynomial amount of noise, it is surprising because it was previously shown that recovery cannot be achieved by low degree polynomials when nll ρ2 d2 [MW21]. A natural question is whether we can derive an Statistical Query (SQ) lower bound matching the previous low degree lower bound in [MW21]. This will - imply that the SQ lower bound can be surpassed by lattice based algorithms; - predict the computational hardness when the planted vector is perturbed by inverse polynomial amount of noise. In this paper, we prove such an SQ lower bound. In particular, we show that super-polynomial number of VSTAT queries is needed to solve the easier statistical testing problem when nll ρ2 d2 and ρgg frac1√d. The most notable technique we used to derive the SQ lower bound is the almost equivalence relationship between SQ lower bound and low degree lower bound [BBH+20, MW21].
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 26 Jan 2023.
Builds on
23 of 38 references.
References · 23
- 2016Statistical Query Lower Bounds for Robust Estimation of High-dimensional Gaussians and Gaussian Mixturescited by 115
- 2019Notes on Computational Hardness of Hypothesis Testing: Predictions using the Low-Degree Likelihood Ratiocited by 85
- 2020Statistical Query Algorithms and Low-Degree Tests Are Almost Equivalentcited by 51
- 2019Subexponential-Time Algorithms for Sparse PCAcited by 41
- 2020Computational Barriers to Estimation from Low-Degree Polynomialscited by 39
- 2015Fast spectral algorithms from sum-of-squares proofs: tensor decomposition and planted sparse vectorscited by 38
- 2020Continuous LWEcited by 37
- 2017Bayesian estimation from few samples: community detection and related problemscited by 28
- 2022Continuous LWE is as Hard as LWE & Applications to Learning Gaussian Mixturescited by 26
- 2021Lattice-Based Methods Surpass Sum-of-Squares in Clusteringcited by 25
- 2021Optimal Spectral Recovery of a Planted Vector in a Subspacecited by 21
- 2014Finding a sparse vector in a subspace: Linear sparsity using alternating directionscited by 18
11 more
- 2020Sparse PCA: Algorithms, Adversarial Perturbations and Certificatescited by 18
- 2020Optimal Low-Degree Hardness of Maximum Independent Setcited by 16
- 2021The Algorithmic Phase Transition of Random k-SAT for Low Degree Polynomialscited by 14
- 2021Clustering a Mixture of Gaussians with Unknown Covariancecited by 14
- 2021Non-Gaussian Component Analysis via Lattice Basis Reductioncited by 14
- 2020Finding the Sparsest Vectors in a Subspace: Theory, Algorithms, and Applicationscited by 13
- 2013Rounding Sum-of-Squares Relaxationscited by 11
- 2020Statistical Query Lower Bounds for Tensor PCAcited by 11
- 2013Scaling Law for Recovering the Sparsest Element in a Subspacecited by 8
- 2020Hypothesis testing with low-degree polynomials in the Morris class of exponential familiescited by 7
- 2022On the well-spread property and its relation to linear regressioncited by 4
Built on by
Citing papers per year: 2023: 1; 2024: 2.
3 papers.