mlsanityData to 14 Oct 2026

Notes on Computational Hardness of Hypothesis Testing: Predictions using the Low-Degree Likelihood Ratio

arXiv 1907.11636 ↗First posted 26 Jul 2019math.ST cs.CC cs.DScited by 85

Not on the map. Why?

Abstract (arXiv)

These notes survey and explore an emerging method, which we call the low-degree method, for predicting and understanding statistical-versus-computational tradeoffs in high-dimensional inference problems. In short, the method posits that a certain quantity -- the second moment of the low-degree likelihood ratio -- gives insight into how much computational time is required to solve a given hypothesis testing problem, which can in turn be used to predict the computational hardness of a variety of statistical inference tasks. While this method originated in the study of the sum-of-squares (SoS) hierarchy of convex programs, we present a self-contained introduction that does not require knowledge of SoS. In addition to showing how to carry out predictions using the method, we include a discussion investigating both rigorous and conjectural consequences of these predictions. These notes include some new results, simplified proofs, and refined conjectures. For instance, we point out a formal connection between spectral methods and the low-degree likelihood ratio, and we give a sharp low-degree lower bound against subexponential-time algorithms for tensor PCA.

Key facts. Cited by 85 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Jul 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 13; 2022: 15; 2023: 13; 2024: 18; 2025: 17; 2026: 9.

85 papers.

Sort:

By area:

  1. 2023Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Modelscited by 61
  2. 2024Computational-Statistical Gaps in Gaussian Single-Index Modelscited by 44
  3. 2022The Franz-Parisi Criterion and Computational Trade-offs in High Dimensional Statisticscited by 31
  4. 2021Statistical Query Lower Bounds for List-Decodable Linear Regressioncited by 25
  5. 2021Lattice-Based Methods Surpass Sum-of-Squares in Clusteringcited by 25
  6. 2022Robust Sparse Mean Estimation via Sum of Squarescited by 24
  7. 2024Bayes-optimal learning of an extensive-width neural network from quadratically many samplescited by 23
  8. 2021Testing network correlation efficiently via counting treescited by 22
  9. 2021Optimal Spectral Recovery of a Planted Vector in a Subspacecited by 21
  10. 2021On the Cryptographic Hardness of Learning Single Periodic Neuronscited by 20
  11. 2022Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplaycited by 15
  12. 2024On the Complexity of Learning Sparse Functions with Statistical and Gradient Queriescited by 15
38 more
  1. 2021The Algorithmic Phase Transition of Random k-SAT for Low Degree Polynomialscited by 14
  2. 2021Clustering a Mixture of Gaussians with Unknown Covariancecited by 14
  3. 2022Statistical limits of correlation detection in treescited by 12
  4. 2024Sliding down the stairs: how correlated latent variables accelerate learning with neural networkscited by 12
  5. 2024Posterior Sampling with Denoising Oracles via Tilted Transportcited by 12
  6. 2021Reconstruction on Trees and Low-Degree Polynomialscited by 10
  7. 2022Statistical and Computational Phase Transitions in Group Testingcited by 10
  8. 2025The Generative Leap: Sharp Sample Complexity for Efficiently Learning Gaussian Multi-Index Modelscited by 9
  9. 2024Tensor cumulants for statistical inference on invariant distributionscited by 8
  10. 2021The Complexity of Sparse Tensor PCAcited by 7
  11. 2022Learning and Testing Latent-Tree Ising Models Efficientlycited by 7
  12. 2023Statistical-Computational Tradeoffs in Mixed Sparse Linear Regressioncited by 7
  13. 2023Detection of Dense Subhypergraphs by Low-Degree Polynomialscited by 7
  14. 2025Feature learning from non-Gaussian inputs: the case of Independent Component Analysis in high dimensionscited by 7
  15. 2022Optimal Estimation and Computational Limit of Low-rank Gaussian Mixturescited by 6
  16. 2022On free energy barriers in Gaussian priors and failure of cold start MCMC for high-dimensional unimodal distributionscited by 6
  17. 2022Average-Case Complexity of Tensor Decomposition for Low-Degree Polynomialscited by 6
  18. 2022Higher degree sum-of-squares relaxations robust against oblivious outlierscited by 6
  19. 2023Computational Lower Bounds for Graphon Estimation via Low-degree Polynomialscited by 6
  20. 2024Statistical Query Lower Bounds for Learning Truncated Gaussianscited by 6
  21. 2021Average-Case Communication Complexity of Statistical Problemscited by 5
  22. 2022Optimal Clustering by Lloyd Algorithm for Low-Rank Mixture Modelcited by 5
  23. 2022Is it easier to count communities than find them?cited by 5
  24. 2022On the well-spread property and its relation to linear regressioncited by 4
  25. 2022Near-optimal fitting of ellipsoids to random pointscited by 4
  26. 2023Detection-Recovery Gap for Planted Dense Cyclescited by 4
  27. 2023Precise Error Rates for Computationally Efficient Testingcited by 4
  28. 2024Computational-Statistical Gaps for Improper Learning in Sparse Linear Regressioncited by 4
  29. 2024Lasso with Latents: Efficient Estimation, Covariate Rescaling, and Computational-Statistical Gapscited by 4
  30. 2024On the phase diagram of extensive-rank symmetric matrix denoising beyond rotational invariancecited by 4
  31. 2025Phase Transition for Stochastic Block Model with more than √n Communities (II)cited by 4
  32. 2026High-Dimensional Statistics: Reflections on Progress and Open Problemscited by 4
  33. 2023SQ Lower Bounds for Random Sparse Planted Vector Problemcited by 3
  34. 2023Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networkscited by 3
  35. 2024Cryptographic Hardness of Score Estimationcited by 3
  36. 2024Semi-Supervised Sparse Gaussian Classification: Provable Benefits of Unlabeled Datacited by 3
  37. 2024Low coordinate degree algorithms II: Categorical signals and generalized stochastic block modelscited by 3
  38. 2025Computational Lower Bounds for Correlated Random Graphs via Algorithmic Contiguitycited by 3

50 most cited of 85 All 85 (JSON)