Notes on Computational Hardness of Hypothesis Testing: Predictions using the Low-Degree Likelihood Ratio
Not on the map. Why?
Abstract (arXiv)
These notes survey and explore an emerging method, which we call the low-degree method, for predicting and understanding statistical-versus-computational tradeoffs in high-dimensional inference problems. In short, the method posits that a certain quantity -- the second moment of the low-degree likelihood ratio -- gives insight into how much computational time is required to solve a given hypothesis testing problem, which can in turn be used to predict the computational hardness of a variety of statistical inference tasks. While this method originated in the study of the sum-of-squares (SoS) hierarchy of convex programs, we present a self-contained introduction that does not require knowledge of SoS. In addition to showing how to carry out predictions using the method, we include a discussion investigating both rigorous and conjectural consequences of these predictions. These notes include some new results, simplified proofs, and refined conjectures. For instance, we point out a formal connection between spectral methods and the low-degree likelihood ratio, and we give a sharp low-degree lower bound against subexponential-time algorithms for tensor PCA.
Key facts. Cited by 85 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 15; 2023: 13; 2024: 18; 2025: 17; 2026: 9.
85 papers.
Sort:
By area:
- 2023Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Modelscited by 61
- 2024Computational-Statistical Gaps in Gaussian Single-Index Modelscited by 44
- 2022The Franz-Parisi Criterion and Computational Trade-offs in High Dimensional Statisticscited by 31
- 2021Statistical Query Lower Bounds for List-Decodable Linear Regressioncited by 25
- 2021Lattice-Based Methods Surpass Sum-of-Squares in Clusteringcited by 25
- 2022Robust Sparse Mean Estimation via Sum of Squarescited by 24
- 2024Bayes-optimal learning of an extensive-width neural network from quadratically many samplescited by 23
- 2021Testing network correlation efficiently via counting treescited by 22
- 2021Optimal Spectral Recovery of a Planted Vector in a Subspacecited by 21
- 2021On the Cryptographic Hardness of Learning Single Periodic Neuronscited by 20
- 2022Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplaycited by 15
- 2024On the Complexity of Learning Sparse Functions with Statistical and Gradient Queriescited by 15
38 more
- 2021The Algorithmic Phase Transition of Random k-SAT for Low Degree Polynomialscited by 14
- 2021Clustering a Mixture of Gaussians with Unknown Covariancecited by 14
- 2022Statistical limits of correlation detection in treescited by 12
- 2024Sliding down the stairs: how correlated latent variables accelerate learning with neural networkscited by 12
- 2024Posterior Sampling with Denoising Oracles via Tilted Transportcited by 12
- 2021Reconstruction on Trees and Low-Degree Polynomialscited by 10
- 2022Statistical and Computational Phase Transitions in Group Testingcited by 10
- 2025The Generative Leap: Sharp Sample Complexity for Efficiently Learning Gaussian Multi-Index Modelscited by 9
- 2024Tensor cumulants for statistical inference on invariant distributionscited by 8
- 2021The Complexity of Sparse Tensor PCAcited by 7
- 2022Learning and Testing Latent-Tree Ising Models Efficientlycited by 7
- 2023Statistical-Computational Tradeoffs in Mixed Sparse Linear Regressioncited by 7
- 2023Detection of Dense Subhypergraphs by Low-Degree Polynomialscited by 7
- 2025Feature learning from non-Gaussian inputs: the case of Independent Component Analysis in high dimensionscited by 7
- 2022Optimal Estimation and Computational Limit of Low-rank Gaussian Mixturescited by 6
- 2022On free energy barriers in Gaussian priors and failure of cold start MCMC for high-dimensional unimodal distributionscited by 6
- 2022Average-Case Complexity of Tensor Decomposition for Low-Degree Polynomialscited by 6
- 2022Higher degree sum-of-squares relaxations robust against oblivious outlierscited by 6
- 2023Computational Lower Bounds for Graphon Estimation via Low-degree Polynomialscited by 6
- 2024Statistical Query Lower Bounds for Learning Truncated Gaussianscited by 6
- 2021Average-Case Communication Complexity of Statistical Problemscited by 5
- 2022Optimal Clustering by Lloyd Algorithm for Low-Rank Mixture Modelcited by 5
- 2022Is it easier to count communities than find them?cited by 5
- 2022On the well-spread property and its relation to linear regressioncited by 4
- 2022Near-optimal fitting of ellipsoids to random pointscited by 4
- 2023Detection-Recovery Gap for Planted Dense Cyclescited by 4
- 2023Precise Error Rates for Computationally Efficient Testingcited by 4
- 2024Computational-Statistical Gaps for Improper Learning in Sparse Linear Regressioncited by 4
- 2024Lasso with Latents: Efficient Estimation, Covariate Rescaling, and Computational-Statistical Gapscited by 4
- 2024On the phase diagram of extensive-rank symmetric matrix denoising beyond rotational invariancecited by 4
- 2025Phase Transition for Stochastic Block Model with more than √n Communities (II)cited by 4
- 2026High-Dimensional Statistics: Reflections on Progress and Open Problemscited by 4
- 2023SQ Lower Bounds for Random Sparse Planted Vector Problemcited by 3
- 2023Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networkscited by 3
- 2024Cryptographic Hardness of Score Estimationcited by 3
- 2024Semi-Supervised Sparse Gaussian Classification: Provable Benefits of Unlabeled Datacited by 3
- 2024Low coordinate degree algorithms II: Categorical signals and generalized stochastic block modelscited by 3
- 2025Computational Lower Bounds for Correlated Random Graphs via Algorithmic Contiguitycited by 3
50 most cited of 85 All 85 (JSON)
- 2026Slow Beats Fast at the Kesten-Stigum Threshold: Minimax, Fisher-Information and Belief-Propagation Characterizations of the Information-Computation Gap in Sparse Stochastic Block Models6 Oct 2026
- 2026Two-Sample Testing for Random Graphs without Vertex Correspondence5 Oct 2026
- 2026Efficiently Learning Drifting Halfspaces with Massart Noise9 Jun 2026
- 2026A Fourier perspective on the learning dynamics of neural networks: from sample complexities to mechanistic insights16 May 2026
- 2026High-Dimensional Statistics: Reflections on Progress and Open Problems6 May 2026
- 2026Computation-Utility-Privacy Tradeoffs in Bayesian Estimation18 Mar 2026
- 2026High-Dimensional Gaussian Mean Estimation under Realizable Contamination17 Mar 2026
- 2026Low-Degree Method Fails to Predict Robust Subspace Recovery3 Mar 2026
- 2026Low-degree Lower bounds for clustering in moderate dimension26 Feb 2026
- 2025Statistical and computational challenges in ranking24 Dec 2025
- 2025Phase Transition for Stochastic Block Model with more than √n Communities (II)26 Nov 2025
- 2025PTF Testing Lower Bounds for Non-Gaussian Component Analysis24 Nov 2025
38 more
- 2025Information-Computation Tradeoffs for Noiseless Linear Regression with Oblivious Contamination12 Oct 2025
- 2025Computational and statistical lower bounds for low-rank estimation under general inhomogeneous noise9 Oct 2025
- 2025Phase Transition for Stochastic Block Model with more than √n Communities19 Sep 2025
- 2025A Smooth Computational Transition in Tensor PCA12 Sep 2025
- 2025An Optimized Franz-Parisi Criterion and its Equivalence with SQ Lower Bounds6 Jun 2025
- 2025The Generative Leap: Sharp Sample Complexity for Efficiently Learning Gaussian Multi-Index Models5 Jun 2025
- 2025LLM Watermarking Using Mixtures and Statistical-to-Computational Gaps2 May 2025
- 2025High-dimensional Clustering and Signal Recovery under Block Signals11 Apr 2025
- 2025A Computational Transition for Detecting Multivariate Shuffled Linear Regression by Low-Degree Polynomials4 Apr 2025
- 2025Feature learning from non-Gaussian inputs: the case of Independent Component Analysis in high dimensions31 Mar 2025
- 2025Computational bottlenecks for denoising diffusions11 Mar 2025
- 2025Low degree conjecture implies sharp computational thresholds in stochastic block model20 Feb 2025
- 2025Computational Lower Bounds for Correlated Random Graphs via Algorithmic Contiguity14 Feb 2025
- 2025Recovering Imbalanced Clusters via Gradient-Based Projection Pursuit4 Feb 2025
- 2024Low coordinate degree algorithms II: Categorical signals and generalized stochastic block models30 Dec 2024
- 2024On the phase diagram of extensive-rank symmetric matrix denoising beyond rotational invariance4 Nov 2024
- 2024Testing Dependency of Weighted Random Graphs23 Sep 2024
- 2024Semi-Supervised Sparse Gaussian Classification: Provable Benefits of Unlabeled Data5 Sep 2024
- 2024Bayes-optimal learning of an extensive-width neural network from quadratically many samples7 Aug 2024
- 2024On the Complexity of Learning Sparse Functions with Statistical and Gradient Queries8 Jul 2024
- 2024Posterior Sampling with Denoising Oracles via Tilted Transport30 Jun 2024
- 2024Information-Theoretic Thresholds for the Alignments of Partially Correlated Graphs8 Jun 2024
- 2024Tensor cumulants for statistical inference on invariant distributions29 Apr 2024
- 2024Sliding down the stairs: how correlated latent variables accelerate learning with neural networks12 Apr 2024
- 2024Cryptographic Hardness of Score Estimation4 Apr 2024
- 2024Computational-Statistical Gaps in Gaussian Single-Index Models8 Mar 2024
- 2024Statistical Query Lower Bounds for Learning Truncated Gaussians4 Mar 2024
- 2024Lasso with Latents: Efficient Estimation, Covariate Rescaling, and Computational-Statistical Gaps23 Feb 2024
- 2024Computational-Statistical Gaps for Improper Learning in Sparse Linear Regression21 Feb 2024
- 2024Computationally efficient reductions between some statistical models12 Feb 2024
- 2024Low-degree phase transitions for detecting a planted clique in sublinear time8 Feb 2024
- 2024Information-Theoretic Thresholds for Planted Dense Cycles1 Feb 2024
- 2023Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks22 Dec 2023
- 2023Precise Error Rates for Computationally Efficient Testing1 Nov 2023
- 2023Computational Lower Bounds for Graphon Estimation via Low-degree Polynomials30 Aug 2023
- 2023SQ Lower Bounds for Learning Bounded Covariance GMMs22 Jun 2023
- 2023Bayes optimal learning in high-dimensional linear regression with network side information9 Jun 2023
- 2023Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Models18 May 2023
50 newest of 85 All 85 (JSON)
- 2024Posterior Sampling with Denoising Oracles via Tilted Transportcited by 12
- 2025Computational bottlenecks for denoising diffusionscited by 3
- 2025Computational bottlenecks for denoising diffusions11 Mar 2025
- 2024Posterior Sampling with Denoising Oracles via Tilted Transport30 Jun 2024
- 2023Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Modelscited by 61
- 2024Computational-Statistical Gaps in Gaussian Single-Index Modelscited by 44
- 2022The Franz-Parisi Criterion and Computational Trade-offs in High Dimensional Statisticscited by 31
- 2021Statistical Query Lower Bounds for List-Decodable Linear Regressioncited by 25
- 2021Lattice-Based Methods Surpass Sum-of-Squares in Clusteringcited by 25
- 2022Robust Sparse Mean Estimation via Sum of Squarescited by 24
- 2024Bayes-optimal learning of an extensive-width neural network from quadratically many samplescited by 23
- 2021Testing network correlation efficiently via counting treescited by 22
- 2021Optimal Spectral Recovery of a Planted Vector in a Subspacecited by 21
- 2021On the Cryptographic Hardness of Learning Single Periodic Neuronscited by 20
- 2022Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplaycited by 15
- 2024On the Complexity of Learning Sparse Functions with Statistical and Gradient Queriescited by 15
12 most cited of 82 All 82 (JSON)
- 2026Slow Beats Fast at the Kesten-Stigum Threshold: Minimax, Fisher-Information and Belief-Propagation Characterizations of the Information-Computation Gap in Sparse Stochastic Block Models6 Oct 2026
- 2026Two-Sample Testing for Random Graphs without Vertex Correspondence5 Oct 2026
- 2026Efficiently Learning Drifting Halfspaces with Massart Noise9 Jun 2026
- 2026A Fourier perspective on the learning dynamics of neural networks: from sample complexities to mechanistic insights16 May 2026
- 2026High-Dimensional Statistics: Reflections on Progress and Open Problems6 May 2026
- 2026Computation-Utility-Privacy Tradeoffs in Bayesian Estimation18 Mar 2026
- 2026High-Dimensional Gaussian Mean Estimation under Realizable Contamination17 Mar 2026
- 2026Low-Degree Method Fails to Predict Robust Subspace Recovery3 Mar 2026
- 2026Low-degree Lower bounds for clustering in moderate dimension26 Feb 2026
- 2025Statistical and computational challenges in ranking24 Dec 2025
- 2025Phase Transition for Stochastic Block Model with more than √n Communities (II)26 Nov 2025
- 2025PTF Testing Lower Bounds for Non-Gaussian Component Analysis24 Nov 2025
12 newest of 82 All 82 (JSON)