mlsanityData to 7 Oct 2026

Low coordinate degree algorithms I: Universality of computational thresholds for hypothesis testing

arXiv 2403.07862 ↗First posted 12 Mar 2024math.ST cs.DS math.PRcited by 3

Not on the map. Why?

Abstract (arXiv)

We study when low coordinate degree functions (LCDF) -- linear combinations of functions depending on small subsets of entries of a vector -- can hypothesis test between high-dimensional probability measures. These functions are a generalization, proposed in Hopkins' 2018 thesis but seldom studied since, of low degree polynomials (LDP), a class widely used in recent literature as a proxy for all efficient algorithms for tasks in statistics and optimization. Instead of the orthogonal polynomial decompositions used in LDP calculations, our analysis of LCDF is based on the Efron-Stein or ANOVA decomposition, making it much more broadly applicable. By way of illustration, we prove channel universality for the success of LCDF in testing for the presence of sufficiently "dilute" random signals through noisy channels: the efficacy of LCDF depends on the channel only through the scalar Fisher information for a class of channels including nearly arbitrary additive i.i.d. noise and nearly arbitrary exponential families. As applications, we extend lower bounds against LDP for spiked matrix and tensor models under additive Gaussian noise to lower bounds against LCDF under general noisy channels. We also give a simple and unified treatment of the effect of censoring models by erasing observations at random and of quantizing models by taking the sign of the observations. These results are the first computational lower bounds against any large class of algorithms for all of these models when the channel is not one of a few special cases, and thereby give the first substantial evidence for the universality of several statistical-to-computational gaps.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 22 of its 91 references that are in the map. First posted on arXiv 12 Mar 2024.

Builds on

22 of 91 references.

References · 22

  1. 2018Contextual Stochastic Block Modelscited by 134
  2. 2020Statistical Query Algorithms and Low-Degree Tests Are Almost Equivalentcited by 51
  3. 2019Subexponential-Time Algorithms for Sparse PCAcited by 41
  4. 2018Reducibility and Computational Lower Bounds for Problems with Planted Sparse Structurecited by 35
  5. 2022The Franz-Parisi Criterion and Computational Trade-offs in High Dimensional Statisticscited by 31
  6. 2018High-dimensional estimation via sum-of-squares proofscited by 25
  7. 2021Lattice-Based Methods Surpass Sum-of-Squares in Clusteringcited by 25
  8. 2017On the Optimization Landscape of Tensor Decompositionscited by 21
  9. 2017The Computer Science and Physics of Community Detection: Landscapes, Phase Transitions, and Hardnesscited by 20
  10. 2021Non-Gaussian Component Analysis via Lattice Basis Reductioncited by 14
  11. 2019Universality of Computational Lower Bounds for Submatrix Detectioncited by 13
  12. 2019Optimal Average-Case Reductions to Sparse PCA: From Weak Assumptions to Strong Hardnesscited by 13
10 more
  1. 2020Counterexamples to the Low-Degree Conjecturecited by 12
  2. 2019The Planted Matching Problem: Phase Transitions and Exact Resultscited by 10
  3. 2021Reconstruction on Trees and Low-Degree Polynomialscited by 10
  4. 2022Statistical and Computational Phase Transitions in Group Testingcited by 10
  5. 2019The Landscape of the Planted Clique Problem: Dense subgraphs and the Overlap Gap Propertycited by 9
  6. 2021The planted matching problem: Sharp threshold and infinite-order phase transitioncited by 9
  7. 2018Adapting to Unknown Noise Distribution in Matrix Denoisingcited by 5
  8. 2022Is it easier to count communities than find them?cited by 4
  9. 2023Precise Error Rates for Computationally Efficient Testingcited by 4
  10. 2023Finding planted cliques using gradient descentcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.