mlsanityData to 7 Oct 2026

Low coordinate degree algorithms II: Categorical signals and generalized stochastic block models

arXiv 2412.21155 ↗First posted 30 Dec 2024math.ST cs.DS math.COcited by 2

Not on the map. Why?

Abstract (arXiv)

We study when low coordinate degree functions (LCDF) -- linear combinations of functions depending on small subsets of entries of a vector -- can test for the presence of categorical structure, including community structure and generalizations thereof, in high-dimensional data. This complements the first paper of this series, which studied the power of LCDF in testing for continuous structure like real-valued signals perturbed by additive noise. We apply the tools developed there to a general form of stochastic block model (SBM), where a population is assigned random labels and every p-tuple of the population generates an observation according to an arbitrary probability measure associated to the p labels of its members. We show that the performance of LCDF admits a unified analysis for this class of models. As applications, we prove tight lower bounds against LCDF (and therefore also against low degree polynomials) for nearly arbitrary graph and regular hypergraph SBMs, always matching suitable generalizations of the Kesten-Stigum threshold. We also prove tight lower bounds for group synchronization and abelian group sumset problems under the "truth-or-Haar" noise model, and use our technical results to give an improved analysis of Gaussian multi-frequency group synchronization. In most of these models, for some parameter settings our lower bounds give new evidence for conjectural statistical-to-computational gaps. Finally, interpreting some of our findings, we propose a precise analogy between categorical and continuous signals: a general SBM as above behaves, in terms of the tradeoff between subexponential runtime cost of testing algorithms and the signal strength needed for a testing algorithm to succeed, like a spiked p_*-tensor model of a certain order p_* that may be computed from the parameters of the SBM.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 30 Dec 2024.

Builds on

25 of 42 references.

References · 25

  1. 2019Notes on Computational Hardness of Hypothesis Testing: Predictions using the Low-Degree Likelihood Ratiocited by 82
  2. 2017The power of sum-of-squares for detecting hidden structurescited by 54
  3. 2020Statistical Query Algorithms and Low-Degree Tests Are Almost Equivalentcited by 51
  4. 2019Subexponential-Time Algorithms for Sparse PCAcited by 41
  5. 2022The Franz-Parisi Criterion and Computational Trade-offs in High Dimensional Statisticscited by 31
  6. 2019Computational Hardness of Certifying Bounds on Constrained PCA Problemscited by 30
  7. 2017Bayesian estimation from few samples: community detection and related problemscited by 28
  8. 2015Non-backtracking spectrum of random graphs: community detection and non-regular Ramanujan graphscited by 26
  9. 2019The Kikuchi Hierarchy and Tensor PCAcited by 15
  10. 2015Spectral Detection on Sparse Hypergraphscited by 14
  11. 2020Spectral Planting and the Hardness of Refuting Cuts, Colorability, and Communities in Random Graphscited by 13
  12. 2019Community detection in the sparse hypergraph stochastic block modelcited by 11
13 more
  1. 2021Reconstruction on Trees and Low-Degree Polynomialscited by 10
  2. 2022Statistical and Computational Phase Transitions in Group Testingcited by 10
  3. 2016Strongly Refuting Random CSPs Below the Spectral Thresholdcited by 9
  4. 2023Time-Uniform Self-Normalized Concentration for Vector-Valued Processescited by 9
  5. 2014Decoding binary node labels from censored edge measurements: Phase transition and efficient recoverycited by 8
  6. 2020Hypothesis testing with low-degree polynomials in the Morris class of exponential familiescited by 7
  7. 2023Is Planted Coloring Easier than Planted Clique?cited by 7
  8. 2016Optimality and Sub-optimality of PCA for Spiked Random Matrices and Synchronizationcited by 6
  9. 2015Spectral Detection in the Censored Block Modelcited by 5
  10. 2022Sparse random hypergraphs: Non-backtracking spectra and community detectioncited by 5
  11. 2022Nonbacktracking spectral clustering of nonuniform hypergraphscited by 4
  12. 2022Is it easier to count communities than find them?cited by 4
  13. 2014Edge Label Inference in Generalized Stochastic Block Models: from Spectral Theory to Impossibility Resultscited by 1

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.