mlsanityData to 7 Oct 2026

Computational Lower Bounds for Graphon Estimation via Low-degree Polynomials

arXiv 2308.15728 ↗First posted 30 Aug 2023math.ST cs.CC cs.DScited by 6

Not on the map. Why?

Abstract (arXiv)

Graphon estimation has been one of the most fundamental problems in network analysis and has received considerable attention in the past decade. From the statistical perspective, the minimax error rate of graphon estimation has been established by Gao et al (2015) for both stochastic block model and nonparametric graphon estimation. The statistical optimal estimators are based on constrained least squares and have computational complexity exponential in the dimension. From the computational perspective, the best-known polynomial-time estimator is based universal singular value thresholding, but it can only achieve a much slower estimation error rate than the minimax one. The computational optimality of the USVT or the existence of a computational barrier in graphon estimation has been a long-standing open problem. In this work, we provide rigorous evidence for the computational barrier in graphon estimation via low-degree polynomials. Specifically, in SBM graphon estimation, we show that for low-degree polynomial estimators, their estimation error rates cannot be significantly better than that of the USVT under a wide range of parameter regimes and in nonparametric graphon estimation, we show low-degree polynomial estimators achieve estimation error rates strictly slower than the minimax rate. Our results are proved based on the recent development of low-degree polynomials by Schramm and Wein (2022), while we overcome a few key challenges in applying it to the general graphon estimation problem. By leveraging our main results, we also provide a computational lower bound on the clustering error for community detection in SBM with a growing number of communities and this yields a new piece of evidence for the conjectured Kesten-Stigum threshold for efficient community recovery. Finally, we extend our computational lower bounds to sparse graphon estimation and biclustering.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 64 of its 125 references that are in the map. First posted on arXiv 30 Aug 2023.

Builds on

64 of 125 references.

References · 64

  1. 2017Community Detection and Stochastic Block Modelscited by 317
  2. 2013Consistency of spectral clustering in stochastic block modelscited by 128
  3. 2016Statistical Query Lower Bounds for Robust Estimation of High-dimensional Gaussians and Gaussian Mixturescited by 114
  4. 2019Notes on Computational Hardness of Hypothesis Testing: Predictions using the Low-Degree Likelihood Ratiocited by 82
  5. 2014Exact Recovery in the Stochastic Block Modelcited by 77
  6. 2018Efficient Algorithms and Lower Bounds for Robust Linear Regressioncited by 76
  7. 2017The power of sum-of-squares for detecting hidden structurescited by 54
  8. 2017Tensor SVD: Statistical and Computational Limitscited by 52
  9. 2020Statistical Query Algorithms and Low-Degree Tests Are Almost Equivalentcited by 51
  10. 2020Reducibility and Statistical-Computational Gaps from Secret Leakagecited by 50
  11. 2013Community detection thresholds and the weak Ramanujan propertycited by 47
  12. 2019Subexponential-Time Algorithms for Sparse PCAcited by 41
38 more
  1. 2013Stochastic blockmodel approximation of a graphon: Theory and consistent estimationcited by 38
  2. 2020Computational Barriers to Estimation from Low-Degree Polynomialscited by 38
  3. 2014A Consistent Histogram Estimator for Exchangeable Graph Modelscited by 36
  4. 2013A Proof Of The Block Model Threshold Conjecturecited by 35
  5. 2015Achieving Optimal Misclassification Proportion in Stochastic Block Modelcited by 35
  6. 2018Reducibility and Computational Lower Bounds for Problems with Planted Sparse Structurecited by 35
  7. 2015Stochastically Transitive Models for Pairwise Comparisons: Statistical and Computational Issuescited by 32
  8. 2022The Franz-Parisi Criterion and Computational Trade-offs in High Dimensional Statisticscited by 31
  9. 2019Computational Hardness of Certifying Bounds on Constrained PCA Problemscited by 30
  10. 2014Statistical-Computational Tradeoffs in Planted Problems and Submatrix Localization with a Growing Number of Clusters and Submatricescited by 29
  11. 2020Tensor Clustering with Planted Structures: Statistical Optimality and Computational Limitscited by 29
  12. 2015Estimating network edge probabilities by neighborhood smoothingcited by 28
  13. 2017Rates of Convergence of Spectral Methods for Graphon Estimationcited by 28
  14. 2014Statistical and computational trade-offs in estimation of sparse principal componentscited by 26
  15. 2014Sparse CCA: Adaptive Estimation and Computational Barrierscited by 25
  16. 2015Minimax Rates of Community Detection in Stochastic Block Modelscited by 25
  17. 2014Consistency Thresholds for the Planted Bisection Modelcited by 24
  18. 2013Limits of local algorithms over sparse random graphscited by 23
  19. 2014Computational Lower Bounds for Community Detection on Random Graphscited by 21
  20. 2014Community detection in sparse networks via Grothendieck's inequalitycited by 21
  21. 2021Optimal Spectral Recovery of a Planted Vector in a Subspacecited by 21
  22. 2013Network histograms and universality of blockmodel approximationcited by 20
  23. 2017The Computer Science and Physics of Community Detection: Landscapes, Phase Transitions, and Hardnesscited by 20
  24. 2015Private Graphon Estimation for Sparse Graphscited by 17
  25. 2016Information-theoretic thresholds for community detection in sparse networkscited by 17
  26. 2020Optimal Low-Degree Hardness of Maximum Independent Setcited by 16
  27. 2015Stochastic Block Model and Community Detection in the Sparse Graphs: A spectral algorithm with optimal rate of recoverycited by 15
  28. 2022Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplaycited by 15
  29. 2013On the Complexity of Random Satisfiability Problems with Planted Solutionscited by 14
  30. 2019Local Statistics, Semidefinite Programming, and Community Detectioncited by 14
  31. 2021The Algorithmic Phase Transition of Random k-SAT for Low Degree Polynomialscited by 14
  32. 2021Clustering a Mixture of Gaussians with Unknown Covariancecited by 14
  33. 2020Isotonic regression with unknown permutations: Statistics, computation, and adaptationcited by 13
  34. 2015Computational and Statistical Boundaries for Submatrix Localization in a Large Noisy Matrixcited by 12
  35. 2015Optimal Estimation and Completion of Matrices with Biclustering Structurescited by 12
  36. 2020Computationally efficient sparse clusteringcited by 12
  37. 2023Large Dimensional Independent Component Analysis: Statistical Optimality and Computational Tractabilitycited by 12
  38. 2018Convex Relaxation Methods for Community Detectioncited by 11

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 1.

6 papers.