Computational and statistical lower bounds for low-rank estimation under general inhomogeneous noise
Not on the map. Why?
Abstract (arXiv)
Recent work has generalized several results concerning the well-understood spiked Wigner matrix model of a low-rank signal matrix corrupted by additive i.i.d. Gaussian noise to the inhomogeneous case, where the noise has a variance profile. In particular, for the special case where the variance profile has a block structure, a series of results identified an effective spectral algorithm for detecting and estimating the signal, identified the threshold signal strength required for that algorithm to succeed, and proved information-theoretic lower bounds that, for some special signal distributions, match the above threshold. We complement these results by studying the computational optimality of this spectral algorithm. Namely, we show that, for a much broader range of signal distributions, whenever the spectral algorithm cannot detect a low-rank signal, then neither can any low-degree polynomial algorithm. This gives the first evidence for a computational hardness conjecture of Guionnet, Ko, Krzakala, and Zdeborov'a (2023). With similar techniques, we also prove sharp information-theoretic lower bounds for a class of signal distributions not treated by prior work. Unlike all of the above results on inhomogeneous models, our results do not assume that the variance profile has a block structure, and suggest that the same spectral algorithm might remain optimal for quite general profiles. We include a numerical study of this claim for an example of a smoothly-varying rather than piecewise-constant profile. Our proofs involve analyzing the graph sums of a matrix, which also appear in free and traffic probability, but we require new bounds on these quantities that are tighter than existing ones for non-negative matrices, which may be of independent interest.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 71 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
22 of 71 references.
References · 22
- 2019Notes on Computational Hardness of Hypothesis Testing: Predictions using the Low-Degree Likelihood Ratiocited by 82
- 2017The power of sum-of-squares for detecting hidden structurescited by 54
- 2018Optimality and Sub-optimality of PCA I: Spiked Random Matrix Modelscited by 33
- 2016Mutual information for symmetric rank-one matrix estimation: A proof of the replica formulacited by 26
- 2015MMSE of probabilistic low-rank matrix estimation: Universality with respect to the output channelcited by 22
- 2018Fundamental limits of detection in the spiked Wigner modelcited by 18
- 2020Spectral Planting and the Hardness of Refuting Cuts, Colorability, and Communities in Random Graphscited by 13
- 2025Computational Complexity of Statistics: New Insights from Low-Degree Polynomialscited by 12
- 2018Rank-one matrix estimation: analysis of algorithmic and information theoretic limits by the spatial coupling methodcited by 11
- 2022Statistical and Computational Phase Transitions in Group Testingcited by 10
- 2020Information-Theoretic Limits for the Matrix Tensor Productcited by 9
- 2022The price of ignorance: how much does it cost to forget noise structure in low-rank matrix estimation?cited by 9
10 more
- 2020Information-theoretic limits of a multiview low-rank symmetric spiked matrix modelcited by 8
- 2021Fundamental limits for rank-one matrix estimation with groupwise heteroskedasticitycited by 8
- 2023Optimal Algorithms for the Inhomogeneous Spiked Wigner Modelcited by 8
- 2024Tensor cumulants for statistical inference on invariant distributionscited by 8
- 2023Detection of Dense Subhypergraphs by Low-Degree Polynomialscited by 7
- 2024Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noisecited by 6
- 2015Spectral Detection in the Censored Block Modelcited by 5
- 2024Matrix Denoising with Doubly Heteroscedastic Noise: Fundamental Limits and Optimal Spectral Methodscited by 5
- 2022Near-optimal fitting of ellipsoids to random pointscited by 4
- 2024Low coordinate degree algorithms I: Universality of computational thresholds for hypothesis testingcited by 3
Built on by
Not cited yet.