mlsanityData to 7 Oct 2026

Tensor cumulants for statistical inference on invariant distributions

arXiv 2404.18735 ↗First posted 29 Apr 2024math.ST cs.CC cs.DScited by 8

Not on the map. Why?

Abstract (arXiv)

Many problems in high-dimensional statistics appear to have a statistical-computational gap: a range of values of the signal-to-noise ratio where inference is information-theoretically possible, but (conjecturally) computationally intractable. A canonical such problem is Tensor PCA, where we observe a tensor Y consisting of a rank-one signal plus Gaussian noise. Multiple lines of work suggest that Tensor PCA becomes computationally hard at a critical value of the signal's magnitude. In particular, below this transition, no low-degree polynomial algorithm can detect the signal with high probability; conversely, various spectral algorithms are known to succeed above this transition. We unify and extend this work by considering tensor networks, orthogonally invariant polynomials where multiple copies of Y are "contracted" to produce scalars, vectors, matrices, or other tensors. We define a new set of objects, tensor cumulants, which provide an explicit, near-orthogonal basis for invariant polynomials of a given degree. This basis lets us unify and strengthen previous results on low-degree hardness, giving a combinatorial explanation of the hardness transition and of a continuum of subexponential-time algorithms that work below it, and proving tight lower bounds against low-degree polynomials for recovering rather than just detecting the signal. It also lets us analyze a new problem of distinguishing between different tensor ensembles, such as Wigner and Wishart tensors, establishing a sharp computational threshold and giving evidence of a new statistical-computational gap in the Central Limit Theorem for random tensors. Finally, we believe these cumulants are valuable mathematical objects in their own right: they generalize the free cumulants of free probability theory from matrices to tensors, and share many of their properties, including additivity under additive free convolution.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 22 of its 49 references that are in the map. First posted on arXiv 29 Apr 2024.

Builds on

22 of 49 references.

References · 22

  1. 2019Notes on Computational Hardness of Hypothesis Testing: Predictions using the Low-Degree Likelihood Ratiocited by 82
  2. 2014A statistical model for tensor PCAcited by 72
  3. 2017The power of sum-of-squares for detecting hidden structurescited by 54
  4. 2020Reducibility and Statistical-Computational Gaps from Secret Leakagecited by 50
  5. 2013Community detection thresholds and the weak Ramanujan propertycited by 47
  6. 2015Fast spectral algorithms from sum-of-squares proofs: tensor decomposition and planted sparse vectorscited by 38
  7. 2020Computational Barriers to Estimation from Low-Degree Polynomialscited by 38
  8. 2015Tensor principal component analysis via sum-of-squares proofscited by 35
  9. 2022The Franz-Parisi Criterion and Computational Trade-offs in High Dimensional Statisticscited by 31
  10. 2014Testing for high-dimensional geometry in random graphscited by 25
  11. 2019The Kikuchi Hierarchy and Tensor PCAcited by 15
  12. 2019How to iron out rough landscapes and get optimal performances: Averaged Gradient Descent and its application to tensor PCAcited by 14
10 more
  1. 2016Homotopy Analysis for Tensor PCAcited by 12
  2. 2016Strongly Refuting Random CSPs Below the Spectral Thresholdcited by 9
  3. 2019Phase Transitions for Detecting Latent Geometry in Random Graphscited by 9
  4. 2020Hardness of Random Optimization Problems for Boolean Circuits, Low-Degree Polynomials, and Langevin Dynamicscited by 7
  5. 2023Is Planted Coloring Easier than Planted Clique?cited by 7
  6. 2018Spectral Methods from Tensor Networkscited by 6
  7. 2022Average-Case Complexity of Tensor Decomposition for Low-Degree Polynomialscited by 6
  8. 2020Estimating Rank-One Spikes from Heavy-Tailed Noise via Self-Avoiding Walkscited by 5
  9. 2022Fast algorithm for overcomplete order-3 tensor decompositioncited by 5
  10. 2016Weak Decoupling, Polynomial Folds, and Approximate Optimization over the Spherecited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 7.

8 papers.