mlsanityData to 14 Oct 2026

Moments, Random Walks, and Limits for Spectrum Approximation

arXiv 2307.00474 ↗First posted 2 Jul 2023cs.DS cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

We study lower bounds for the problem of approximating a one dimensional distribution given (noisy) measurements of its moments. We show that there are distributions on [-1,1] that cannot be approximated to accuracy ε in Wasserstein-1 distance even if we know all of their moments to multiplicative accuracy (1±2-Omega(1/ε)); this result matches an upper bound of Kong and Valiant [Annals of Statistics, 2017]. To obtain our result, we provide a hard instance involving distributions induced by the eigenvalue spectra of carefully constructed graph adjacency matrices. Efficiently approximating such spectra in Wasserstein-1 distance is a well-studied algorithmic problem, and a recent result of Cohen-Steiner et al. [KDD 2018] gives a method based on accurately approximating spectral moments using 2O(1/ε) random walks initiated at uniformly random nodes in the graph. As a strengthening of our main result, we show that improving the dependence on 1/ε in this result would require a new algorithmic approach. Specifically, no algorithm can compute an ε-accurate approximation to the spectrum of a normalized graph adjacency matrix with constant probability, even when given the transcript of 2Omega(1/ε) random walks of length 2Omega(1/ε) started at random nodes.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 2 Jul 2023.

Builds on

10 of 25 references.

References · 10

  1. 2019An Investigation into Neural Net Optimization via Hessian Eigenvalue Densitycited by 292
  2. 2017Empirical Analysis of the Hessian of Over-Parametrized Neural Networkscited by 290
  3. 2019Traditional and Heavy-Tailed Self Regularization in Neural Network Modelscited by 105
  4. 2018The Emergence of Spectral Universality in Deep Networkscited by 74
  5. 2020Hutch++: Optimal Stochastic Trace Estimationcited by 63
  6. 2021Analysis of stochastic Lanczos quadrature for spectrum approximationcited by 17
  7. 2019Network Density of Statescited by 13
  8. 2016Spectrum Estimation from Samplescited by 10
  9. 2021Sublinear Time Spectral Density Estimationcited by 9
  10. 2017Approximating the Spectrum of a Graphcited by 7

Built on by

Cited by year

Citing papers per year: 2024: 2.

2 papers.