Moments, Random Walks, and Limits for Spectrum Approximation
Not on the map. Why?
Abstract (arXiv)
We study lower bounds for the problem of approximating a one dimensional distribution given (noisy) measurements of its moments. We show that there are distributions on [-1,1] that cannot be approximated to accuracy ε in Wasserstein-1 distance even if we know all of their moments to multiplicative accuracy (1±2-Omega(1/ε)); this result matches an upper bound of Kong and Valiant [Annals of Statistics, 2017]. To obtain our result, we provide a hard instance involving distributions induced by the eigenvalue spectra of carefully constructed graph adjacency matrices. Efficiently approximating such spectra in Wasserstein-1 distance is a well-studied algorithmic problem, and a recent result of Cohen-Steiner et al. [KDD 2018] gives a method based on accurately approximating spectral moments using 2O(1/ε) random walks initiated at uniformly random nodes in the graph. As a strengthening of our main result, we show that improving the dependence on 1/ε in this result would require a new algorithmic approach. Specifically, no algorithm can compute an ε-accurate approximation to the spectrum of a normalized graph adjacency matrix with constant probability, even when given the transcript of 2Omega(1/ε) random walks of length 2Omega(1/ε) started at random nodes.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 2 Jul 2023.
Builds on
10 of 25 references.
References · 10
- 2019An Investigation into Neural Net Optimization via Hessian Eigenvalue Densitycited by 292
- 2017Empirical Analysis of the Hessian of Over-Parametrized Neural Networkscited by 290
- 2019Traditional and Heavy-Tailed Self Regularization in Neural Network Modelscited by 105
- 2018The Emergence of Spectral Universality in Deep Networkscited by 74
- 2020Hutch++: Optimal Stochastic Trace Estimationcited by 63
- 2021Analysis of stochastic Lanczos quadrature for spectrum approximationcited by 17
- 2019Network Density of Statescited by 13
- 2016Spectrum Estimation from Samplescited by 10
- 2021Sublinear Time Spectral Density Estimationcited by 9
- 2017Approximating the Spectrum of a Graphcited by 7
Built on by
Citing papers per year: 2024: 2.
2 papers.