mlsanityData to 7 Oct 2026

Sharper Bounds for Chebyshev Moment Matching, with Applications

arXiv 2408.12385 ↗First posted 22 Aug 2024cs.DS cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

We study the problem of approximately recovering a probability distribution given noisy measurements of its Chebyshev polynomial moments. This problem arises broadly across algorithms, statistics, and machine learning. By leveraging a global decay bound on the coefficients in the Chebyshev expansion of any Lipschitz function, we sharpen prior work, proving that accurate recovery in the Wasserstein distance is possible with more noise than previously known. Our result immediately yields a number of applications: 1) We give a simple "linear query" algorithm for constructing a differentially private synthetic data distribution with Wasserstein-1 error tildeO(1/n) based on a dataset of n points in [-1,1]. This bound is optimal up to log factors, and matches a recent result of Boedihardjo, Strohmer, and Vershynin [Probab. Theory. Rel., 2024], which uses a more complex "superregular random walk" method. 2) We give an tildeO(n2/ε) time algorithm for the linear algebraic problem of estimating the spectral density of an n× n symmetric matrix up to ε error in the Wasserstein distance. Our result accelerates prior methods from Chen et al. [ICML 2021] and Braverman et al. [STOC 2022]. 3) We tighten an analysis of Vinayak, Kong, Valiant, and Kakade [ICML 2019] on the maximum likelihood estimator for the statistical problem of "Learning Populations of Parameters'', extending the parameter regime in which sample optimal results can be obtained. Beyond these main results, we provide an extension of our bound to estimating distributions in d > 1 dimensions. We hope that these bounds will find applications more broadly to problems involving distribution recovery from noisy moment information.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 38 of its 104 references that are in the map. First posted on arXiv 22 Aug 2024.

Builds on

38 of 104 references.

References · 38

  1. 2021Convex optimizationcited by 2,479
  2. 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 633
  3. 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 443
  4. 2019PyHessian: Neural Networks Through the Lens of the Hessiancited by 291
  5. 2019An Investigation into Neural Net Optimization via Hessian Eigenvalue Densitycited by 289
  6. 2019Traditional and Heavy-Tailed Self Regularization in Neural Network Modelscited by 104
  7. 2022AIM: An Adaptive and Iterative Mechanism for Differentially Private Synthetic Datacited by 88
  8. 2018The Emergence of Spectral Universality in Deep Networkscited by 74
  9. 2020Privacy in Deep Learning: A Surveycited by 70
  10. 2015Randomized Block Krylov Methods for Stronger and Faster Approximate Singular Value Decompositioncited by 63
  11. 2020Hutch++: Optimal Stochastic Trace Estimationcited by 62
  12. 2021Iterative Methods for Private Synthetic Data: Unifying Framework and New Methodscited by 58
26 more
  1. 2021Differentially Private Query Release Through Adaptive Projectioncited by 50
  2. 2020Differentially Private Synthetic Data: Applied Evaluations and Enhancementscited by 36
  3. 2022Private Synthetic Data for Multitask Learning and Marginal Queriescited by 35
  4. 2020The Limits of Differential Privacy (and its Misuse in Data Release and Machine Learning)cited by 22
  5. 2021Analysis of stochastic Lanczos quadrature for spectrum approximationcited by 17
  6. 2015Efficient Inverse Maintenance and Faster Algorithms for Linear Programmingcited by 13
  7. 2019Network Density of Statescited by 13
  8. 2023Query lower bounds for log-concave samplingcited by 12
  9. 2018Tight Query Complexity Lower Bounds for PCA via Finite Sample Deformed Wigner Lawcited by 11
  10. 2019Maximum Likelihood Estimation for Learning Populations of Parameterscited by 11
  11. 2021Optimal Sketching for Trace Estimationcited by 11
  12. 2023Algorithmically Effective Differentially Private Synthetic Datacited by 11
  13. 2016Spectrum Estimation from Samplescited by 9
  14. 2019The gradient complexity of linear regressioncited by 9
  15. 2021Sublinear Time Spectral Density Estimationcited by 9
  16. 2023Optimal Eigenvalue Approximation via Sketchingcited by 9
  17. 2024Instance-Optimal Private Density Estimation in the Wasserstein Distancecited by 9
  18. 2019Querying a Matrix through Matrix-Vector Productscited by 8
  19. 2022Epistemic Parity: Reproducibility as an Evaluation Metric for Differential Privacycited by 5
  20. 2022Optimal Query Complexities for Dynamic Trace Estimationcited by 5
  21. 2022Efficient Algorithms for Sparse Moment Problems without Separationcited by 3
  22. 2024Fixed-sparsity matrix approximation from matrix-vector productscited by 3
  23. 2022Differentially Private Heatmapscited by 2
  24. 2023Krylov Methods are (nearly) Optimal for Low-Rank Approximationcited by 2
  25. 2024Faster Spectral Density Estimation and Sparsification in the Nuclear Normcited by 2
  26. 2024Near-optimal hierarchical matrix approximation from matrix-vector productscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.