mlsanityData to 14 Oct 2026

Testing Support Size More Efficiently Than Learning Histograms

arXiv 2410.18915 ↗First posted 24 Oct 2024cs.DS cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Consider two problems about an unknown probability distribution p: 1. How many samples from p are required to test if p is supported on n elements or not? Specifically, given samples from p, determine whether it is supported on at most n elements, or it is "ε-far" (in total variation distance) from being supported on n elements. 2. Given m samples from p, what is the largest lower bound on its support size that we can produce? The best known upper bound for problem (1) uses a general algorithm for learning the histogram of the distribution p, which requires Theta(tfracnε2 log n) samples. We show that testing can be done more efficiently than learning the histogram, using only O(tfracnε log n log(1/ε)) samples, nearly matching the best known lower bound of Omega(tfracnε log n). This algorithm also provides a better solution to problem (2), producing larger lower bounds on support size than what follows from previous work. The proof relies on an analysis of Chebyshev polynomial approximations outside the range where they are designed to be good approximations, and the paper is intended as an accessible self-contained exposition of the Chebyshev polynomial method.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 40 references that are in the map. First posted on arXiv 24 Oct 2024.

Builds on

12 of 40 references.

References · 12

  1. 2015The Optimal Sample Complexity of PAC Learningcited by 72
  2. 2019The Broad Optimality of Profile Maximum Likelihoodcited by 5
  3. 2020VC Dimension and Distribution-Free Sample-Based Testingcited by 5
  4. 2018Local moment matching: A unified methodology for symmetric functional estimation and distribution estimation under Wasserstein distancecited by 4
  5. 2019Unified Sample-Optimal Property Estimation in Near-Linear Timecited by 4
  6. 2016Tolerant Junta Testing and the Connection to Submodular Optimization and Function Isomorphismcited by 3
  7. 2022Estimating the Effective Support Size in Constant Query Complexitycited by 2
  8. 2022Testing Distributions of Huge Objectscited by 2
  9. 2019Testing Bipartitness in an Augmented VDF Bounded-Degree Graph Modelcited by 1
  10. 2023Distribution Testing Under the Parity Tracecited by 1
  11. 2023Refining the Adaptivity Notion in the Huge Object Modelcited by 1
  12. 2023Support Testing in the Huge Object Modelcited by 1

Built on by

Not cited yet.