mlsanityData to 7 Oct 2026

Sharp Constants in Uniformity Testing via the Huber Statistic

arXiv 2206.10722 ↗First posted 21 Jun 2022stat.ML cs.DS cs.ITcited by 1

Not on the map. Why?

Abstract (arXiv)

Uniformity testing is one of the most well-studied problems in property testing, with many known test statistics, including ones based on counting collisions, singletons, and the empirical TV distance. It is known that the optimal sample complexity to distinguish the uniform distribution on m elements from any ε-far distribution with 1-δ probability is n = Thetaleft(frac√m log (1/δ)ε2 + fraclog (1/δ)ε2right), which is achieved by the empirical TV tester. Yet in simulation, these theoretical analyses are misleading: in many cases, they do not correctly rank order the performance of existing testers, even in an asymptotic regime of all parameters tending to 0 or ∞. We explain this discrepancy by studying the constant factors required by the algorithms. We show that the collisions tester achieves a sharp maximal constant in the number of standard deviations of separation between uniform and non-uniform inputs. We then introduce a new tester based on the Huber loss, and show that it not only matches this separation, but also has tails corresponding to a Gaussian with this separation. This leads to a sample complexity of (1 + o(1))frac√m log (1/δ)ε2 in the regime where this term is dominant, unlike all other existing testers.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 21 Jun 2022.

Builds on

12 of 33 references.

References · 12

  1. 2021Convex optimizationcited by 2,479
  2. 2013Optimal Algorithms for Testing Closeness of Discrete Distributionscited by 37
  3. 2017Testing Conditional Independence of Discrete Distributionscited by 22
  4. 2017Optimal Identity Testing with High Probabilitycited by 19
  5. 2020Optimal Testing of Discrete Distributions with High Probabilitycited by 15
  6. 2016Collision-based Testers are Optimal for Uniformity and Closenesscited by 14
  7. 2016BPTree: an ℓ2 heavy hitters algorithm using constant memorycited by 4
  8. 2017Generalized Uniformity Testingcited by 3
  9. 2017Sharp Bounds for Generalized Uniformity Testingcited by 3
  10. 2017New Cardinality Estimation Methods for HyperLogLog Sketchescited by 2
  11. 2017Back to the Future: an Even More Nearly Optimal Cardinality Estimation Algorithmcited by 2
  12. 2020Information Theoretic Limits of Cardinality Estimation: Fisher Meets Shannoncited by 2

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.