mlsanityData to 14 Oct 2026

Scale-Sensitive Shattering: Learnability and Evaluability at Optimal Scale

arXiv 2605.13684 ↗First posted 13 May 2026cs.LG cs.IT math.ITcited by 1

Not on the map. Why?

Abstract (arXiv)

We study the optimal scale at which real-valued function classes exhibit uniform convergence and learnability. Our main result establishes a scale-sensitive generalization of the fundamental theorem of PAC learning: for every bounded real-valued class and every γ>0, uniform convergence at scale γ, agnostic learnability at scale γ/2, and finiteness of the fat-shattering dimension at every scale γ'>γ are equivalent. This resolves a question by Anthony and Bartlett (Cambridge Univ. Press 1999) on the precise scales governing learnability, refuting a conjecture attributed there to Phil Long that a multiplicative 2-factor gap is unavoidable, and improves the upper bounds of Bartlett and Long (JCSS 1998), which incur such a loss. The key technical ingredient is a direct bound on empirical ℓ_∞ covering numbers, avoiding the standard detour through packing numbers. As a consequence, we obtain sharp asymptotic metric-entropy bounds in terms of the fat-shattering scale γ: an O(log2 n) bound holds already at scale γ/2, while an O(log n) bound holds at scale 2γ. We further show that the O(log2 n) bound is sometimes tight. These results resolve open questions by Alon et al. (JACM 1997) and Rudelson and Vershynin (Ann. of Math. 2006). As an application, we establish a sharp dichotomy for bounded integral probability metrics: every such IPM is either estimable or cannot be weakly evaluated within any multiplicative factor c<3, while 3-weak evaluability always holds, resolving an open question from Aiyer et al. (ICML 2026). We also highlight several open questions on quantitative sample complexity and evaluability.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 37 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

14 of 37 references.

References · 14

  1. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 470
  2. 2024What is Wrong with Perplexity for Long-context Language Modeling?cited by 69
  3. 2021A Theory of PAC Learnability of Partial Concept Classescited by 60
  4. 2015Sample compression schemes for VC classescited by 47
  5. 2024Can Perplexity Reflect Large Language Model's Ability in Long Text Understanding?cited by 45
  6. 2020Sparse Text Generationcited by 24
  7. 2018Sample Compression for Real-Valued Learnerscited by 19
  8. 2019The Optimal Approximation Factor in Density Estimationcited by 12
  9. 2023Prediction, Learning, Uniform Convergence, and Scale-sensitive Dimensionscited by 12
  10. 2018Agnostic Sample Compression Schemes for Regressioncited by 7
  11. 2021Primal and Dual Combinatorial Dimensionscited by 6
  12. 2021Fat-Shattering Dimension of k-fold Aggregationscited by 5
2 more
  1. 2023An Improved Uniform Convergence Bound with Fat-Shattering Dimensioncited by 3
  2. 2026A Theoretical Framework for Statistical Evaluability of Generative Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.