Lean Formalization of Generalization Error Bound by Rademacher Complexity and Dudley's Entropy Integral
Not on the map. Why?
Abstract (arXiv)
Understanding and certifying the generalization performance of machine learning algorithms -- i.e. obtaining theoretical estimates of the test error from the training error -- is a central theme of statistical learning theory. Among the many complexity measures used to derive such guarantees, Rademacher complexity yields sharp, data-dependent bounds that apply well beyond classical VC-dimension theory. In this study, we formalize the generalization error bound by Rademacher complexity in Lean 4, building on measure-theoretic probability theory available in the Mathlib library. Our development provides a mechanically-checked pipeline from the definitions of empirical and expected Rademacher complexity, through a formal symmetrization argument and a bounded-differences analysis, to high-probability uniform deviation bounds via a formally proved McDiarmid inequality. A key technical contribution is a reusable mechanism for lifting results from countable hypothesis classes (where measurability of suprema is straightforward in Mathlib) to separable topological index sets via a reduction to a countable dense subset. As worked applications of the abstract theorem, we mechanize standard empirical Rademacher bounds for linear predictors under ℓ2 and ℓ1 regularizations, and we also formalize a Dudley-type entropy integral bound based on covering numbers and a chaining construction.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 3 of its 24 references that are in the map. First posted on arXiv 25 Mar 2025.
Builds on
3 of 24 references.
References · 3
- 2019The Lean mathematical librarycited by 134
- 2020CertRL: Formalizing Convergence Proofs for Value and Policy Iteration in Coqcited by 9
- 2022Formalization of a Stochastic Approximation Theoremcited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026LeanMarathon: Toward Reliable AI Co-Mathematicians through Long-Horizon Lean Autoformalizationcited by 12
- 2026Hypothesis-Disciplined Multi-Agent Automated Formalization of Asymptotic Statistical Theorycited by 1
- 2026CausalSmith: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inferencecited by 1
- 2026CausalSmith: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference24 Jul 2026
- 2026Hypothesis-Disciplined Multi-Agent Automated Formalization of Asymptotic Statistical Theory3 Jun 2026
- 2026LeanMarathon: Toward Reliable AI Co-Mathematicians through Long-Horizon Lean Autoformalization3 Jun 2026