mlsanityData to 7 Oct 2026

AI4SLT: Empirical Processes in Lean 4 for Formal Statistical Learning Theory

arXiv 2602.02285 ↗First posted 2 Feb 2026cs.LG cs.CL math.STcited by 4

Not on the map. Why?

Abstract (arXiv)

We present the first comprehensive Lean 4 formalization of statistical learning theory (SLT) grounded in empirical process theory. Our en-to-end formal infrastructure implement the missing contents in latest Lean library, including a complete development of Gaussian Lipschitz concentration, Dudley's entropy integral theorem for sub-Gaussian processes, and an application to least-squares (sparse) regression with a sharp rate. The project was carried out using a human-AI collaborative workflow, in which humans design proof strategies and AI agents execute tactical proof construction, leading to the human-verified Lean 4 toolbox for SLT. Beyond implementation, the formalization process exposes and resolves implicit assumptions and missing details in standard SLT textbooks, enforcing a granular, line-by-line understanding of the theory. This work establishes a reusable formal foundation and opens the door for future developments in machine learning theory. The code is provided in https://github.com/YuanheZ/lean-stat-learning-theory.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 11 of its 29 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

11 of 29 references.

References · 11

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 919
  3. 2019Benign Overfitting in Linear Regressioncited by 544
  4. 2019The generalization error of random features regression: Precise asymptotics and double descent curvecited by 410
  5. 2020Benign overfitting in ridge regressioncited by 152
  6. 2022The merged-staircase property: a necessary and nearly sufficient condition for SGD learning of sparse functions on two-layer neural networkscited by 141
  7. 2021Intermediate Layer Optimization for Inverse Problems using Deep Generative Modelscited by 70
  8. 2025Dynamical Decoupling of Generalization and Overfitting in Large Two-Layer Networkscited by 21
  9. 2025Survey on Algorithms for multi-index modelscited by 15
  10. 2025Towards Formalizing Reinforcement Learning Theory: A Robbins-Siegmund Approachcited by 5
  11. 2024Formalization of Complexity Analysis of the First-order Algorithms for Convex Optimizationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.