# Gaussian and Non-Gaussian Universality of Data Augmentation

arXiv: https://arxiv.org/abs/2202.09134 · HTML: https://mlsanity.com/paper/2202.09134/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 4 of its 25 references that are in the map.
- First posted on arXiv 18 Feb 2022.

## Builds on (most cited first, 4 of 4)

- [Surprises in High-Dimensional Ridgeless Least Squares Interpolation](https://mlsanity.com/paper/1903.08560/) (2019)
- [The generalization error of random features regression: Precise asymptotics and double descent curve](https://mlsanity.com/paper/1908.05355/) (2019)
- [Neural collapse with unconstrained features](https://mlsanity.com/paper/2011.11619/) (2020)
- [Black-box tests for algorithmic stability](https://mlsanity.com/paper/2111.15546/) (2021)

## Built on by (most cited first, 2 of 2)

- [Diagonal Symmetrization of Neural Network Solvers for the Many-Electron Schr"odinger Equation](https://mlsanity.com/paper/2502.05318/) (2025)
- [The Zero Pattern of a Design Matrix Drives Multiple Descent in Over-parameterized Regression](https://mlsanity.com/paper/2607.24041/) (2026)

## Abstract (arXiv)

We provide universality results that quantify how data augmentation affects the variance and limiting distribution of estimates through simple surrogates, and analyze several specific models in detail. The results confirm some observations made in machine learning practice, but also lead to unexpected findings: Data augmentation may increase rather than decrease the uncertainty of estimates, such as the empirical prediction risk. It can act as a regularizer, but fails to do so in certain high-dimensional problems, and it may shift the double-descent peak of an empirical risk. Overall, the analysis shows that several properties data augmentation has been attributed with are not either true or false, but rather depend on a combination of factors -- notably the data distribution, the properties of the estimator, and the interplay of sample size, number of augmentations, and dimension. As our main theoretical tool, we develop an adaptation of Lindeberg's technique for block dependence. The resulting universality regime may be Gaussian or non-Gaussian.