Benign Overfitting in Linear Classifiers with a Bias Term
Not on the map. Why?
Abstract (arXiv)
Overparameterized models often generalize well even when they interpolate noisy training data. This is known as benign overfitting. For linear classification, Hashimoto et al. (2025) analyzed the phenomenon under a broad class of mixture distributions, but only for homogeneous classifiers without a bias term. We extend their framework to classifiers with an intercept. Benign overfitting still occurs, but the intercept perturbs the normalized Gram matrix of the noise and creates extra constraints on the covariance. These constraints are strongest with label noise. Their effect depends on the covariance: under isotropic noise they are dominated by the homogeneous conditions, while in anisotropic or noisy regimes they can raise the dimensionality needed for benign generalization. Thus the bias term changes the theory in some covariance regimes and leaves the asymptotic thresholds unchanged in others.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 14 references that are in the map. First posted on arXiv 16 Nov 2025.
Builds on
10 of 14 references.
References · 10
- 2016Understanding deep learning requires rethinking generalizationcited by 1,657
- 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 919
- 2017The Implicit Bias of Gradient Descent on Separable Datacited by 649
- 2019Benign Overfitting in Linear Regressioncited by 544
- 2019Surprises in High-Dimensional Ridgeless Least Squares Interpolationcited by 508
- 2018Just Interpolate: Kernel "Ridgeless" Regression Can Generalizecited by 190
- 2020Finite-sample Analysis of Interpolating Linear Classifiers in the Overparameterized Regimecited by 81
- 2021Risk Bounds for Over-parameterized Maximum Margin Classification on Sub-Gaussian Mixturescited by 48
- 2020Binary Classification of Gaussian Mixtures: Abundance of Support Vectors, Benign Overfitting and Regularizationcited by 27
- 2025Universality of Benign Overfitting in Binary Linear Classificationcited by 2
Built on by
Not cited yet.