# Benign Overfitting in Linear Classifiers with a Bias Term

arXiv: https://arxiv.org/abs/2511.12840 · HTML: https://mlsanity.com/paper/2511.12840/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 10 of its 14 references that are in the map.
- First posted on arXiv 16 Nov 2025.

## Builds on (most cited first, 10 of 10)

- [Understanding deep learning requires rethinking generalization](https://mlsanity.com/paper/1611.03530/) (2016)
- [Reconciling modern machine learning practice and the bias-variance trade-off](https://mlsanity.com/paper/1812.11118/) (2018)
- [The Implicit Bias of Gradient Descent on Separable Data](https://mlsanity.com/paper/1710.10345/) (2017)
- [Benign Overfitting in Linear Regression](https://mlsanity.com/paper/1906.11300/) (2019)
- [Surprises in High-Dimensional Ridgeless Least Squares Interpolation](https://mlsanity.com/paper/1903.08560/) (2019)
- [Just Interpolate: Kernel "Ridgeless" Regression Can Generalize](https://mlsanity.com/paper/1808.00387/) (2018)
- [Finite-sample Analysis of Interpolating Linear Classifiers in the Overparameterized Regime](https://mlsanity.com/paper/2004.12019/) (2020)
- [Risk Bounds for Over-parameterized Maximum Margin Classification on Sub-Gaussian Mixtures](https://mlsanity.com/paper/2104.13628/) (2021)
- [Binary Classification of Gaussian Mixtures: Abundance of Support Vectors, Benign Overfitting and Regularization](https://mlsanity.com/paper/2011.09148/) (2020)
- [Universality of Benign Overfitting in Binary Linear Classification](https://mlsanity.com/paper/2501.10538/) (2025)

## Abstract (arXiv)

Overparameterized models often generalize well even when they interpolate noisy training data. This is known as benign overfitting. For linear classification, Hashimoto et al. (2025) analyzed the phenomenon under a broad class of mixture distributions, but only for homogeneous classifiers without a bias term. We extend their framework to classifiers with an intercept. Benign overfitting still occurs, but the intercept perturbs the normalized Gram matrix of the noise and creates extra constraints on the covariance. These constraints are strongest with label noise. Their effect depends on the covariance: under isotropic noise they are dominated by the homogeneous conditions, while in anisotropic or noisy regimes they can raise the dimensionality needed for benign generalization. Thus the bias term changes the theory in some covariance regimes and leaves the asymptotic thresholds unchanged in others.