# A Study of Error Variance Estimation in Lasso Regression

arXiv: https://arxiv.org/abs/1311.5274 · HTML: https://mlsanity.com/paper/1311.5274/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 21 Nov 2013.

## Built on by (most cited first, 10 of 10)

- [A Class of Geometric Structures in Transfer Learning: Minimax Bounds and Optimality](https://mlsanity.com/paper/2202.11685/) (2022)
- [Granger Causal Inference in Multivariate Hawkes Processes by Minimum Message Length](https://mlsanity.com/paper/2309.02027/) (2023)
- [Non-Asymptotic Uncertainty Quantification in High-Dimensional Learning](https://mlsanity.com/paper/2407.13666/) (2024)
- [Approximating the universal thermal climate index using sparse regression with orthogonal polynomials](https://mlsanity.com/paper/2508.11307/) (2025)
- [Spatially relaxed inference on high-dimensional linear models](https://mlsanity.com/paper/2106.02590/) (2021)
- [Robust Variable Selection and Estimation Via Adaptive Elastic Net S-Estimators for Linear Regression](https://mlsanity.com/paper/2107.03325/) (2021)
- [Predicting Rental Price of Lane Houses in Shanghai with Machine Learning Methods and Large Language Models](https://mlsanity.com/paper/2405.17505/) (2024)
- [A parametric distribution for exact post-selection inference with data carving](https://mlsanity.com/paper/2305.12581/) (2023)
- [Convex Estimation of Gaussian Graphical Regression Models with Covariates](https://mlsanity.com/paper/2410.06326/) (2024)
- [Post-Transfer Learning Statistical Inference in High-Dimensional Regression](https://mlsanity.com/paper/2504.18212/) (2025)

## Abstract (arXiv)

Variance estimation in the linear model when p > n is a difficult problem. Standard least squares estimation techniques do not apply. Several variance estimators have been proposed in the literature, all with accompanying asymptotic results proving consistency and asymptotic normality under a variety of assumptions. It is found, however, that most of these estimators suffer large biases in finite samples when true underlying signals become less sparse with larger per element signal strength. One estimator seems to be largely neglected in the literature: a residual sum of squares based estimator using Lasso coefficients with regularisation parameter selected adaptively (via cross-validation). In this paper, we review several variance estimators and perform a reasonably extensive simulation study in an attempt to compare their finite sample performance. It would seem from the results that variance estimators with adaptively chosen regularisation parameters perform admirably over a broad range of sparsity and signal strength settings. Finally, some intial theoretical analyses pertaining to these types of estimators are proposed and developed.