# De-Biasing The Lasso With Degrees-of-Freedom Adjustment

arXiv: https://arxiv.org/abs/1902.08885 · HTML: https://mlsanity.com/paper/1902.08885/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Feb 2019.

## Built on by (most cited first, 12 of 12)

- [Asymptotic normality of robust M-estimators with convex penalty](https://mlsanity.com/paper/2107.03826/) (2021)
- [Observable adjustments in single-index models for regularized M-estimators](https://mlsanity.com/paper/2204.06990/) (2022)
- [A non-asymptotic distributional theory of approximate message passing for sparse and robust regression](https://mlsanity.com/paper/2401.03923/) (2024)
- [Optimally taming biases in black-box models for efficient semiparametric estimation](https://mlsanity.com/paper/2606.06368/) (2026)
- [Chi-square and normal inference in high-dimensional multi-task regression](https://mlsanity.com/paper/2107.07828/) (2021)
- [Non-Asymptotic Uncertainty Quantification in High-Dimensional Learning](https://mlsanity.com/paper/2407.13666/) (2024)
- [Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scaling](https://mlsanity.com/paper/2502.15131/) (2025)
- [Spatially relaxed inference on high-dimensional linear models](https://mlsanity.com/paper/2106.02590/) (2021)
- [Mixed Semi-Supervised Generalized-Linear-Regression with Applications to Deep-Learning and Interpolators](https://mlsanity.com/paper/2302.09526/) (2023)
- [Stability of a Generalized Debiased Lasso with Applications to Resampling-Based Variable Selection](https://mlsanity.com/paper/2405.03063/) (2024)
- [Simultaneous analysis of approximate leave-one-out cross-validation and mean-field inference](https://mlsanity.com/paper/2501.02624/) (2025)
- [High-Dimensional Confidence Regions in Sparse MRI](https://mlsanity.com/paper/2407.18964/) (2024)

## Abstract (arXiv)

This paper studies schemes to de-bias the Lasso in a linear model y=Xβ+ε where the goal is to construct confidence intervals for a0Tβ in a direction a0, where X has iid N(0,Sigma) rows. We show that previously analyzed propositions to de-bias the Lasso require a modification in order to enjoy efficiency in a full range of sparsity. This modification takes the form of a degrees-of-freedom adjustment that accounts for the dimension of the model selected by Lasso. Let s0 be the true sparsity. If Sigma is known and the ideal score vector proportional to XSigma-1a0 is used, the unadjusted de-biasing schemes proposed previously enjoy efficiency if s0lll n2/3. However, if s0ggg n2/3, the unadjusted schemes cannot be efficient in certain a0: then it is necessary to modify existing procedures by a degrees-of-freedom adjustment. This modification grants asymptotic efficiency for any a0 when s0/p→ 0 and s0log(p/s0)/n → 0. If Sigma is unknown, efficiency is granted for general a0 when fracs0log pn+minBigfracs_Omegalog pn,frac|Sigma-1a0|1√log p|Sigma-1/2a0|2 √ nBig+fracmin(s_Omega,s0)log p√ n→0 where s_Omega=|Sigma-1a0|0, provided that the de-biased estimate is modified with the degrees-of-freedom adjustment. The dependence in s0,s_Omega and |Sigma-1a0|1 is optimal. Our estimated score vector provides a novel methodology to handle dense a0. Our analysis shows that the degrees-of-freedom adjustment is not needed when the initial bias in direction a0 is small, which is granted under stringent conditions on Sigma-1. The main proof argument is an interpolation path similar to that typically used to derive Slepian's lemma. It yields a new ℓ_∞ error bound for the Lasso which is of independent interest.