# False Discoveries Occur Early on the Lasso Path

arXiv: https://arxiv.org/abs/1511.01957 · HTML: https://mlsanity.com/paper/1511.01957/

## Key facts

- Cited by 31 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Nov 2015.

## Built on by (most cited first, 30 of 31)

- [S-LIME: Stabilized-LIME for Model Explanation](https://mlsanity.com/paper/2106.07875/) (2021)
- [Adversarial Training Helps Transfer Learning via Better Representations](https://mlsanity.com/paper/2106.10189/) (2021)
- [A toolkit for data-driven discovery of governing equations in high-noise regimes](https://mlsanity.com/paper/2111.04870/) (2021)
- [Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discovery](https://mlsanity.com/paper/2301.12649/) (2023)
- [The Terminating-Random Experiments Selector: Fast High-Dimensional Variable Selection with False Discovery Rate Control](https://mlsanity.com/paper/2110.06048/) (2021)
- [A flexible empirical Bayes approach to multiple linear regression and connections with penalized regression](https://mlsanity.com/paper/2208.10910/) (2022)
- [Proximal Subgradient Norm Minimization of ISTA and FISTA](https://mlsanity.com/paper/2211.01610/) (2022)
- [Average case analysis of Lasso under ultra-sparse conditions](https://mlsanity.com/paper/2302.13093/) (2023)
- [Characterizing the SLOPE Trade-off: A Variational Perspective and the Donoho-Tanner Limit](https://mlsanity.com/paper/2105.13302/) (2021)
- [Bayesian Hierarchical Probabilistic Forecasting of Intraday Electricity Prices](https://mlsanity.com/paper/2403.05441/) (2024)
- [A novel interpretable machine learning system to generate clinical risk scores: An application for predicting early mortality or unplanned readmission in a retrospective cohort study](https://mlsanity.com/paper/2201.03291/) (2022)
- [Near-optimal multiple testing in Bayesian linear models with finite-sample FDR control](https://mlsanity.com/paper/2211.02778/) (2022)
- [Linear Convergence of ISTA and FISTA](https://mlsanity.com/paper/2212.06319/) (2022)
- [Thresholded Graphical Lasso Adjusts for Latent Variables: Application to Functional Neural Connectivity](https://mlsanity.com/paper/2104.06389/) (2021)
- [Transfer Learning for Spatial Autoregressive Models with Application to U.S. Presidential Election Prediction](https://mlsanity.com/paper/2405.15600/) (2024)
- [Retire: Robust Expectile Regression in High Dimensions](https://mlsanity.com/paper/2212.05562/) (2022)
- [A parametric distribution for exact post-selection inference with data carving](https://mlsanity.com/paper/2305.12581/) (2023)
- [Improved identification accuracy in equation learning via comprehensive boldsymbolR2-elimination and Bayesian model selection](https://mlsanity.com/paper/2311.13265/) (2023)
- [Inconsistency of cross-validation for structure learning in Gaussian graphical models](https://mlsanity.com/paper/2312.17047/) (2023)
- [Predictive Performance Test based on the Exhaustive Nested Cross-Validation for High-dimensional data](https://mlsanity.com/paper/2408.03138/) (2024)
- [Validation-Free Sparse Learning: A Phase Transition Approach to Feature Selection](https://mlsanity.com/paper/2411.17180/) (2024)
- [Variable Selection Methods for Multivariate, Functional, and Complex Biomedical Data in the AI Age](https://mlsanity.com/paper/2501.06868/) (2025)
- [Statistical Learning for Heterogeneous Treatment Effects: Pretraining, Prognosis, and Prediction](https://mlsanity.com/paper/2505.00310/) (2025)
- [Proximal Operators of Sorted Nonconvex Penalties](https://mlsanity.com/paper/2506.15315/) (2025)
- [Sharp Trade-Offs in High-Dimensional Inference via 2-Level SLOPE](https://mlsanity.com/paper/2507.09110/) (2025)
- [Lasso Penalization for High-Dimensional Beta Regression Models: Computation, Analysis, and Inference](https://mlsanity.com/paper/2507.20079/) (2025)
- [From STLS to Projection-based Dictionary Selection in Sparse Regression for System Identification](https://mlsanity.com/paper/2512.14404/) (2025)
- [An Empirical Study on Ensemble-Based Transfer Learning Bayesian Optimisation with Mixed Variable Types](https://mlsanity.com/paper/2601.15640/) (2026)
- [Choosing the Right Regularizer for Applied ML: Simulation Benchmarks of Popular Scikit-learn Regularization Frameworks](https://mlsanity.com/paper/2604.03541/) (2026)
- [Virtual Dummies: Enabling Scalable FDR-Controlled Variable Selection via Sequential Sampling of Null Features](https://mlsanity.com/paper/2604.07464/) (2026)

## Abstract (arXiv)

In regression settings where explanatory variables have very low correlations and there are relatively few effects, each of large magnitude, we expect the Lasso to find the important variables with few errors, if any. This paper shows that in a regime of linear sparsity---meaning that the fraction of variables with a non-vanishing effect tends to a constant, however small---this cannot really be the case, even when the design variables are stochastically independent. We demonstrate that true features and null features are always interspersed on the Lasso path, and that this phenomenon occurs no matter how strong the effect sizes are. We derive a sharp asymptotic trade-off between false and true positive rates or, equivalently, between measures of type I and type II errors along the Lasso path. This trade-off states that if we ever want to achieve a type II error (false negative rate) under a critical value, then anywhere on the Lasso path the type I error (false positive rate) will need to exceed a given threshold so that we can never have both errors at a low level at the same time. Our analysis uses tools from approximate message passing (AMP) theory as well as novel elements to deal with a possibly adaptive selection of the Lasso regularizing parameter.