# Sharp Trade-Offs in High-Dimensional Inference via 2-Level SLOPE

arXiv: https://arxiv.org/abs/2507.09110 · HTML: https://mlsanity.com/paper/2507.09110/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 9 of its 34 references that are in the map.
- First posted on arXiv 12 Jul 2025.

## Builds on (most cited first, 9 of 9)

- [A unifying tutorial on Approximate Message Passing](https://mlsanity.com/paper/2105.02180/) (2021)
- [SLOPE - Adaptive variable selection via convex optimization](https://mlsanity.com/paper/1407.3824/) (2014)
- [False Discoveries Occur Early on the Lasso Path](https://mlsanity.com/paper/1511.01957/) (2015)
- [Universality of Approximate Message Passing Algorithms](https://mlsanity.com/paper/2003.10431/) (2020)
- [Algorithmic Analysis and Statistical Estimation of SLOPE via Approximate Message Passing](https://mlsanity.com/paper/1907.07502/) (2019)
- [Does SLOPE outperform bridge regression?](https://mlsanity.com/paper/1909.09345/) (2019)
- [Characterizing the SLOPE Trade-off: A Variational Perspective and the Donoho-Tanner Limit](https://mlsanity.com/paper/2105.13302/) (2021)
- [Efficient Designs of SLOPE Penalty Sequences in Finite Dimension](https://mlsanity.com/paper/2102.07211/) (2021)
- [Asymptotic Statistical Analysis of Sparse Group LASSO via Approximate Message Passing Algorithm](https://mlsanity.com/paper/2107.01266/) (2021)

## Abstract (arXiv)

Among techniques for high-dimensional linear regression, Sorted L-One Penalized Estimation (SLOPE) generalizes the LASSO via an adaptive l1 regularization that applies heavier penalties to larger coefficients in the model. To achieve such adaptivity, SLOPE requires the specification of a complex hierarchy of penalties, i.e., a monotone penalty sequence in Rp, in contrast to a single penalty scalar for LASSO. Tuning this sequence when p is large poses a challenge, as brute force search over a grid of values is computationally prohibitive. In this work, we study the 2-level SLOPE, an important subclass of SLOPE, with only three hyperparameters. We demonstrate both empirically and analytically that 2-level SLOPE not only preserves the advantages of general SLOPE -- such as improved mean squared error and overcoming the Donoho-Tanner power limit -- but also exhibits computational benefits by reducing the penalty hyperparameter space. In particular, we prove that 2-level SLOPE admits a sharp, theoretically tight characterization of the trade-off between true positive proportion (TPP) and false discovery proportion (FDP), contrasting with general SLOPE where only upper and lower bounds are known. Empirical evaluations further underscore the effectiveness of 2-level SLOPE in settings where predictors exhibit high correlation, when the noise is large, or when the underlying signal is not sparse. Our results suggest that 2-level SLOPE offers a robust, scalable alternative to both LASSO and general SLOPE, making it particularly suited for practical high-dimensional data analysis.