# Sparse Quantile Regression

arXiv: https://arxiv.org/abs/2006.11201 · HTML: https://mlsanity.com/paper/2006.11201/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Jun 2020.

## Built on by (most cited first, 1 of 1)

- [A sparse PAC-Bayesian approach for high-dimensional quantile prediction](https://mlsanity.com/paper/2409.01687/) (2024)

## Abstract (arXiv)

We consider both ℓ 0-penalized and ℓ 0-constrained quantile regression estimators. For the ℓ 0-penalized estimator, we derive an exponential inequality on the tail probability of excess quantile prediction risk and apply it to obtain non-asymptotic upper bounds on the mean-square parameter and regression function estimation errors. We also derive analogous results for the ℓ 0-constrained estimator. The resulting rates of convergence are nearly minimax-optimal and the same as those for ℓ 1-penalized and non-convex penalized estimators. Further, we characterize expected Hamming loss for the ℓ 0-penalized estimator. We implement the proposed procedure via mixed integer linear programming and also a more scalable first-order approximation algorithm. We illustrate the finite-sample performance of our approach in Monte Carlo experiments and its usefulness in a real data application concerning conformal prediction of infant birth weights (with n≈ 103 and up to p>103). In sum, our ℓ 0-based method produces a much sparser estimator than the ℓ 1-penalized and non-convex penalized approaches without compromising precision.