# A General Theory of Hypothesis Tests and Confidence Regions for Sparse High Dimensional Models

arXiv: https://arxiv.org/abs/1412.8765 · HTML: https://mlsanity.com/paper/1412.8765/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Dec 2014.

## Built on by (most cited first, 26 of 26)

- [Uncertainty quantification in the Bradley-Terry-Luce model](https://mlsanity.com/paper/2110.03874/) (2021)
- [Inference for Heteroskedastic PCA with Missing Data](https://mlsanity.com/paper/2107.12365/) (2021)
- [Lagrangian Inference for Ranking Problems](https://mlsanity.com/paper/2110.00151/) (2021)
- [Debiased Machine Learning without Sample-Splitting for Stable Estimators](https://mlsanity.com/paper/2206.01825/) (2022)
- [Inference on Optimal Dynamic Policies via Softmax Approximation](https://mlsanity.com/paper/2303.04416/) (2023)
- [A Conditional Randomization Test for Sparse Logistic Regression in High-Dimension](https://mlsanity.com/paper/2205.14613/) (2022)
- [On Heterogeneous Treatment Effects in Heterogeneous Causal Graphs](https://mlsanity.com/paper/2301.12383/) (2023)
- [Causal Discovery with Generalized Linear Models through Peeling Algorithms](https://mlsanity.com/paper/2310.16698/) (2023)
- [Spatially relaxed inference on high-dimensional linear models](https://mlsanity.com/paper/2106.02590/) (2021)
- [Inference for High Dimensional Censored Quantile Regression](https://mlsanity.com/paper/2107.10959/) (2021)
- [Post-Regularization Confidence Bands for Ordinary Differential Equations](https://mlsanity.com/paper/2110.12510/) (2021)
- [Adaptive debiased SGD in high-dimensional GLMs with streaming data](https://mlsanity.com/paper/2405.18284/) (2024)
- [U-learning for Prediction Inference via Combinatory Multi-Subsampling: With Applications to LASSO and Neural Networks](https://mlsanity.com/paper/2407.15301/) (2024)
- [Generalized Linear Models with Structured Sparsity Estimators](https://mlsanity.com/paper/2104.14371/) (2021)
- [Statistical Inference for High-Dimensional Linear Regression with Blockwise Missing Data](https://mlsanity.com/paper/2106.03344/) (2021)
- [An Overview of Healthcare Data Analytics With Applications to the COVID-19 Pandemic](https://mlsanity.com/paper/2111.14623/) (2021)
- [High-dimensional Inference and FDR Control for Simulated Markov Random Fields](https://mlsanity.com/paper/2202.05612/) (2022)
- [Retire: Robust Expectile Regression in High Dimensions](https://mlsanity.com/paper/2212.05562/) (2022)
- [On High dimensional Poisson models with measurement error: hypothesis testing for nonlinear nonconvex optimization](https://mlsanity.com/paper/2301.00139/) (2022)
- [Asymptotic Inference for Multi-Stage Stationary Treatment Policy with Variable Selection](https://mlsanity.com/paper/2301.12553/) (2023)
- [Communication-Efficient Distributed Estimation and Inference for Cox's Model](https://mlsanity.com/paper/2302.12111/) (2023)
- [Inference with non-differentiable surrogate loss in a general high-dimensional classification framework](https://mlsanity.com/paper/2405.11723/) (2024)
- [Targeted Learning for Variable Importance](https://mlsanity.com/paper/2411.02221/) (2024)
- [Inference for High-Dimensional Sparse Spectral Precision Matrices](https://mlsanity.com/paper/2606.07986/) (2026)
- [Renewable Lasso without Batch-Number Constraints: A Gradient-Enhanced Approach](https://mlsanity.com/paper/2606.11738/) (2026)
- [Marginal Coordinate Test for Fr'echet Regression with Random Objects](https://mlsanity.com/paper/2608.30644/) (2026)

## Abstract (arXiv)

We consider the problem of uncertainty assessment for low dimensional components in high dimensional models. Specifically, we propose a decorrelated score function to handle the impact of high dimensional nuisance parameters. We consider both hypothesis tests and confidence regions for generic penalized M-estimators. Unlike most existing inferential methods which are tailored for individual models, our approach provides a general framework for high dimensional inference and is applicable to a wide range of applications. From the testing perspective, we develop general theorems to characterize the limiting distributions of the decorrelated score test statistic under both null hypothesis and local alternatives. These results provide asymptotic guarantees on the type I errors and local powers of the proposed test. Furthermore, we show that the decorrelated score function can be used to construct point and confidence region estimators that are semiparametrically efficient. We also generalize this framework to broaden its applications. First, we extend it to handle high dimensional null hypothesis, where the number of parameters of interest can increase exponentially fast with the sample size. Second, we establish the theory for model misspecification. Third, we go beyond the likelihood framework, by introducing the generalized score test based on general loss functions. Thorough numerical studies are conducted to back up the developed theoretical results.