Exact Post-Selection Inference for Sequential Regression Procedures
Not on the map. Why?
Abstract (arXiv)
We propose new inference tools for forward stepwise regression, least angle regression, and the lasso. Assuming a Gaussian model for the observation vector y, we first describe a general scheme to perform valid inference after any selection event that can be characterized as y falling into a polyhedral set. This framework allows us to derive conditional (post-selection) hypothesis tests at any step of forward stepwise or least angle regression, or any step along the lasso regularization path, because, as it turns out, selection events for these procedures can be expressed as polyhedral constraints on y. The p-values associated with these tests are exactly uniform under the null distribution, in finite samples, yielding exact type I error control. The tests can also be inverted to produce confidence intervals for appropriate underlying regression parameters. The R package "selectiveInference", freely available on the CRAN repository, implements the new inference tools described in this paper.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jan 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 8; 2023: 7; 2024: 8; 2025: 9; 2026: 5.
47 papers.
Sort:
By area:
- 2021More Powerful Conditional Selective Inference for Generalized Lasso by Parametric Programmingcited by 24
- 2022Selective inference for k-means clusteringcited by 21
- 2023Valid P-Value for Deep Learning-Driven Salient Regioncited by 17
- 2021Conditional Selective Inference for Robust Regression and Outlier Detection using Piecewise-Linear Homotopy Continuationcited by 16
- 2021Fast and More Powerful Selective Inference for Sparse High-order Interaction Modelcited by 15
- 2021Tree-Values: selective inference for regression treescited by 15
- 2024Confidence on the Focal: Conformal Prediction with Selection-Conditional Coveragecited by 14
- 2021Data fission: splitting a single data pointcited by 13
- 2023DRCFS: Doubly Robust Causal Feature Selectioncited by 12
- 2021The Terminating-Random Experiments Selector: Fast High-Dimensional Variable Selection with False Discovery Rate Controlcited by 10
- 2021Valid and Exact Statistical Inference for Multi-dimensional Multiple Change-Points by Selective Inferencecited by 10
- 2022Valid Inference After Causal Discoverycited by 10
35 more
- 2023CAD-DA: Controllable Anomaly Detection after Domain Adaptation by Statistical Inferencecited by 10
- 2025PCS-UQ: Uncertainty Quantification via the Predictability-Computability-Stability Frameworkcited by 9
- 2021Exact Statistical Inference for the Wasserstein Distance by Selective Inferencecited by 7
- 2024Statistical Test for Attention Map in Vision Transformercited by 6
- 2024Statistical Test for Anomaly Detections by Variational Auto-Encoderscited by 6
- 2025A Statistical Case Against Empirical Human-AI Alignmentcited by 6
- 2023Selective Inference for Changepoint detection by Recurrent Neural Networkcited by 4
- 2021The Adaptive Multi-Factor Model and the Financial Marketcited by 3
- 2024Statistical Test for Feature Selection Pipelines by Selective Inferencecited by 3
- 2024Statistical Test for Auto Feature Engineering by Selective Inferencecited by 3
- 2025Quantifying Statistical Significance of Deep Nearest Neighbor Anomaly Detection via Selective Inferencecited by 3
- 2024Statistical Inference for Feature Selection after Optimal Transport-based Domain Adaptationcited by 2
- 2024Controllable RANSAC-based Anomaly Detection via Hypothesis Testingcited by 2
- 2025Change Point Detection in the Frequency Domain with Statistical Reliabilitycited by 2
- 2025Statistical Inference for Autoencoder-based Anomaly Detection after Representation Learning-based Domain Adaptationcited by 2
- 2026Data-driven sparse identification of governing PDEs via knockoff filters and multi-criteria trade-offscited by 2
- 2021Spatially relaxed inference on high-dimensional linear modelscited by 1
- 2022Multi-Study Boosting: Theoretical Considerations for Merging vs. Ensemblingcited by 1
- 2023Bounded P-values in Parametric Programming-based Selective Inferencecited by 1
- 2024Statistical Test for Diffusion-Based Anomaly Localization via Selective Inferencecited by 1
- 2025Statistical Test for Saliency Maps of Graph Neural Networks via Selective Inferencecited by 1
- 2026Bayesian Sparse Low-Rank Adaptation for Large Language Model Uncertainty Estimationcited by 1
- 2022Statistical Inference for the Dynamic Time Warping Distance, with Application to Abnormal Time-Series Detectioncited by 0
- 2022Adaptive Noisy Data Augmentation for Regularized Estimation and Inference in Generalized Linear Modelscited by 0
- 2022An Analysis of Selection Bias Issue for Online Advertisingcited by 0
- 2022Inferring independent sets of Gaussian variables after thresholding correlationscited by 0
- 2022Confidence Intervals for Unobserved Eventscited by 0
- 2023A parametric distribution for exact post-selection inference with data carvingcited by 0
- 2023Sparsified Simultaneous Confidence Intervals for High-Dimensional Linear Modelscited by 0
- 2025Post-Transfer Learning Statistical Inference in High-Dimensional Regressioncited by 0
- 2025Statistical Inference for Clustering-based Anomaly Detectioncited by 0
- 2025Spacing Test for Fused Lassocited by 0
- 2026Automatic Statistical Test for Rationally Expressible Algorithms by Selective Inference, with Applications to Feature Selectioncited by 0
- 2026Statistical Testing for Multiple Instance Learning via Selective Inference with Applications to Computational Pathologycited by 0
- 2026Post-Anomaly Detection Inference for Deep SVDDcited by 0
- 2026Post-Anomaly Detection Inference for Deep SVDD29 Sep 2026
- 2026Statistical Testing for Multiple Instance Learning via Selective Inference with Applications to Computational Pathology21 Sep 2026
- 2026Automatic Statistical Test for Rationally Expressible Algorithms by Selective Inference, with Applications to Feature Selection5 Aug 2026
- 2026Bayesian Sparse Low-Rank Adaptation for Large Language Model Uncertainty Estimation2 Jul 2026
- 2026Data-driven sparse identification of governing PDEs via knockoff filters and multi-criteria trade-offs26 May 2026
- 2025Spacing Test for Fused Lasso17 Sep 2025
- 2025Statistical Inference for Autoencoder-based Anomaly Detection after Representation Learning-based Domain Adaptation9 Aug 2025
- 2025Statistical Test for Saliency Maps of Graph Neural Networks via Selective Inference22 May 2025
- 2025PCS-UQ: Uncertainty Quantification via the Predictability-Computability-Stability Framework13 May 2025
- 2025Statistical Inference for Clustering-based Anomaly Detection25 Apr 2025
- 2025Post-Transfer Learning Statistical Inference in High-Dimensional Regression25 Apr 2025
- 2025A Statistical Case Against Empirical Human-AI Alignment20 Feb 2025
35 more
- 2025Quantifying Statistical Significance of Deep Nearest Neighbor Anomaly Detection via Selective Inference18 Feb 2025
- 2025Change Point Detection in the Frequency Domain with Statistical Reliability5 Feb 2025
- 2024Controllable RANSAC-based Anomaly Detection via Hypothesis Testing19 Oct 2024
- 2024Statistical Inference for Feature Selection after Optimal Transport-based Domain Adaptation19 Oct 2024
- 2024Statistical Test for Auto Feature Engineering by Selective Inference13 Oct 2024
- 2024Statistical Test for Feature Selection Pipelines by Selective Inference27 Jun 2024
- 2024Confidence on the Focal: Conformal Prediction with Selection-Conditional Coverage6 Mar 2024
- 2024Statistical Test for Diffusion-Based Anomaly Localization via Selective Inference19 Feb 2024
- 2024Statistical Test for Anomaly Detections by Variational Auto-Encoders6 Feb 2024
- 2024Statistical Test for Attention Map in Vision Transformer16 Jan 2024
- 2023Selective Inference for Changepoint detection by Recurrent Neural Network25 Nov 2023
- 2023CAD-DA: Controllable Anomaly Detection after Domain Adaptation by Statistical Inference23 Oct 2023
- 2023Bounded P-values in Parametric Programming-based Selective Inference21 Jul 2023
- 2023Sparsified Simultaneous Confidence Intervals for High-Dimensional Linear Models14 Jul 2023
- 2023DRCFS: Doubly Robust Causal Feature Selection12 Jun 2023
- 2023A parametric distribution for exact post-selection inference with data carving21 May 2023
- 2023Valid P-Value for Deep Learning-Driven Salient Region6 Jan 2023
- 2022Confidence Intervals for Unobserved Events6 Nov 2022
- 2022Inferring independent sets of Gaussian variables after thresholding correlations2 Nov 2022
- 2022Valid Inference After Causal Discovery11 Aug 2022
- 2022Multi-Study Boosting: Theoretical Considerations for Merging vs. Ensembling11 Jul 2022
- 2022An Analysis of Selection Bias Issue for Online Advertising7 Jun 2022
- 2022Adaptive Noisy Data Augmentation for Regularized Estimation and Inference in Generalized Linear Models18 Apr 2022
- 2022Selective inference for k-means clustering29 Mar 2022
- 2022Statistical Inference for the Dynamic Time Warping Distance, with Application to Abnormal Time-Series Detection14 Feb 2022
- 2021Data fission: splitting a single data point21 Dec 2021
- 2021Valid and Exact Statistical Inference for Multi-dimensional Multiple Change-Points by Selective Inference18 Oct 2021
- 2021The Terminating-Random Experiments Selector: Fast High-Dimensional Variable Selection with False Discovery Rate Control12 Oct 2021
- 2021Exact Statistical Inference for the Wasserstein Distance by Selective Inference29 Sep 2021
- 2021The Adaptive Multi-Factor Model and the Financial Market30 Jul 2021
- 2021Tree-Values: selective inference for regression trees15 Jun 2021
- 2021Fast and More Powerful Selective Inference for Sparse High-order Interaction Model9 Jun 2021
- 2021Spatially relaxed inference on high-dimensional linear models4 Jun 2021
- 2021More Powerful Conditional Selective Inference for Generalized Lasso by Parametric Programming11 May 2021
- 2021Conditional Selective Inference for Robust Regression and Outlier Detection using Piecewise-Linear Homotopy Continuation22 Apr 2021
- 2021More Powerful Conditional Selective Inference for Generalized Lasso by Parametric Programmingcited by 24
- 2022Selective inference for k-means clusteringcited by 21
- 2023Valid P-Value for Deep Learning-Driven Salient Regioncited by 17
- 2021Conditional Selective Inference for Robust Regression and Outlier Detection using Piecewise-Linear Homotopy Continuationcited by 16
- 2021Fast and More Powerful Selective Inference for Sparse High-order Interaction Modelcited by 15
- 2021Tree-Values: selective inference for regression treescited by 15
- 2024Confidence on the Focal: Conformal Prediction with Selection-Conditional Coveragecited by 14
- 2021Data fission: splitting a single data pointcited by 13
- 2023DRCFS: Doubly Robust Causal Feature Selectioncited by 12
- 2021The Terminating-Random Experiments Selector: Fast High-Dimensional Variable Selection with False Discovery Rate Controlcited by 10
- 2021Valid and Exact Statistical Inference for Multi-dimensional Multiple Change-Points by Selective Inferencecited by 10
- 2022Valid Inference After Causal Discoverycited by 10
12 most cited of 46 All 46 (JSON)
- 2026Post-Anomaly Detection Inference for Deep SVDD29 Sep 2026
- 2026Statistical Testing for Multiple Instance Learning via Selective Inference with Applications to Computational Pathology21 Sep 2026
- 2026Automatic Statistical Test for Rationally Expressible Algorithms by Selective Inference, with Applications to Feature Selection5 Aug 2026
- 2026Data-driven sparse identification of governing PDEs via knockoff filters and multi-criteria trade-offs26 May 2026
- 2025Spacing Test for Fused Lasso17 Sep 2025
- 2025Statistical Inference for Autoencoder-based Anomaly Detection after Representation Learning-based Domain Adaptation9 Aug 2025
- 2025Statistical Test for Saliency Maps of Graph Neural Networks via Selective Inference22 May 2025
- 2025PCS-UQ: Uncertainty Quantification via the Predictability-Computability-Stability Framework13 May 2025
- 2025Statistical Inference for Clustering-based Anomaly Detection25 Apr 2025
- 2025Post-Transfer Learning Statistical Inference in High-Dimensional Regression25 Apr 2025
- 2025A Statistical Case Against Empirical Human-AI Alignment20 Feb 2025
- 2025Quantifying Statistical Significance of Deep Nearest Neighbor Anomaly Detection via Selective Inference18 Feb 2025
12 newest of 46 All 46 (JSON)