A Confidence Machine for Sparse High-Order Interaction Model
Not on the map. Why?
Abstract (arXiv)
In predictive modeling for high-stake decision-making, predictors must be not only accurate but also reliable. Conformal prediction (CP) is a promising approach for obtaining the confidence of prediction results with fewer theoretical assumptions. To obtain the confidence set by so-called full-CP, we need to refit the predictor for all possible values of prediction results, which is only possible for simple predictors. For complex predictors such as random forests (RFs) or neural networks (NNs), split-CP is often employed where the data is split into two parts: one part for fitting and another to compute the confidence set. Unfortunately, because of the reduced sample size, split-CP is inferior to full-CP both in fitting as well as confidence set computation. In this paper, we develop a full-CP of sparse high-order interaction model (SHIM), which is sufficiently flexible as it can take into account high-order interactions among variables. We resolve the computational challenge for full-CP of SHIM by introducing a novel approach called homotopy mining. Through numerical experiments, we demonstrate that SHIM is as accurate as complex predictors such as RF and NN and enjoys the superior statistical power of full-CP.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 56 references that are in the map. First posted on arXiv 28 May 2022.
Builds on
24 of 56 references.
References · 24
- 2016Distribution-Free Predictive Inference For Regressioncited by 657
- 2020Uncertainty Sets for Image Classifiers using Conformal Predictioncited by 365
- 2022Conformal prediction beyond exchangeabilitycited by 348
- 2016Least Ambiguous Set-Valued Classifiers with Bounded Error Levelscited by 270
- 2021User-friendly introduction to PAC-Bayes boundscited by 234
- 2019Predictive inference with the jackknife+cited by 206
- 2020Conformal Inference of Counterfactuals and Individual Treatment Effectscited by 150
- 2021Testing for Outliers with Conformal p-valuescited by 133
- 2013Exact post-selection inference, with application to the lassocited by 90
- 2019Nested conformal prediction and quantile out-of-bag ensemble methodscited by 88
- 2014Optimal Inference After Model Selectioncited by 63
- 2021Few-shot Conformal Prediction with Auxiliary Taskscited by 53
12 more
- 2018Distribution-Free Prediction Sets for Two-Layer Hierarchical Modelscited by 34
- 2020Computing Valid p-value for Optimal Changepoint by Selective Inference using Dynamic Programmingcited by 25
- 2021Conformal prediction for text infilling and part-of-speech predictioncited by 22
- 2021Multi Split Conformal Predictioncited by 21
- 2017Fast Exact Conformalization of Lasso using Piecewise Linear Homotopycited by 20
- 2019Computing Full Conformal Prediction Set with Approximate Homotopycited by 19
- 2021Fast and More Powerful Selective Inference for Sparse High-order Interaction Modelcited by 15
- 2016Safe Pattern Pruning: An Efficient Approach for Predictive Pattern Miningcited by 13
- 2022Approximating Full Conformal Prediction at Scale via Influence Functionscited by 11
- 2021Exact Optimization of Conformal Predictors via Incremental and Decremental Learningcited by 10
- 2021Root-finding Approaches for Computing Conformal Prediction Setcited by 8
- 2018The Well Tempered Lassocited by 1
Built on by
Citing papers per year: 2023: 1.
1 paper.