Nested conformal prediction and quantile out-of-bag ensemble methods
Not on the map. Why?
Abstract (arXiv)
Conformal prediction is a popular tool for providing valid prediction sets for classification and regression problems, without relying on any distributional assumptions on the data. While the traditional description of conformal prediction starts with a nonconformity score, we provide an alternate (but equivalent) view that starts with a sequence of nested sets and calibrates them to find a valid prediction set. The nested framework subsumes all nonconformity scores, including recent proposals based on quantile regression and density estimation. While these ideas were originally derived based on sample splitting, our framework seamlessly extends them to other aggregation schemes like cross-conformal, jackknife+ and out-of-bag methods. We use the framework to derive a new algorithm (QOOB, pronounced cube) that combines four ideas: quantile regression, cross-conformalization, ensemble methods and out-of-bag predictions. We develop a computationally efficient implementation of cross-conformal, that is also used by QOOB. In a detailed numerical investigation, QOOB performs either the best or close to the best on all simulated and real datasets. Code for QOOB is available at https://github.com/aigen/QOOB.
Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 14; 2023: 16; 2024: 11; 2025: 26; 2026: 8.
88 papers.
Sort:
By area:
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 278
- 2021Testing for Outliers with Conformal p-valuescited by 133
- 2024Language Models with Conformal Factuality Guaranteescited by 128
- 2021Distribution-free uncertainty quantification for classification under label shiftcited by 99
- 2021Conformal Prediction using Conditional Histogramscited by 77
- 2023Improved Online Conformal Prediction via Strongly Adaptive Online Learningcited by 76
- 2022Sequential Predictive Conformal Inference for Time Seriescited by 71
- 2021Conformalized Survival Analysiscited by 53
- 2023How to Trust Your Diffusion Model: A Convex Optimization Approach to Conformal Risk Controlcited by 50
- 2021Calibrated Multiple-Output Quantile Regression with Representation Learningcited by 49
- 2021Improving Conditional Coverage via Orthogonal Quantile Regressioncited by 48
38 more
- 2021PAC Prediction Sets Under Covariate Shiftcited by 42
- 2022Improving Trustworthiness of AI Disease Severity Rating in Medical Imaging with Ordinal Conformal Prediction Setscited by 38
- 2025Decision Theoretic Foundations for Conformal Prediction: Optimal Uncertainty Quantification for Risk-Averse Agentscited by 37
- 2022Conformal Prediction Sets with Limited False Positivescited by 28
- 2023Principal Uncertainty Quantification with Spatial Correlation for Image Restoration Problemscited by 28
- 2023One-Shot Federated Conformal Predictioncited by 26
- 2022Efficient and Differentiable Conformal Prediction with General Function Classescited by 25
- 2023Probabilistically robust conformal predictioncited by 25
- 2023Conformal Prediction with Missing Valuescited by 24
- 2021Selective Ensembles for Consistent Predictionscited by 23
- 2024Probabilistic Conformal Prediction with Approximate Conditional Validitycited by 23
- 2023Transductive conformal inference with adaptive scorescited by 21
- 2025Conformal Linguistic Calibration: Trading-off between Factuality and Specificitycited by 20
- 2022Integrative conformal p-values for powerful out-of-distribution testing with labeled outlierscited by 19
- 2024Conformal Semantic Image Segmentation: Post-hoc Quantification of Predictive Uncertaintycited by 19
- 2023Integrating Uncertainty Awareness into Conformalized Quantile Regressioncited by 17
- 2021Learning Prediction Intervals for Regression: Generalization and Calibrationcited by 16
- 2023Improving Uncertainty Quantification of Deep Classifiers via Neighborhood Conformal Prediction: Novel Algorithm and Theoretical Analysiscited by 16
- 2023Derandomized Novelty Detection with FDR Control via Conformal E-valuescited by 15
- 2022Conformal Off-policy Predictioncited by 14
- 2022Predictive Inference with Weak Supervisioncited by 13
- 2024Multi-group Uncertainty Quantification for Long-form Text Generationcited by 13
- 2025Conformal Prediction for Image Segmentation Using Morphological Prediction Setscited by 13
- 2024Bellman Conformal Inference: Calibrating Prediction Intervals For Time Seriescited by 12
- 2024Conformal Thresholded Intervals for Efficient Regressioncited by 11
- 2021Exact Optimization of Conformal Predictors via Incremental and Decremental Learningcited by 10
- 2022Conformal Frequency Estimation using Discrete Sketched Data with Coverage for Distinct Queriescited by 10
- 2025Volume Optimality in Conformal Prediction with Structured Prediction Setscited by 9
- 2023Conformalized Unconditional Quantile Regressioncited by 8
- 2024Cross-Validation Conformal Risk Controlcited by 8
- 2025Response Quality Assessment for Retrieval-Augmented Generation via Conditional Conformal Factualitycited by 8
- 2024Robust Conformal Prediction Using Privileged Informationcited by 7
- 2025Guaranteed prediction sets for functional surrogate modelscited by 7
- 2025Parametric Scaling Law of Tuning Bias in Conformal Predictioncited by 7
- 2024Selecting informative conformal prediction sets with false coverage rate controlcited by 6
- 2025Volume-Sorted Prediction Set: Efficient Conformal Prediction for Multi-Target Regressioncited by 6
- 2025Document Summarization with Conformal Importance Guaranteescited by 6
- 2025Human-AI Collaborative Uncertainty Quantificationcited by 6
50 most cited of 88 All 88 (JSON)
- 2026Replicable Conformal Prediction23 Aug 2026
- 2026Set-Preserving Calibration from Conformal P-Values to E-Values2 Jun 2026
- 2026Leave a Window Out: Modifying the Jackknife for Predictive Inference in Time Series28 May 2026
- 2026Skew-adaptive conformal prediction15 May 2026
- 2026Conformal Agent Error Attribution7 May 2026
- 2026Uncertainty Quantification for Named Entity Recognition via Full-Sequence and Subsequence Conformal Prediction13 Jan 2026
- 2026Fast Conformal Prediction using Conditional Interquantile Intervals6 Jan 2026
- 2026Enhanced Data-Driven Product Development via Gradient Based Optimization and Conformalized Monte Carlo Dropout Uncertainty Estimation2 Jan 2026
- 2025E-Scores for (In)Correctness Assessment of Generative Model Outputs29 Oct 2025
- 2025Human-AI Collaborative Uncertainty Quantification27 Oct 2025
- 2025Centrum: Model-based Database Auto-tuning with Minimal Distributional Assumptions26 Oct 2025
- 2025Singleton-Optimized Conformal Prediction28 Sep 2025
38 more
- 2025Calibration Meets Reality: Making Machine Learning Predictions Trustworthy28 Sep 2025
- 2025Document Summarization with Conformal Importance Guarantees24 Sep 2025
- 2025Response Quality Assessment for Retrieval-Augmented Generation via Conditional Conformal Factuality26 Jun 2025
- 2025Conformal Mixed-Integer Constraint Learning with Feasibility Guarantees4 Jun 2025
- 2025Conformal Object Detection by Sequential Risk Control29 May 2025
- 2025MetaSTNet: Multimodal Meta-learning for Cellular Traffic Conformal Prediction26 May 2025
- 2025Conformalized Decision Risk Assessment19 May 2025
- 2025Stacked conformal prediction18 May 2025
- 2025Extreme Conformal Prediction: Reliable Intervals for High-Impact Events13 May 2025
- 2025Computing High-dimensional Confidence Sets for Arbitrary Distributions3 Apr 2025
- 2025Reliable uncertainty quantification for 2D/3D anatomical landmark localization using multi-output conformal prediction18 Mar 2025
- 2025Conformal Prediction for Image Segmentation Using Morphological Prediction Sets7 Mar 2025
- 2025Tightening optimality gap with confidence through conformal prediction6 Mar 2025
- 2025Volume-Sorted Prediction Set: Efficient Conformal Prediction for Multi-Target Regression4 Mar 2025
- 2025Improving the statistical efficiency of cross-conformal prediction3 Mar 2025
- 2025Conformal Linguistic Calibration: Trading-off between Factuality and Specificity26 Feb 2025
- 2025Volume Optimality in Conformal Prediction with Structured Prediction Sets23 Feb 2025
- 2025Efficient distributional regression trees learning algorithms for calibrated non-parametric probabilistic forecasts7 Feb 2025
- 2025Parametric Scaling Law of Tuning Bias in Conformal Prediction5 Feb 2025
- 2025Decision Theoretic Foundations for Conformal Prediction: Optimal Uncertainty Quantification for Risk-Averse Agents4 Feb 2025
- 2025Conformal Prediction in Hierarchical Classification with Constrained Representation Complexity31 Jan 2025
- 2025Guaranteed prediction sets for functional surrogate models30 Jan 2025
- 2024Multi-group Uncertainty Quantification for Long-form Text Generation25 Jul 2024
- 2024Conformal Thresholded Intervals for Efficient Regression19 Jul 2024
- 2024Probabilistic Conformal Prediction with Approximate Conditional Validity1 Jul 2024
- 2024Robust Conformal Prediction Using Privileged Information8 Jun 2024
- 2024Single Trajectory Conformal Prediction3 Jun 2024
- 2024Conformal Semantic Image Segmentation: Post-hoc Quantification of Predictive Uncertainty16 Apr 2024
- 2024Predictive Inference in Multi-environment Scenarios25 Mar 2024
- 2024Selecting informative conformal prediction sets with false coverage rate control18 Mar 2024
- 2024Language Models with Conformal Factuality Guarantees15 Feb 2024
- 2024Bellman Conformal Inference: Calibrating Prediction Intervals For Time Series7 Feb 2024
- 2024Cross-Validation Conformal Risk Control22 Jan 2024
- 2023Conformalized Deep Splines for Optimal and Efficient Prediction Sets1 Nov 2023
- 2023Transductive conformal inference with adaptive scores27 Oct 2023
- 2023Conformal Predictions for Longitudinal Data4 Oct 2023
- 2023Probabilistically robust conformal prediction31 Jul 2023
- 2023Integrating Uncertainty Awareness into Conformalized Quantile Regression14 Jun 2023
50 newest of 88 All 88 (JSON)
- 2026Conformal Agent Error Attributioncited by 3
- 2026Conformal Agent Error Attribution7 May 2026
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 278
- 2021Testing for Outliers with Conformal p-valuescited by 133
- 2024Language Models with Conformal Factuality Guaranteescited by 128
- 2021Distribution-free uncertainty quantification for classification under label shiftcited by 99
- 2021Conformal Prediction using Conditional Histogramscited by 77
- 2023Improved Online Conformal Prediction via Strongly Adaptive Online Learningcited by 76
- 2022Sequential Predictive Conformal Inference for Time Seriescited by 71
- 2021Conformalized Survival Analysiscited by 53
- 2021Calibrated Multiple-Output Quantile Regression with Representation Learningcited by 49
- 2021Improving Conditional Coverage via Orthogonal Quantile Regressioncited by 48
- 2021PAC Prediction Sets Under Covariate Shiftcited by 42
12 most cited of 85 All 85 (JSON)
- 2026Replicable Conformal Prediction23 Aug 2026
- 2026Set-Preserving Calibration from Conformal P-Values to E-Values2 Jun 2026
- 2026Leave a Window Out: Modifying the Jackknife for Predictive Inference in Time Series28 May 2026
- 2026Skew-adaptive conformal prediction15 May 2026
- 2026Uncertainty Quantification for Named Entity Recognition via Full-Sequence and Subsequence Conformal Prediction13 Jan 2026
- 2026Fast Conformal Prediction using Conditional Interquantile Intervals6 Jan 2026
- 2026Enhanced Data-Driven Product Development via Gradient Based Optimization and Conformalized Monte Carlo Dropout Uncertainty Estimation2 Jan 2026
- 2025E-Scores for (In)Correctness Assessment of Generative Model Outputs29 Oct 2025
- 2025Human-AI Collaborative Uncertainty Quantification27 Oct 2025
- 2025Centrum: Model-based Database Auto-tuning with Minimal Distributional Assumptions26 Oct 2025
- 2025Singleton-Optimized Conformal Prediction28 Sep 2025
- 2025Calibration Meets Reality: Making Machine Learning Predictions Trustworthy28 Sep 2025
12 newest of 85 All 85 (JSON)