PAC Confidence Sets for Deep Neural Networks via Calibrated Prediction
Not on the map. Why?
Abstract (arXiv)
We propose an algorithm combining calibrated prediction and generalization bounds from learning theory to construct confidence sets for deep neural networks with PAC guarantees---i.e., the confidence set for a given input contains the true label with high probability. We demonstrate how our approach can be used to construct PAC confidence sets on ResNet for ImageNet, a visual object tracking model, and a dynamics model for the half-cheetah reinforcement learning problem.
Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 7; 2022: 14; 2023: 13; 2024: 14; 2025: 7; 2026: 3.
59 papers.
Sort:
By area:
- 2022Conformal Risk Controlcited by 290
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 278
- 2021Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Controlcited by 256
- 2021Testing for Outliers with Conformal p-valuescited by 133
- 2023Improved Online Conformal Prediction via Strongly Adaptive Online Learningcited by 76
- 2022Batch Multivalid Conformal Predictioncited by 66
- 2022Practical Adversarial Multivalid Conformal Predictioncited by 65
- 2023Credal Bayesian Deep Learningcited by 45
- 2021PAC Prediction Sets Under Covariate Shiftcited by 42
- 2024Length Optimization in Conformal Predictioncited by 39
- 2023Conformal Prediction Regions for Time Series using Linear Complementarity Programmingcited by 33
- 2024Fast yet Safe: Early-Exiting with Risk Controlcited by 27
38 more
- 2022Efficient and Differentiable Conformal Prediction with General Function Classescited by 25
- 2024Conformal Prediction: A Data Perspectivecited by 25
- 2023TRAQ: Trustworthy Retrieval Augmented Question Answering via Conformal Predictioncited by 23
- 2024Adaptive Bounding Box Uncertainties via Two-Step Conformal Predictioncited by 23
- 2024Conformal Prediction with Learned Featurescited by 23
- 2023Confident Object Detection via Conformal Prediction and Conformal Risk Control: an Application to Railway Signalingcited by 22
- 2023PAC Prediction Sets Under Label Shiftcited by 19
- 2024Conformal Semantic Image Segmentation: Post-hoc Quantification of Predictive Uncertaintycited by 19
- 2023Prompt Risk Control: A Rigorous Framework for Responsible Deployment of Large Language Modelscited by 17
- 2021Private Prediction Setscited by 16
- 2022UQGAN: A Unified Model for Uncertainty Quantification of Deep Classifiers trained via Conditional GANscited by 16
- 2022PAC Prediction Sets for Meta-Learningcited by 16
- 2023Improving Uncertainty Quantification of Deep Classifiers via Neighborhood Conformal Prediction: Novel Algorithm and Theoretical Analysiscited by 16
- 2023Selective Generation for Controllable Language Modelscited by 15
- 2022Recommendation Systems with Distribution-Free Reliability Guaranteescited by 13
- 2024Semi-Supervised Risk Control via Prediction-Powered Inferencecited by 13
- 2022PAC-Wrap: Semi-Supervised PAC Anomaly Detectioncited by 10
- 2024Conformal Structured Predictioncited by 9
- 2022Towards PAC Multi-Object Detection and Trackingcited by 8
- 2023SymmPI: Predictive Inference for Data with Group Symmetriescited by 8
- 2024Conformal Risk Control for Ordinal Classificationcited by 8
- 2024Stochastic Online Conformal Prediction with Semi-Bandit Feedbackcited by 7
- 2025Conformal Information Pursuit for Interactively Guiding Large Language Modelscited by 7
- 2022Risk Verification of Stochastic Systems with Neural Network Controllerscited by 6
- 2023PAC Prediction Sets for Large Language Models of Codecited by 5
- 2022Distribution-Free Finite-Sample Guarantees and Split Conformal Predictioncited by 4
- 2024Uncertainty Quantification for Neurosymbolic Programs via Compositional Conformal Predictioncited by 4
- 2025LEC: Linear Expectation Constraints for Selection-Conditioned Risk Control in Selective Prediction and Routing Systemscited by 4
- 2023CAMMARL: Conformal Action Modeling in Multi Agent Reinforcement Learningcited by 3
- 2024Marginal and training-conditional guarantees in one-shot federated conformal predictioncited by 3
- 2025Conformal Object Detection by Sequential Risk Controlcited by 3
- 2025Colorful Pinball: Density-Weighted Quantile Regression for Conditional Guarantee of Conformal Predictioncited by 3
- 2022ACon2: Adaptive Conformal Consensus for Provable Blockchain Oraclescited by 2
- 2021Label Smoothed Embedding Hypothesis for Out-of-Distribution Detectioncited by 1
- 2022Certified Error Control of Candidate Set Pruning for Two-Stage Relevance Rankingcited by 1
- 2023PAC-Based Formal Verification for Out-of-Distribution Data Detectioncited by 1
- 2024Conformal Predictions for Probabilistically Robust Scalable Machine Learning Classificationcited by 1
- 2020MPC-guided Imitation Learning of Neural Network Policies for the Artificial Pancreascited by 0
50 most cited of 59 All 59 (JSON)
- 2026The Label Complexity of Useful Class-Conditional Prediction Sets under Distribution Shift20 Jul 2026
- 2026Uncertainty Quantification for LLM-based Code Generation12 May 2026
- 2026Elements of Conformal Prediction25 Mar 2026
- 2025Colorful Pinball: Density-Weighted Quantile Regression for Conditional Guarantee of Conformal Prediction30 Dec 2025
- 2025A Critical Perspective on Finite Sample Conformal Prediction Theory in Medical Applications9 Dec 2025
- 2025LEC: Linear Expectation Constraints for Selection-Conditioned Risk Control in Selective Prediction and Routing Systems1 Dec 2025
- 2025CoVeR: Conformal Calibration for Versatile and Reliable Autoregressive Next-Token Prediction5 Sep 2025
- 2025Conformal Information Pursuit for Interactively Guiding Large Language Models4 Jul 2025
- 2025Position: There Is No Free Bayesian Uncertainty Quantification4 Jun 2025
- 2025Conformal Object Detection by Sequential Risk Control29 May 2025
- 2024Semi-Supervised Risk Control via Prediction-Powered Inference15 Dec 2024
- 2024Fundus Image-based Visual Acuity Assessment with PAC-Guarantees9 Dec 2024
38 more
- 2024Conformal Prediction: A Data Perspective9 Oct 2024
- 2024Conformal Structured Prediction8 Oct 2024
- 2024Length Optimization in Conformal Prediction27 Jun 2024
- 2024Fast yet Safe: Early-Exiting with Risk Control31 May 2024
- 2024Uncertainty Quantification for Neurosymbolic Programs via Compositional Conformal Prediction24 May 2024
- 2024Stochastic Online Conformal Prediction with Semi-Bandit Feedback22 May 2024
- 2024Marginal and training-conditional guarantees in one-shot federated conformal prediction21 May 2024
- 2024Conformal Risk Control for Ordinal Classification1 May 2024
- 2024Conformal Prediction with Learned Features26 Apr 2024
- 2024Conformal Semantic Image Segmentation: Post-hoc Quantification of Predictive Uncertainty16 Apr 2024
- 2024Conformal Predictions for Probabilistically Robust Scalable Machine Learning Classification15 Mar 2024
- 2024Adaptive Bounding Box Uncertainties via Two-Step Conformal Prediction12 Mar 2024
- 2023SymmPI: Predictive Inference for Data with Group Symmetries26 Dec 2023
- 2023Prompt Risk Control: A Rigorous Framework for Responsible Deployment of Large Language Models22 Nov 2023
- 2023PAC Prediction Sets Under Label Shift19 Oct 2023
- 2023Selective Generation for Controllable Language Models18 Jul 2023
- 2023TRAQ: Trustworthy Retrieval Augmented Question Answering via Conformal Prediction7 Jul 2023
- 2023CAMMARL: Conformal Action Modeling in Multi Agent Reinforcement Learning19 Jun 2023
- 2023Confident Object Detection via Conformal Prediction and Conformal Risk Control: an Application to Railway Signaling12 Apr 2023
- 2023PAC-Based Formal Verification for Out-of-Distribution Data Detection4 Apr 2023
- 2023Conformal Prediction Regions for Time Series using Linear Complementarity Programming3 Apr 2023
- 2023Improving Uncertainty Quantification of Deep Classifiers via Neighborhood Conformal Prediction: Novel Algorithm and Theoretical Analysis19 Mar 2023
- 2023Credal Bayesian Deep Learning19 Feb 2023
- 2023PAC Prediction Sets for Large Language Models of Code17 Feb 2023
- 2023Improved Online Conformal Prediction via Strongly Adaptive Online Learning15 Feb 2023
- 2022ACon2: Adaptive Conformal Consensus for Provable Blockchain Oracles17 Nov 2022
- 2022Ruby: Unmasking Unsafe Rust in Stripped Binaries via Machine Learning31 Oct 2022
- 2022Distribution-Free Finite-Sample Guarantees and Split Conformal Prediction26 Oct 2022
- 2022Batch Multivalid Conformal Prediction30 Sep 2022
- 2022Risk Verification of Stochastic Systems with Neural Network Controllers26 Aug 2022
- 2022Conformal Risk Control4 Aug 2022
- 2022PAC Prediction Sets for Meta-Learning6 Jul 2022
- 2022Recommendation Systems with Distribution-Free Reliability Guarantees4 Jul 2022
- 2022Practical Adversarial Multivalid Conformal Prediction2 Jun 2022
- 2022PAC-Wrap: Semi-Supervised PAC Anomaly Detection22 May 2022
- 2022Certified Error Control of Candidate Set Pruning for Two-Stage Relevance Ranking19 May 2022
- 2022Towards PAC Multi-Object Detection and Tracking15 Apr 2022
- 2022Efficient and Differentiable Conformal Prediction with General Function Classes22 Feb 2022
50 newest of 59 All 59 (JSON)
- 2024Fast yet Safe: Early-Exiting with Risk Controlcited by 27
- 2024Fast yet Safe: Early-Exiting with Risk Control31 May 2024
- 2022Conformal Risk Controlcited by 290
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 278
- 2021Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Controlcited by 256
- 2021Testing for Outliers with Conformal p-valuescited by 133
- 2023Improved Online Conformal Prediction via Strongly Adaptive Online Learningcited by 76
- 2022Batch Multivalid Conformal Predictioncited by 66
- 2022Practical Adversarial Multivalid Conformal Predictioncited by 65
- 2023Credal Bayesian Deep Learningcited by 45
- 2021PAC Prediction Sets Under Covariate Shiftcited by 42
- 2024Length Optimization in Conformal Predictioncited by 39
- 2023Conformal Prediction Regions for Time Series using Linear Complementarity Programmingcited by 33
- 2022Efficient and Differentiable Conformal Prediction with General Function Classescited by 25
12 most cited of 56 All 56 (JSON)
- 2026The Label Complexity of Useful Class-Conditional Prediction Sets under Distribution Shift20 Jul 2026
- 2026Uncertainty Quantification for LLM-based Code Generation12 May 2026
- 2026Elements of Conformal Prediction25 Mar 2026
- 2025Colorful Pinball: Density-Weighted Quantile Regression for Conditional Guarantee of Conformal Prediction30 Dec 2025
- 2025A Critical Perspective on Finite Sample Conformal Prediction Theory in Medical Applications9 Dec 2025
- 2025LEC: Linear Expectation Constraints for Selection-Conditioned Risk Control in Selective Prediction and Routing Systems1 Dec 2025
- 2025CoVeR: Conformal Calibration for Versatile and Reliable Autoregressive Next-Token Prediction5 Sep 2025
- 2025Conformal Information Pursuit for Interactively Guiding Large Language Models4 Jul 2025
- 2025Position: There Is No Free Bayesian Uncertainty Quantification4 Jun 2025
- 2025Conformal Object Detection by Sequential Risk Control29 May 2025
- 2024Semi-Supervised Risk Control via Prediction-Powered Inference15 Dec 2024
- 2024Fundus Image-based Visual Acuity Assessment with PAC-Guarantees9 Dec 2024
12 newest of 56 All 56 (JSON)