mlsanityData to 14 Oct 2026

Conformal Prediction for Deep Classifier via Label Ranking

arXiv 2310.06430 ↗First posted 10 Oct 2023cs.LG cs.CV math.STcited by 53

Not on the map. Why?

Abstract (arXiv)

Conformal prediction is a statistical framework that generates prediction sets containing ground-truth labels with a desired coverage guarantee. The predicted probabilities produced by machine learning models are generally miscalibrated, leading to large prediction sets in conformal prediction. To address this issue, we propose a novel algorithm named textitSorted Adaptive Prediction Sets (SAPS), which discards all the probability values except for the maximum softmax probability. The key idea behind SAPS is to minimize the dependence of the non-conformity score on the probability values while retaining the uncertainty information. In this manner, SAPS can produce compact prediction sets and communicate instance-wise uncertainty. Extensive experiments validate that SAPS not only lessens the prediction sets but also broadly enhances the conditional coverage rate of prediction sets.

Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 50 of its 86 references that are in the map. First posted on arXiv 10 Oct 2023.

Builds on

50 of 86 references.

References · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2017On Calibration of Modern Neural Networkscited by 4,960
  4. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  5. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  6. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  7. 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
  8. 2016End to End Learning for Self-Driving Carscited by 1,009
  9. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 792
  10. 2019Conformalized Quantile Regressioncited by 629
  11. 2019Conformal Prediction Under Covariate Shiftcited by 519
  12. 2020Classification with Valid and Adaptive Coveragecited by 396
38 more
  1. 2020Uncertainty Sets for Image Classifiers using Conformal Predictioncited by 366
  2. 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 308
  3. 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
  4. 2016Least Ambiguous Set-Valued Classifiers with Bounded Error Levelscited by 272
  5. 2019Predictive inference with the jackknife+cited by 211
  6. 2023Conformal Language Modelingcited by 170
  7. 2023Conformal Prediction With Conditional Guaranteescited by 152
  8. 2023Conformal Prediction with Large Language Models for Multi-Choice Question Answeringcited by 139
  9. 2021Testing for Outliers with Conformal p-valuescited by 134
  10. 2021Learning Optimal Conformal Classifierscited by 112
  11. 2023Class-Conditional Conformal Prediction with Many Classescited by 109
  12. 2021Distribution-free uncertainty quantification for classification under label shiftcited by 101
  13. 2013A Conformal Prediction Approach to Explore Functional Datacited by 86
  14. 2022Training Uncertainty-Aware Classifiers with Conformalized Deep Learningcited by 64
  15. 2022Improving Expert Predictions with Conformal Predictioncited by 54
  16. 2021Few-shot Conformal Prediction with Auxiliary Taskscited by 53
  17. 2023How to Trust Your Diffusion Model: A Convex Optimization Approach to Conformal Risk Controlcited by 50
  18. 2023Federated Conformal Predictors for Distributed Uncertainty Quantificationcited by 46
  19. 2019Prediction and outlier detection in classification problemscited by 44
  20. 2022Predictive Inference with Feature Conformal Predictioncited by 34
  21. 2022Conffusion: Confidence Intervals for Diffusion Modelscited by 33
  22. 2023Conformal Prediction for Federated Uncertainty Quantification Under Label Shiftcited by 29
  23. 2021Optimized conformal classification using gradient descent approximationcited by 28
  24. 2022Conformal Prediction Sets with Limited False Positivescited by 28
  25. 2022Distribution Free Prediction Sets for Node Classificationcited by 28
  26. 2022Efficient and Differentiable Conformal Prediction with General Function Classescited by 26
  27. 2023Adaptive conformal classification with noisy labelscited by 25
  28. 2023Conformal Temporal Logic Planning using Large Language Modelscited by 21
  29. 2020Training conformal predictorscited by 20
  30. 2022Label Noise Robustness of Conformal Predictioncited by 20
  31. 2023HappyMap: A Generalized Multi-calibration Methodcited by 18
  32. 2021Learning Prediction Intervals for Regression: Generalization and Calibrationcited by 16
  33. 2023Improving Uncertainty Quantification of Deep Classifiers via Neighborhood Conformal Prediction: Novel Algorithm and Theoretical Analysiscited by 16
  34. 2023Conformal inference is (almost) free for neural networks trained with early stoppingcited by 14
  35. 2023Group-Conditional Conformal Prediction via Quantile Regression Calibration for Crop and Weed Classificationcited by 9
  36. 2022Prediction Sets for High-Dimensional Mixture of Experts Modelscited by 8
  37. 2022A Cross-Conformal Predictor for Multi-label Classificationcited by 8
  38. 2022Batch-Ensemble Stochastic Neural Networks for Out-of-Distribution Detectioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 17; 2025: 22; 2026: 14.

53 papers.

Sort:

By area:

  1. 2024API Is Enough: Conformal Prediction for Large Language Models Without Logit-Accesscited by 69
  2. 2024Towards Human-AI Complementarity with Prediction Setscited by 25
  3. 2024Conformal Prediction: A Data Perspectivecited by 25
  4. 2024Trustworthy Classification through Rank-Based Conformal Prediction Setscited by 20
  5. 2024Conformal Prediction for Class-wise Coverage via Augmented Label Rank Calibrationcited by 19
  6. 2025Conformal Prediction for Zero-Shot Modelscited by 15
  7. 2024Conformal Prediction Sets Can Cause Disparate Impactcited by 14
  8. 2024Does confidence calibration improve conformal prediction?cited by 12
  9. 2024Weighted Aggregation of Conformity Scores for Classificationcited by 11
  10. 2024Uncertainty quantification for probabilistic machine learning in earth observation using conformal predictioncited by 9
  11. 2024TorchCP: A Python Library for Conformal Predictioncited by 9
  12. 2024Controlling Counterfactual Harm in Decision Support Systems Based on Prediction Setscited by 9
38 more
  1. 2024Entropy Reweighted Conformal Classificationcited by 8
  2. 2025Direct Prediction Set Minimization via Bilevel Conformal Classifier Trainingcited by 8
  3. 2024Similarity-Navigated Conformal Prediction for Graph Neural Networkscited by 7
  4. 2024C-Adapter: Adapting Deep Classifiers for Efficient Conformal Prediction Setscited by 7
  5. 2025Parametric Scaling Law of Tuning Bias in Conformal Predictioncited by 7
  6. 2025Conformal Prediction for Long-Tailed Classificationcited by 7
  7. 2024Valid Conformal Prediction for Dynamic GNNscited by 6
  8. 2025Volume-Sorted Prediction Set: Efficient Conformal Prediction for Multi-Target Regressioncited by 6
  9. 2025Document Summarization with Conformal Importance Guaranteescited by 6
  10. 2026From Debate to Decision: Conformal Social Choice for Safe Multi-Agent Deliberationcited by 6
  11. 2024Spatial-Aware Conformal Prediction for Trustworthy Hyperspectral Image Classificationcited by 5
  12. 2024Towards Trustworthy Knowledge Graph Reasoning: An Uncertainty Aware Perspectivecited by 5
  13. 2025Exploring the Noise Robustness of Online Conformal Predictioncited by 5
  14. 2025Trustworthy AI Must Account for Interactionscited by 5
  15. 2025Conformal Prediction Meets Long-tail Classificationcited by 5
  16. 2026Conformal Agent Error Attributioncited by 4
  17. 2025Tackling Fake Forgetting through Uncertainty Quantificationcited by 3
  18. 2025Online Conformal Selection with Accept-to-Reject Changescited by 3
  19. 2025ATTS: Asynchronous Test-Time Scaling via Conformal Predictioncited by 3
  20. 2025CLAPS: Aleatoric-Epistemic Scaling via Last-Layer Laplace for Conformal Regressioncited by 2
  21. 2026Beyond Procedure: Substantive Fairness in Conformal Predictioncited by 2
  22. 2025Adaptive Cumulative Mass Calibration with Conformal Predictioncited by 1
  23. 2025Semi-Supervised Conformal Prediction With Unlabeled Nonconformity Scorecited by 1
  24. 2025Performance of Conformal Prediction in Capturing Aleatoric Uncertaintycited by 1
  25. 2025Provable Training Data Identification for Large Language Modelscited by 1
  26. 2025Provably Minimum-Length Conformal Prediction Sets for Ordinal Classificationcited by 1
  27. 2026Improving Backward Conformal Prediction via Non-Conformity Score Transformationcited by 1
  28. 2025Quantifying and Improving Adaptivity in Conformal Prediction through Input Transformationscited by 0
  29. 2025Cost-Sensitive Conformal Training with Provably Controllable Learning Boundscited by 0
  30. 2025Enhancing Conformal Prediction via Class Similaritycited by 0
  31. 2025Conformal Correction for Efficiency May be at Odds with Entropycited by 0
  32. 2026Softmax is not Enough (for Adaptive Conformal Classification)cited by 0
  33. 2026DANCE: Doubly Adaptive Neighborhood Conformal Estimationcited by 0
  34. 2026Delving into Non-Exchangeability for Conformal Prediction in Graph-Structured Multivariate Time Seriescited by 0
  35. 2026Cluster Frequency Conformal Prediction for Local Coveragecited by 0
  36. 2026Benchmarking non-conformity score functions in conformal predictioncited by 0
  37. 2026Judgment-Grounded Expansion for Peer Review Generationcited by 0
  38. 2026Self-Organized Conformal Prediction: Reducing Regional Coverage Gaps with Unsupervised Group Discoverycited by 0

50 most cited of 53 All 53 (JSON)