mlsanityData to 7 Oct 2026

Class-Conditional Conformal Prediction with Many Classes

arXiv 2306.09335 ↗First posted 15 Jun 2023stat.ML cs.CV cs.LGcited by 109

Not on the map. Why?

Abstract (arXiv)

Standard conformal prediction methods provide a marginal coverage guarantee, which means that for a random test point, the conformal prediction set contains the true label with a user-specified probability. In many classification problems, we would like to obtain a stronger guarantee--that for test points of a specific class, the prediction set contains the true label with the same user-chosen probability. For the latter goal, existing conformal prediction methods do not work well when there is a limited amount of labeled data per class, as is often the case in real applications where the number of classes is large. We propose a method called clustered conformal prediction that clusters together classes having "similar" conformal scores and performs conformal prediction at the cluster level. Based on empirical evaluation across four image data sets with many (up to 1000) classes, we find that clustered conformal typically outperforms existing methods in terms of class-conditional coverage and set size metrics.

Key facts. Cited by 109 papers in the map (data through 7 Oct 2026). Builds on 15 of its 29 references that are in the map. First posted on arXiv 15 Jun 2023.

Builds on

15 of 29 references.

References · 15

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  3. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
  4. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
  5. 2016Distribution-Free Predictive Inference For Regressioncited by 657
  6. 2019Conformalized Quantile Regressioncited by 620
  7. 2020Classification with Valid and Adaptive Coveragecited by 390
  8. 2020Uncertainty Sets for Image Classifiers using Conformal Predictioncited by 365
  9. 2016Least Ambiguous Set-Valued Classifiers with Bounded Error Levelscited by 270
  10. 2023Conformal Prediction With Conditional Guaranteescited by 146
  11. 2021Localized Conformal Prediction: A Generalized Inference Framework for Conformal Predictioncited by 112
  12. 2022Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in Imagingcited by 107
3 more
  1. 2019Prediction and outlier detection in classification problemscited by 44
  2. 2019With Malice Towards None: Assessing Uncertainty via Equalized Coveragecited by 43
  3. 2018Cautious Deep Learningcited by 35

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 25; 2025: 39; 2026: 42.

109 papers.

Sort:

By area:

  1. 2024Language Models with Conformal Factuality Guaranteescited by 128
  2. 2023Conformal Prediction for Deep Classifier via Label Rankingcited by 52
  3. 2024Length Optimization in Conformal Predictioncited by 39
  4. 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failurescited by 30
  5. 2024Conformal Prediction: A Data Perspectivecited by 25
  6. 2024Conformal Prediction with Learned Featurescited by 23
  7. 2024Conformal Prediction for Class-wise Coverage via Augmented Label Rank Calibrationcited by 18
  8. 2025Rectifying Conformity Scores for Better Conditional Coveragecited by 17
  9. 2024Self-Calibrating Conformal Predictioncited by 16
  10. 2023Kandinsky Conformal Prediction: Efficient Calibration of Image Segmentation Algorithmscited by 14
  11. 2024Conformal Prediction Sets Can Cause Disparate Impactcited by 14
  12. 2025Conformal Prediction for Zero-Shot Modelscited by 14
38 more
  1. 2024On Temperature Scaling and Conformal Prediction of Deep Classifierscited by 13
  2. 2024Semi-Supervised Risk Control via Prediction-Powered Inferencecited by 13
  3. 2024Are foundation models for computer vision good conformal predictors?cited by 12
  4. 2025Kandinsky Conformal Prediction: Beyond Class- and Covariate-Conditional Coveragecited by 12
  5. 2024TorchCP: A Python Library for Conformal Predictioncited by 9
  6. 2025Synthetic-Powered Predictive Inferencecited by 9
  7. 2025Full Conformal Adaptation of Medical Vision-Language Modelscited by 9
  8. 2024Entropy Reweighted Conformal Classificationcited by 8
  9. 2024Multi-model Ensemble Conformal Prediction in Dynamic Environmentscited by 8
  10. 2025Direct Prediction Set Minimization via Bilevel Conformal Classifier Trainingcited by 8
  11. 2025Trustworthy Few-Shot Transfer of Medical VLMs through Split Conformal Predictioncited by 8
  12. 2025Conditional Coverage Diagnostics for Conformal Predictioncited by 8
  13. 2024C-Adapter: Adapting Deep Classifiers for Efficient Conformal Prediction Setscited by 7
  14. 2025Conformal Prediction and MLLM aided Uncertainty Quantification in Scene Graph Generationcited by 7
  15. 2025A Generic Framework for Conformal Fairnesscited by 7
  16. 2025Conformal Prediction for Long-Tailed Classificationcited by 7
  17. 2024Conformal Predictive Programming for Chance Constrained Optimizationcited by 6
  18. 2024Selecting informative conformal prediction sets with false coverage rate controlcited by 6
  19. 2025Reducing Aleatoric and Epistemic Uncertainty through Multi-modal Data Acquisitioncited by 5
  20. 2025Conditional Conformal Risk Adaptationcited by 5
  21. 2025Conformal Prediction Meets Long-tail Classificationcited by 5
  22. 2025Trustworthy AI Must Account for Interactionscited by 4
  23. 2025Predicate-Conditional Conformalized Answer Sets for Knowledge Graph Embeddingscited by 4
  24. 2025Efficient Robust Conformal Prediction via Lipschitz-Bounded Networkscited by 4
  25. 2024Efficient Online Set-valued Classification with Bandit Feedbackcited by 3
  26. 2024Conditional Prediction ROC Bands for Graph Classificationcited by 3
  27. 2025ConfIC-RCA: Statistically Grounded Efficient Estimation of Segmentation Qualitycited by 3
  28. 2025Test-time augmentation improves efficiency in conformal predictioncited by 3
  29. 2025Multi-model Online Conformal Prediction with Graph-Structured Feedbackcited by 3
  30. 2025ATTS: Asynchronous Test-Time Scaling via Conformal Predictioncited by 3
  31. 2025Controlling the Risk of Corrupted Contexts for Language Models via Early-Exitingcited by 3
  32. 2025Conformal Inference for Open-Set and Imbalanced Classificationcited by 3
  33. 2025Colorful Pinball: Density-Weighted Quantile Regression for Conditional Guarantee of Conformal Predictioncited by 3
  34. 2024Conformal Calibration of Statistical Confidence Setscited by 2
  35. 2024On the Role of Surrogates in Conformal Inference of Individual Causal Effectscited by 2
  36. 2025Hierarchical Conformal Classificationcited by 2
  37. 2025Towards Reliable and Holistic Visual In-Context Learning Prompt Selectioncited by 2
  38. 2026Beyond Procedure: Substantive Fairness in Conformal Predictioncited by 2

50 most cited of 109 All 109 (JSON)