mlsanityData to 14 Oct 2026

Weighted Aggregation of Conformity Scores for Classification

arXiv 2407.10230 ↗First posted 14 Jul 2024stat.ML cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

Conformal prediction is a powerful framework for constructing prediction sets with valid coverage guarantees in multi-class classification. However, existing methods often rely on a single score function, which can limit their efficiency and informativeness. We propose a novel approach that combines multiple score functions to improve the performance of conformal predictors by identifying optimal weights that minimize prediction set size. Our theoretical analysis establishes a connection between the weighted score functions and subgraph classes of functions studied in Vapnik-Chervonenkis theory, providing a rigorous mathematical basis for understanding the effectiveness of the proposed method. Experiments demonstrate that our approach consistently outperforms single-score conformal predictors while maintaining valid coverage, offering a principled and data-driven way to enhance the efficiency and practicality of conformal prediction in classification tasks.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 29 of its 51 references that are in the map. First posted on arXiv 14 Jul 2024.

Builds on

29 of 51 references.

References · 29

  1. 2017On Calibration of Modern Neural Networkscited by 4,960
  2. 2019Conformalized Quantile Regressioncited by 629
  3. 2021RepVGG: Making VGG-style ConvNets Great Againcited by 522
  4. 2019Conformal Prediction Under Covariate Shiftcited by 519
  5. 2020Classification with Valid and Adaptive Coveragecited by 396
  6. 2020Uncertainty Sets for Image Classifiers using Conformal Predictioncited by 366
  7. 2022Conformal Risk Controlcited by 299
  8. 2016Least Ambiguous Set-Valued Classifiers with Bounded Error Levelscited by 272
  9. 2019Predictive inference with the jackknife+cited by 211
  10. 2023Conformal Prediction With Conditional Guaranteescited by 152
  11. 2021Localized Conformal Prediction: A Generalized Inference Framework for Conformal Predictioncited by 114
  12. 2019Distributional conformal predictioncited by 105
17 more
  1. 2020Intra Order-preserving Functions for Calibration of Multi-Class Neural Networkscited by 65
  2. 2019Flexible distribution-free conditional predictive bands using density estimatorscited by 64
  3. 2014Regression Conformal Prediction with Nearest Neighbourscited by 59
  4. 2019Adaptive, Distribution-Free Prediction Intervals for Deep Networkscited by 56
  5. 2020Predictive Inference Is Free with the Jackknife+-after-Bootstrapcited by 55
  6. 2021Conformalized Survival Analysiscited by 53
  7. 2023Conformal Prediction for Deep Classifier via Label Rankingcited by 53
  8. 2021Selection and Aggregation of Conformal Prediction Setscited by 49
  9. 2023Conformal prediction under ambiguous ground truthcited by 31
  10. 2024Conformal Validity Guarantees Exist for Any Data Distribution (and How to Find Them)cited by 26
  11. 2021Locally Valid and Discriminative Prediction Intervals for Deep Learning Modelscited by 24
  12. 2024Trustworthy Classification through Rank-Based Conformal Prediction Setscited by 20
  13. 2021Anomalous Edge Detection in Edge Exchangeable Social Network Modelscited by 17
  14. 2024Normalizing Flows for Conformal Regressioncited by 11
  15. 2024Conformal Load Prediction with Transductive Graph Autoencoderscited by 11
  16. 2022Extending Conformal Prediction to Hidden Markov Models with Exact Validity via de Finetti's Theorem for Markov Chainscited by 8
  17. 2023On training locally adaptive CPcited by 8

Built on by

Cited by year

Citing papers per year: 2024: 5; 2025: 6.

11 papers.

  1. 2024Conformal Risk Minimization with Variance Reductioncited by 11
  2. 2024Game-Theoretic Defenses for Robust Conformal Prediction Against Adversarial Attacks in Medical Imagingcited by 10
  3. 2024Entropy Reweighted Conformal Classificationcited by 8
  4. 2024Conformalized Interval Arithmetic with Symmetric Calibrationcited by 8
  5. 2025Parametric Scaling Law of Tuning Bias in Conformal Predictioncited by 7
  6. 2025Conditional Conformal Risk Adaptationcited by 7
  7. 2025Volume-Sorted Prediction Set: Efficient Conformal Prediction for Multi-Target Regressioncited by 6
  8. 2025Enhanced Route Planning with Calibrated Uncertainty Setcited by 5
  9. 2024Adaptive Conformal Inference by Particle Filtering under Hidden Markov Modelscited by 4
  10. 2025Conformal Object Detection by Sequential Risk Controlcited by 3
  11. 2025Towards Trustworthy Vital Sign Forecasting: Leveraging Uncertainty for Prediction Intervalscited by 2