AUC-based Selective Classification
Not on the map. Why?
Abstract (arXiv)
Selective classification (or classification with a reject option) pairs a classifier with a selection function to determine whether or not a prediction should be accepted. This framework trades off coverage (probability of accepting a prediction) with predictive performance, typically measured by distributive loss functions. In many application scenarios, such as credit scoring, performance is instead measured by ranking metrics, such as the Area Under the ROC Curve (AUC). We propose a model-agnostic approach to associate a selection function to a given probabilistic binary classifier. The approach is specifically targeted at optimizing the AUC. We provide both theoretical justifications and a novel algorithm, called AUCROSS, to achieve such a goal. Experiments show that our method succeeds in trading-off coverage for AUC, improving over existing selective classification methods targeted at optimizing accuracy.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 10 of its 42 references that are in the map. First posted on arXiv 19 Oct 2022.
Builds on
10 of 42 references.
References · 10
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2021Revisiting Deep Learning Models for Tabular Datacited by 740
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
- 2018Scalable and accurate deep learning for electronic health recordscited by 280
- 2020Self-Adaptive Training: beyond Empirical Risk Minimizationcited by 126
- 2021Machine Learning with a Reject Option: A surveycited by 109
- 2022AUC Maximization in the Era of Big Data and AI: A Surveycited by 100
- 2019Deep Gamblers: Learning to Abstain with Portfolio Theorycited by 71
- 2020Selective Classification Can Magnify Disparities Across Groupscited by 36
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 5; 2026: 4.
13 papers.
Sort:
By area:
- 2024Overcoming Common Flaws in the Evaluation of Selective Classification Systemscited by 37
- 2024A Causal Framework for Evaluating Deferring Systemscited by 13
- 2025Selective Conformal Risk Controlcited by 11
- 2023Unsupervised Anomaly Detection with Rejectioncited by 9
- 2025Interpretable and Fair Mechanisms for Abstaining Classifierscited by 2
- 2025Knowing What You Cannot Explain: Learning to Reject Low-Quality Explanationscited by 2
- 2025What Does It Take to Build a Performant Selective Classifier?cited by 2
- 2026Density-Ratio Losses for Post-Hoc Learning to Defercited by 1
- 2023Model Agnostic Explainable Selective Regression via Uncertainty Estimationcited by 0
- 2025Bounded-Abstention Pairwise Learning to Rankcited by 0
- 2026Bounded-Abstention Multi-horizon Time-series Forecastingcited by 0
- 2026A Regime Theory of Controller Class Selection for LLM Action Decisionscited by 0
- 2026Improving Selective Classification with Pairwise Queries for Binary Classification28 May 2026
- 2026Density-Ratio Losses for Post-Hoc Learning to Defer19 May 2026
- 2026A Regime Theory of Controller Class Selection for LLM Action Decisions7 May 2026
- 2026Bounded-Abstention Multi-horizon Time-series Forecasting4 Feb 2026
- 2025Selective Conformal Risk Control14 Dec 2025
- 2025What Does It Take to Build a Performant Selective Classifier?23 Oct 2025
- 2025Knowing What You Cannot Explain: Learning to Reject Low-Quality Explanations17 Jul 2025
- 2025Bounded-Abstention Pairwise Learning to Rank29 May 2025
- 2025Interpretable and Fair Mechanisms for Abstaining Classifiers24 Mar 2025
- 2024Overcoming Common Flaws in the Evaluation of Selective Classification Systems1 Jul 2024
- 2024A Causal Framework for Evaluating Deferring Systems29 May 2024
- 2023Model Agnostic Explainable Selective Regression via Uncertainty Estimation15 Nov 2023
1 more
- 2023Unsupervised Anomaly Detection with Rejection22 May 2023
- 2024Overcoming Common Flaws in the Evaluation of Selective Classification Systemscited by 37
- 2024A Causal Framework for Evaluating Deferring Systemscited by 13
- 2025Selective Conformal Risk Controlcited by 11
- 2023Unsupervised Anomaly Detection with Rejectioncited by 9
- 2025Interpretable and Fair Mechanisms for Abstaining Classifierscited by 2
- 2025Knowing What You Cannot Explain: Learning to Reject Low-Quality Explanationscited by 2
- 2025What Does It Take to Build a Performant Selective Classifier?cited by 2
- 2026Density-Ratio Losses for Post-Hoc Learning to Defercited by 1
- 2023Model Agnostic Explainable Selective Regression via Uncertainty Estimationcited by 0
- 2025Bounded-Abstention Pairwise Learning to Rankcited by 0
- 2026Bounded-Abstention Multi-horizon Time-series Forecastingcited by 0
- 2026Improving Selective Classification with Pairwise Queries for Binary Classificationcited by 0
- 2026Improving Selective Classification with Pairwise Queries for Binary Classification28 May 2026
- 2026Density-Ratio Losses for Post-Hoc Learning to Defer19 May 2026
- 2026Bounded-Abstention Multi-horizon Time-series Forecasting4 Feb 2026
- 2025Selective Conformal Risk Control14 Dec 2025
- 2025What Does It Take to Build a Performant Selective Classifier?23 Oct 2025
- 2025Knowing What You Cannot Explain: Learning to Reject Low-Quality Explanations17 Jul 2025
- 2025Bounded-Abstention Pairwise Learning to Rank29 May 2025
- 2025Interpretable and Fair Mechanisms for Abstaining Classifiers24 Mar 2025
- 2024Overcoming Common Flaws in the Evaluation of Selective Classification Systems1 Jul 2024
- 2024A Causal Framework for Evaluating Deferring Systems29 May 2024
- 2023Model Agnostic Explainable Selective Regression via Uncertainty Estimation15 Nov 2023
- 2023Unsupervised Anomaly Detection with Rejection22 May 2023