Selective Classification via One-Sided Prediction
Not on the map. Why?
Abstract (arXiv)
We propose a novel method for selective classification (SC), a problem which allows a classifier to abstain from predicting some instances, thus trading off accuracy against coverage (the fraction of instances predicted). In contrast to prior gating or confidence-set based work, our proposed method optimises a collection of class-wise decoupled one-sided empirical risks, and is in essence a method for explicitly finding the largest decision sets for each class that have few false positives. This one-sided prediction (OSP) based relaxation yields an SC scheme that attains near-optimal coverage in the practically relevant high target accuracy regime, and further admits efficient implementation, leading to a flexible and principled method for SC. We theoretically derive generalization bounds for SC and OSP, and empirically we show that our scheme strongly outperforms state of the art methods in coverage at small error levels.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 4; 2023: 13; 2024: 4; 2025: 6; 2026: 8.
38 papers.
Sort:
- 2021Machine Learning with a Reject Option: A surveycited by 109
- 2023Who Should Predict? Exact Algorithms For Learning to Defer to Humanscited by 70
- 2022MaskTune: Mitigating Spurious Correlations by Forcing to Explorecited by 66
- 2023When Does Confidence-Based Cascade Deferral Suffice?cited by 60
- 2021DOCTOR: A Simple Method for Detecting Misclassification Errorscited by 53
- 2022Sample Efficient Learning of Predictors that Complement Humanscited by 46
- 2023Principled Approaches for Learning to Defer with Multiple Expertscited by 38
- 2023Predictor-Rejector Multi-Class Abstention: Theoretical Analysis and Algorithmscited by 36
- 2023Theoretically Grounded Loss Functions and Algorithms for Score-Based Multi-Class Abstentioncited by 32
- 2024Realizable H-Consistent and Bayes-Consistent Loss Functions for Learning to Defercited by 26
- 2022Selective Prediction via Training Dynamicscited by 20
- 2024Agreement-Based Cascading for Efficient Inferencecited by 16
26 more
- 2025Mastering Multiple-Expert Routing: Realizable H-Consistency and Strong Guarantees for Learning to Defercited by 16
- 2023Plugin estimators for selective classification with out-of-distribution detectioncited by 14
- 2025Budgeted Multiple-Expert Deferralcited by 13
- 2023Regression with Cost-based Rejectioncited by 11
- 2021Online Selective Classification with Limited Feedbackcited by 9
- 2023Conservative Prediction via Data-Driven Confidence Minimizationcited by 8
- 2024A Unifying Post-Processing Framework for Multi-Objective Learn-to-Defer Problemscited by 5
- 2025Selective Risk Certification for LLM Outputs via Information-Lift Statistics: PAC-Bayes, Robustness, and Skeleton Designcited by 5
- 2025Suitability Filter: A Statistical Framework for Classifier Evaluation in Real-World Deployment Settingscited by 4
- 2022Selective classification using a robust meta-learning approachcited by 2
- 2023Counterfactually Comparing Abstaining Classifierscited by 2
- 2023Learning to Abstain From Uninformative Datacited by 2
- 2024Selective Explanationscited by 2
- 2025Interpretable and Fair Mechanisms for Abstaining Classifierscited by 2
- 2023A Minimax Approach Against Multi-Armed Adversarial Attacks Detectioncited by 0
- 2023Model Agnostic Explainable Selective Regression via Uncertainty Estimationcited by 0
- 2023Rescuing referral failures during automated diagnosis of domain-shifted medical imagescited by 0
- 2025The Good, the Bad, and the Sampled: a No-Regret Approach to Safe Online Classificationcited by 0
- 2026Measuring What Matters: Synthetic Benchmarks for Concept Bottleneck Modelscited by 0
- 2026Non-Degenerate Risk Certification for Automated Security Decisions: A Decision-Contract Theory with ATT&CK-Aligned Triage as a Worked Instancecited by 0
- 2026Decision Shifts, Lost Label Functionality, and an Inconclusive Grounding Audit in Correctness-Gated Multi-Teacher Distillationcited by 0
- 2026Refuse, Decompose, Refresh: A Claim-Safe Protocol for Closed-Loop AI Evaluationcited by 0
- 2026Classification with Abstention Under Class-Conditional Error Constraintscited by 0
- 2026When Are Aggregate Agent Traces Diagnosable? Traffic-Governed Interpretation and Calibrated Abstentioncited by 0
- 2026Estimation of the Label-Noise Transition Matrix with Performance Guarantees via Selective Classificationcited by 0
- 2026Lost in the Fallback: How Reliably Do Typed Decision Models Use Fallback Options?cited by 0
- 2026Lost in the Fallback: How Reliably Do Typed Decision Models Use Fallback Options?14 Oct 2026
- 2026Estimation of the Label-Noise Transition Matrix with Performance Guarantees via Selective Classification30 Sep 2026
- 2026When Are Aggregate Agent Traces Diagnosable? Traffic-Governed Interpretation and Calibrated Abstention22 Sep 2026
- 2026Classification with Abstention Under Class-Conditional Error Constraints18 Sep 2026
- 2026Refuse, Decompose, Refresh: A Claim-Safe Protocol for Closed-Loop AI Evaluation17 Sep 2026
- 2026Decision Shifts, Lost Label Functionality, and an Inconclusive Grounding Audit in Correctness-Gated Multi-Teacher Distillation9 Sep 2026
- 2026Non-Degenerate Risk Certification for Automated Security Decisions: A Decision-Contract Theory with ATT&CK-Aligned Triage as a Worked Instance12 Aug 2026
- 2026Measuring What Matters: Synthetic Benchmarks for Concept Bottleneck Models3 Jun 2026
- 2025Budgeted Multiple-Expert Deferral30 Oct 2025
- 2025The Good, the Bad, and the Sampled: a No-Regret Approach to Safe Online Classification1 Oct 2025
- 2025Selective Risk Certification for LLM Outputs via Information-Lift Statistics: PAC-Bayes, Robustness, and Skeleton Design16 Sep 2025
- 2025Mastering Multiple-Expert Routing: Realizable H-Consistency and Strong Guarantees for Learning to Defer25 Jun 2025
26 more
- 2025Suitability Filter: A Statistical Framework for Classifier Evaluation in Real-World Deployment Settings28 May 2025
- 2025Interpretable and Fair Mechanisms for Abstaining Classifiers24 Mar 2025
- 2024Realizable H-Consistent and Bayes-Consistent Loss Functions for Learning to Defer18 Jul 2024
- 2024A Unifying Post-Processing Framework for Multi-Objective Learn-to-Defer Problems17 Jul 2024
- 2024Agreement-Based Cascading for Efficient Inference2 Jul 2024
- 2024Selective Explanations29 May 2024
- 2023Rescuing referral failures during automated diagnosis of domain-shifted medical images28 Nov 2023
- 2023Model Agnostic Explainable Selective Regression via Uncertainty Estimation15 Nov 2023
- 2023Regression with Cost-based Rejection8 Nov 2023
- 2023Principled Approaches for Learning to Defer with Multiple Experts23 Oct 2023
- 2023Predictor-Rejector Multi-Class Abstention: Theoretical Analysis and Algorithms23 Oct 2023
- 2023Theoretically Grounded Loss Functions and Algorithms for Score-Based Multi-Class Abstention23 Oct 2023
- 2023Learning to Abstain From Uninformative Data25 Sep 2023
- 2023When Does Confidence-Based Cascade Deferral Suffice?6 Jul 2023
- 2023Conservative Prediction via Data-Driven Confidence Minimization8 Jun 2023
- 2023Counterfactually Comparing Abstaining Classifiers17 May 2023
- 2023A Minimax Approach Against Multi-Armed Adversarial Attacks Detection4 Feb 2023
- 2023Plugin estimators for selective classification with out-of-distribution detection29 Jan 2023
- 2023Who Should Predict? Exact Algorithms For Learning to Defer to Humans15 Jan 2023
- 2022Selective classification using a robust meta-learning approach12 Dec 2022
- 2022MaskTune: Mitigating Spurious Correlations by Forcing to Explore30 Sep 2022
- 2022Sample Efficient Learning of Predictors that Complement Humans19 Jul 2022
- 2022Selective Prediction via Training Dynamics26 May 2022
- 2021Online Selective Classification with Limited Feedback27 Oct 2021
- 2021Machine Learning with a Reject Option: A survey23 Jul 2021
- 2021DOCTOR: A Simple Method for Detecting Misclassification Errors4 Jun 2021
- 2021Machine Learning with a Reject Option: A surveycited by 109
- 2023Who Should Predict? Exact Algorithms For Learning to Defer to Humanscited by 70
- 2022MaskTune: Mitigating Spurious Correlations by Forcing to Explorecited by 66
- 2023When Does Confidence-Based Cascade Deferral Suffice?cited by 60
- 2021DOCTOR: A Simple Method for Detecting Misclassification Errorscited by 53
- 2022Sample Efficient Learning of Predictors that Complement Humanscited by 46
- 2023Principled Approaches for Learning to Defer with Multiple Expertscited by 38
- 2023Predictor-Rejector Multi-Class Abstention: Theoretical Analysis and Algorithmscited by 36
- 2023Theoretically Grounded Loss Functions and Algorithms for Score-Based Multi-Class Abstentioncited by 32
- 2024Realizable H-Consistent and Bayes-Consistent Loss Functions for Learning to Defercited by 26
- 2022Selective Prediction via Training Dynamicscited by 20
- 2024Agreement-Based Cascading for Efficient Inferencecited by 16
12 most cited of 38 All 38 (JSON)
- 2026Lost in the Fallback: How Reliably Do Typed Decision Models Use Fallback Options?14 Oct 2026
- 2026Estimation of the Label-Noise Transition Matrix with Performance Guarantees via Selective Classification30 Sep 2026
- 2026When Are Aggregate Agent Traces Diagnosable? Traffic-Governed Interpretation and Calibrated Abstention22 Sep 2026
- 2026Classification with Abstention Under Class-Conditional Error Constraints18 Sep 2026
- 2026Refuse, Decompose, Refresh: A Claim-Safe Protocol for Closed-Loop AI Evaluation17 Sep 2026
- 2026Decision Shifts, Lost Label Functionality, and an Inconclusive Grounding Audit in Correctness-Gated Multi-Teacher Distillation9 Sep 2026
- 2026Non-Degenerate Risk Certification for Automated Security Decisions: A Decision-Contract Theory with ATT&CK-Aligned Triage as a Worked Instance12 Aug 2026
- 2026Measuring What Matters: Synthetic Benchmarks for Concept Bottleneck Models3 Jun 2026
- 2025Budgeted Multiple-Expert Deferral30 Oct 2025
- 2025The Good, the Bad, and the Sampled: a No-Regret Approach to Safe Online Classification1 Oct 2025
- 2025Selective Risk Certification for LLM Outputs via Information-Lift Statistics: PAC-Bayes, Robustness, and Skeleton Design16 Sep 2025
- 2025Mastering Multiple-Expert Routing: Realizable H-Consistency and Strong Guarantees for Learning to Defer25 Jun 2025
12 newest of 38 All 38 (JSON)