A Joint Finite-Sample Certificate for Adaptive Selective Conformal Risk Control
Not on the map. Why?
Abstract (arXiv)
Selective predictors answer on confident inputs and abstain elsewhere; deploying one safely needs a single finite-sample certificate that simultaneously upper-bounds the selected risk, lower-bounds the acceptance probability pacc above a floor pmin, and lower-bounds the deployment utility. This certificate must be valid under adaptive threshold selection from a finite grid of m pairs on ncert samples. We give such a certificate for bounded, possibly non-monotone losses by treating the selected risk directly as a ratio rather than through a Hoeffding-style range bound. The construction couples three confidence bounds: a variance-adaptive empirical-Bernstein bound on the ratio risk, a Clopper--Pearson bound on acceptance, and a two-sided closeness bound on utility. Together they lower-bound the certified policy's utility absolutely and to within 2gammau of the best over the certified set, both non-vacuous whenever feasible; a regime-scoped third leg matches an external oracle, informative only where the risk margin gammar < α and vacuous at the headline operating points. Relative to the range-only Hoeffding-ratio construction this sharpens the acceptance-floor dependence from 1/pmin to 1/√pmin, and a closed-form corollary identifies a per-pair regime in which our risk bound dominates a Hoeffding conformal risk control (Hoeffding--CRC) selective bound. Empirically, on ImageNet (three ResNets) and COCO val 2017 panoptic, the certificate opens a +22 pp certified-acceptance frontier over Hoeffding--CRC and is ≈10× tighter than a non-vacuous matched-valid baseline; these gains are regime-scoped, not universal, and absent on ADE20K. The certifier runs in O(ncert m) time.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 28 of its 32 references that are in the map. First posted on arXiv 7 Jun 2026.
Builds on
28 of 32 references.
References · 28
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
- 2022Conformal Risk Controlcited by 299
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
- 2021Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Controlcited by 271
- 2018Time-uniform, nonparametric, nonasymptotic confidence sequencescited by 229
- 2020Estimating means of bounded random variables by bettingcited by 169
- 2023Non-Exchangeable Conformal Risk Controlcited by 29
- 2022Efficiently Controlling Multiple Risks with Pareto Testingcited by 22
16 more
- 2024Automatically Adaptive Conformal Risk Controlcited by 16
- 2022Post-selection inference for e-value based confidence intervalscited by 14
- 2024Confidence on the Focal: Conformal Prediction with Selection-Conditional Coveragecited by 14
- 2024Semi-Supervised Risk Control via Prediction-Powered Inferencecited by 13
- 2026Conformal Selective Prediction with General Risk Controlcited by 12
- 2023Selective conformal inference with false coverage-statement rate controlcited by 11
- 2025Selective Conformal Risk Controlcited by 11
- 2024Cross-Validation Conformal Risk Controlcited by 8
- 2024Conformal Risk Control for Ordinal Classificationcited by 8
- 2026Conformal Risk Control for Non-Monotonic Lossescited by 8
- 2024Two-stage Risk Control with Application to Ranked Retrievalcited by 6
- 2026Anytime-Valid Conformal Risk Controlcited by 5
- 2025Generalization and Informativeness of Weighted Conformal Risk Control Under Covariate Shiftcited by 3
- 2025Online Conformal Abstention Under Adversarial Bandit Feedbackcited by 3
- 2026Conformal Risk Control under Non-Monotone Losses: Theory and Finite-Sample Guaranteescited by 3
- 2025Multiply Robust Conformal Risk Control with Coarsened Datacited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Calibrate What You SHIP: Post-Selection Risk Control for Verifier-Guided Text-to-Image Generationcited by 1
- 2026Certify or Refuse: A Cross-Model Map for Selective Risk Control with Coverage Floors under Covariate Shiftcited by 0
- 2026Conditional Validity for Adaptive Modality Acquisition: When the Policy Chooses Its Own Calibration Groupcited by 0
- 2026SafeRestore: Detector-Relative Risk Certificates for Selective Industrial Image Restorationcited by 0
- 2026Neyman-Pearson Classification with Indecisions: Simultaneous Control of Selective Type I and Type II Errorscited by 0
- 2026Neyman-Pearson Classification with Indecisions: Simultaneous Control of Selective Type I and Type II Errors3 Oct 2026
- 2026SafeRestore: Detector-Relative Risk Certificates for Selective Industrial Image Restoration3 Sep 2026
- 2026Calibrate What You SHIP: Post-Selection Risk Control for Verifier-Guided Text-to-Image Generation22 Aug 2026
- 2026Conditional Validity for Adaptive Modality Acquisition: When the Policy Chooses Its Own Calibration Group16 Aug 2026
- 2026Certify or Refuse: A Cross-Model Map for Selective Risk Control with Coverage Floors under Covariate Shift11 Aug 2026