With Malice Towards None: Assessing Uncertainty via Equalized Coverage
Not on the map. Why?
Abstract (arXiv)
An important factor to guarantee a fair use of data-driven recommendation systems is that we should be able to communicate their uncertainty to decision makers. This can be accomplished by constructing prediction intervals, which provide an intuitive measure of the limits of predictive performance. To support equitable treatment, we force the construction of such intervals to be unbiased in the sense that their coverage must be equal across all protected groups of interest. We present an operational methodology that achieves this goal by offering rigorous distribution-free coverage guarantees holding in finite samples. Our methodology, equalized coverage, is flexible as it can be viewed as a wrapper around any predictive algorithm. We test the applicability of the proposed framework on real data, demonstrating that equalized coverage constructs unbiased prediction intervals, unlike competitive methods.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 10; 2023: 10; 2024: 9; 2025: 5; 2026: 1.
43 papers.
Sort:
By area:
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 792
- 2023Class-Conditional Conformal Prediction with Many Classescited by 109
- 2021Conformal Prediction using Conditional Histogramscited by 77
- 2021Consistent Accelerated Inference via Confident Adaptive Transformerscited by 74
- 2021Fair Conformal Predictors for Applications in Medical Imagingcited by 74
- 2022Batch Multivalid Conformal Predictioncited by 67
- 2022Practical Adversarial Multivalid Conformal Predictioncited by 65
- 2022Training Uncertainty-Aware Classifiers with Conformalized Deep Learningcited by 64
- 2021Few-shot Conformal Prediction with Auxiliary Taskscited by 53
- 2021Conformalized Survival Analysiscited by 53
- 2024Conformal Prediction for Natural Language Processing: A Surveycited by 53
- 2021Improving Conditional Coverage via Orthogonal Quantile Regressioncited by 48
31 more
- 2021PAC Prediction Sets Under Covariate Shiftcited by 45
- 2023Beyond Confidence: Reliable Models Should Also Consider Atypicalitycited by 25
- 2023Adaptive conformal classification with noisy labelscited by 25
- 2024Adaptive Bounding Box Uncertainties via Two-Step Conformal Predictioncited by 23
- 2024Probabilistic Conformal Prediction with Approximate Conditional Validitycited by 23
- 2022Integrative conformal p-values for powerful out-of-distribution testing with labeled outlierscited by 19
- 2022Conformalized Fairness via Quantile Regressioncited by 19
- 2023HappyMap: A Generalized Multi-calibration Methodcited by 18
- 2024End-to-end Conditional Robust Optimizationcited by 17
- 2023Equal Opportunity of Coverage in Fair Regressioncited by 16
- 2023Conformal inference is (almost) free for neural networks trained with early stoppingcited by 14
- 2024Conformal Prediction Sets Can Cause Disparate Impactcited by 14
- 2022Predictive Inference with Weak Supervisioncited by 13
- 2025The Relationship between No-Regret Learning and Online Conformal Predictioncited by 13
- 2022Conformal Methods for Quantifying Uncertainty in Spatiotemporal Data: A Surveycited by 11
- 2022Conformal Frequency Estimation using Discrete Sketched Data with Coverage for Distinct Queriescited by 10
- 2023Group-Conditional Conformal Prediction via Quantile Regression Calibration for Crop and Weed Classificationcited by 9
- 2022Prediction Sets for High-Dimensional Mixture of Experts Modelscited by 8
- 2024Conformalized Interval Arithmetic with Symmetric Calibrationcited by 8
- 2025Conditional Coverage Diagnostics for Conformal Predictioncited by 8
- 2025Conformal Prediction and MLLM aided Uncertainty Quantification in Scene Graph Generationcited by 7
- 2025Conditional Conformal Risk Adaptationcited by 7
- 2023Is this model reliable for everyone? Testing for strong calibrationcited by 6
- 2023Conformalizing Machine Translation Evaluationcited by 5
- 2022Distribution-Free Finite-Sample Guarantees and Split Conformal Predictioncited by 4
- 2024Powerful batch conformal prediction for classificationcited by 4
- 2024Conditional Prediction ROC Bands for Graph Classificationcited by 3
- 2025CP2: Leveraging Geometry for Conformal Prediction via Canonicalizationcited by 2
- 2026Multi-Distribution Robust Conformal Predictioncited by 2
- 2023Group conditional validity via multi-group learningcited by 1
- 2024Fast Calibrated Explanations: Efficient and Uncertainty-Aware Explanations for Machine Learning Modelscited by 1
- 2026Multi-Distribution Robust Conformal Prediction6 Jan 2026
- 2025Conditional Coverage Diagnostics for Conformal Prediction12 Dec 2025
- 2025CP2: Leveraging Geometry for Conformal Prediction via Canonicalization19 Jun 2025
- 2025Conditional Conformal Risk Adaptation10 Apr 2025
- 2025Conformal Prediction and MLLM aided Uncertainty Quantification in Scene Graph Generation18 Mar 2025
- 2025The Relationship between No-Regret Learning and Online Conformal Prediction16 Feb 2025
- 2024Powerful batch conformal prediction for classification4 Nov 2024
- 2024Fast Calibrated Explanations: Efficient and Uncertainty-Aware Explanations for Machine Learning Models28 Oct 2024
- 2024Conditional Prediction ROC Bands for Graph Classification20 Oct 2024
- 2024Conformal Prediction Sets Can Cause Disparate Impact2 Oct 2024
- 2024Conformalized Interval Arithmetic with Symmetric Calibration20 Aug 2024
- 2024Probabilistic Conformal Prediction with Approximate Conditional Validity1 Jul 2024
31 more
- 2024Conformal Prediction for Natural Language Processing: A Survey3 May 2024
- 2024Adaptive Bounding Box Uncertainties via Two-Step Conformal Prediction12 Mar 2024
- 2024End-to-end Conditional Robust Optimization7 Mar 2024
- 2023Equal Opportunity of Coverage in Fair Regression3 Nov 2023
- 2023Adaptive conformal classification with noisy labels10 Sep 2023
- 2023Group-Conditional Conformal Prediction via Quantile Regression Calibration for Crop and Weed Classification29 Aug 2023
- 2023Is this model reliable for everyone? Testing for strong calibration28 Jul 2023
- 2023Class-Conditional Conformal Prediction with Many Classes15 Jun 2023
- 2023Conformalizing Machine Translation Evaluation9 Jun 2023
- 2023Beyond Confidence: Reliable Models Should Also Consider Atypicality29 May 2023
- 2023HappyMap: A Generalized Multi-calibration Method8 Mar 2023
- 2023Group conditional validity via multi-group learning7 Mar 2023
- 2023Conformal inference is (almost) free for neural networks trained with early stopping27 Jan 2023
- 2022Conformal Frequency Estimation using Discrete Sketched Data with Coverage for Distinct Queries9 Nov 2022
- 2022Prediction Sets for High-Dimensional Mixture of Experts Models30 Oct 2022
- 2022Distribution-Free Finite-Sample Guarantees and Split Conformal Prediction26 Oct 2022
- 2022Conformalized Fairness via Quantile Regression5 Oct 2022
- 2022Batch Multivalid Conformal Prediction30 Sep 2022
- 2022Conformal Methods for Quantifying Uncertainty in Spatiotemporal Data: A Survey8 Sep 2022
- 2022Integrative conformal p-values for powerful out-of-distribution testing with labeled outliers23 Aug 2022
- 2022Practical Adversarial Multivalid Conformal Prediction2 Jun 2022
- 2022Training Uncertainty-Aware Classifiers with Conformalized Deep Learning12 May 2022
- 2022Predictive Inference with Weak Supervision20 Jan 2022
- 2021Fair Conformal Predictors for Applications in Medical Imaging9 Sep 2021
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification15 Jul 2021
- 2021PAC Prediction Sets Under Covariate Shift17 Jun 2021
- 2021Improving Conditional Coverage via Orthogonal Quantile Regression1 Jun 2021
- 2021Conformal Prediction using Conditional Histograms18 May 2021
- 2021Consistent Accelerated Inference via Confident Adaptive Transformers18 Apr 2021
- 2021Conformalized Survival Analysis17 Mar 2021
- 2021Few-shot Conformal Prediction with Auxiliary Tasks17 Feb 2021
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 792
- 2023Class-Conditional Conformal Prediction with Many Classescited by 109
- 2021Conformal Prediction using Conditional Histogramscited by 77
- 2021Consistent Accelerated Inference via Confident Adaptive Transformerscited by 74
- 2021Fair Conformal Predictors for Applications in Medical Imagingcited by 74
- 2022Batch Multivalid Conformal Predictioncited by 67
- 2022Practical Adversarial Multivalid Conformal Predictioncited by 65
- 2022Training Uncertainty-Aware Classifiers with Conformalized Deep Learningcited by 64
- 2021Few-shot Conformal Prediction with Auxiliary Taskscited by 53
- 2021Conformalized Survival Analysiscited by 53
- 2024Conformal Prediction for Natural Language Processing: A Surveycited by 53
- 2021Improving Conditional Coverage via Orthogonal Quantile Regressioncited by 48
12 most cited of 42 All 42 (JSON)
- 2026Multi-Distribution Robust Conformal Prediction6 Jan 2026
- 2025Conditional Coverage Diagnostics for Conformal Prediction12 Dec 2025
- 2025CP2: Leveraging Geometry for Conformal Prediction via Canonicalization19 Jun 2025
- 2025Conditional Conformal Risk Adaptation10 Apr 2025
- 2025Conformal Prediction and MLLM aided Uncertainty Quantification in Scene Graph Generation18 Mar 2025
- 2025The Relationship between No-Regret Learning and Online Conformal Prediction16 Feb 2025
- 2024Powerful batch conformal prediction for classification4 Nov 2024
- 2024Fast Calibrated Explanations: Efficient and Uncertainty-Aware Explanations for Machine Learning Models28 Oct 2024
- 2024Conditional Prediction ROC Bands for Graph Classification20 Oct 2024
- 2024Conformal Prediction Sets Can Cause Disparate Impact2 Oct 2024
- 2024Conformalized Interval Arithmetic with Symmetric Calibration20 Aug 2024
- 2024Probabilistic Conformal Prediction with Approximate Conditional Validity1 Jul 2024
12 newest of 42 All 42 (JSON)