Unequal Uncertainty: Rethinking Algorithmic Interventions for Mitigating Discrimination from AI
Not on the map. Why?
Abstract (arXiv)
Uncertainty in artificial intelligence (AI) predictions raises pressing legal and ethical questions for AI-assisted decision-making. This article examines two uncertainty-based algorithmic interventions that act as guardrails for human-AI interaction: selective abstention, which withholds high-uncertainty predictions from human decision-makers, and selective friction, which presents such predictions together with salient warnings about the model's uncertainty. Prior work suggests that uncertainty-based abstention can exacerbate disparities where under-represented groups are more likely to receive uncertain predictions. We provide, to our knowledge, the first doctrinal analysis of uncertainty-based algorithmic interventions under laws from the United Kingdom and examine their consequences through two AI-assisted case studies: consumer credit and risk of reoffending. We show that the use of uncertainty thresholds, though formally neutral, can generate discriminatory effects. We argue that both interventions pose risks of unlawful discrimination, but that selective friction is legally preferable. It preserves access to the prediction and is more likely to satisfy proportionality under the Equality Act 2010. Whether selective friction also improves decision quality in practice is uncertain. We identify conditions under which it may improve or worsen decision quality.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 187 references that are in the map. First posted on arXiv 11 Aug 2025.
Builds on
46 of 187 references.
References · 46
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 586
- 2017Algorithmic decision making and the cost of fairnesscited by 403
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
- 2017Fairness in Criminal Justice Risk Assessments: The State of the Artcited by 315
- 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
- 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
- 2018Manipulating and Measuring Model Interpretabilitycited by 256
- 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 254
34 more
- 2017Predict Responsibly: Improving Fairness and Accuracy by Learning to Defercited by 233
- 2018Delayed Impact of Fair Machine Learningcited by 184
- 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 139
- 2020Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertaintycited by 129
- 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 81
- 2023Who Should Predict? Exact Algorithms For Learning to Defer to Humanscited by 70
- 2023Evaluating Language Models for Mathematics through Interactionscited by 70
- 2024"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trustcited by 67
- 2022Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learningcited by 53
- 2023Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrongcited by 51
- 2021The Flaws of Policies Requiring Human Oversight of Government Algorithmscited by 44
- 2020Selective Classification Can Magnify Disparities Across Groupscited by 36
- 2017Like trainer, like bot? Inheritance of bias in algorithmic content moderationcited by 35
- 2023Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classificationcited by 32
- 2021Classification with abstention but without disparitiescited by 28
- 2024A Decision Theoretic Framework for Measuring AI Reliancecited by 28
- 2024On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectivescited by 28
- 2023On The Impact of Machine Learning Randomness on Group Fairnesscited by 26
- 2021Human-AI Interactions in Public Sector Decision-Making: "Automation Bias" and "Selective Adherence" to Algorithmic Advicecited by 22
- 2023Aleatoric and Epistemic Discrimination: Fundamental Limits of Fairness Interventionscited by 19
- 2021Loss-Aversively Fair Classificationcited by 18
- 2024Contrastive Explanations That Anticipate Human Misconceptions Can Improve Human Decision-Making Skillscited by 14
- 2024Modulating Language Model Experiences through Frictionscited by 13
- 2023AI Reliance and Decision Quality: Fundamentals, Interdependence, and the Effects of Interventionscited by 9
- 2024Decoding AI's Nudge: A Unified Framework to Predict Human Behavior in AI-assisted Decision Makingcited by 9
- 2021How Costly is Noise? Data and Disparities in Consumer Creditcited by 8
- 2023Mitigating Calibration Bias Without Fixed Attribute Grouping for Improved Fairness in Medical Imaging Analysiscited by 7
- 2024Scarce Resource Allocations That Rely On Machine Learning Should Be Randomizedcited by 7
- 2024When Should Algorithms Resign? A Proposal for AI Governancecited by 6
- 2023Enhancing Content Moderation with Culturally-Aware Modelscited by 3
- 2024Formalising Anti-Discrimination Law in Automated Decision Systemscited by 2
- 2024When to Accept Automated Predictions and When to Defer to Human Judgment?cited by 2
- 2024FairlyUncertain: A Comprehensive Benchmark of Uncertainty in Algorithmic Fairnesscited by 2
- 2024Does calibration mean what they say it means; or, the reference class problem rises againcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Fairness under uncertainty in sequential decisions
- 2022On the Need and Applicability of Causality for Fairness: A Unified Framework for AI Auditing and Legal Analysis
- 2026Fairness of Explanations in Artificial Intelligence (AI): A Unifying Framework, Axioms, and Future Direction toward Responsible AI
- 2025Dropouts in Confidence: Moral Uncertainty in Human-LLM Alignment
- 2024The Reasoning Under Uncertainty Trap: A Structural AI Risk
- 2023On the meaning of uncertainty for ethical AI: philosophy and practice
- 2023Absolutist AI
- 2025Human aversion? Do AI Agents Judge Identity More Harshly Than Performance