Why not both? Complementing explanations with uncertainty, and the role of self-confidence in Human-AI collaboration
Not on the map. Why?
Abstract (arXiv)
AI and ML models have already found many applications in critical domains, such as healthcare and criminal justice. However, fully automating such high-stakes applications can raise ethical or fairness concerns. Instead, in such cases, humans should be assisted by automated systems so that the two parties reach a joint decision, stemming out of their interaction. In this work we conduct an empirical study to identify how uncertainty estimates and model explanations affect users' reliance, understanding, and trust towards a model, looking for potential benefits of bringing the two together. Moreover, we seek to assess how users' behaviour is affected by their own self-confidence in their abilities to perform a certain task, while we also discuss how the latter may distort the outcome of an analysis based on agreement and switching percentages.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 64 references that are in the map. First posted on arXiv 27 Apr 2023.
Builds on
13 of 64 references.
References · 13
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
- 2019On the (In)fidelity and Sensitivity for Explanationscited by 310
- 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
- 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
- 2018Metrics for Explainable AI: Challenges and Prospectscited by 260
- 2018Manipulating and Measuring Model Interpretabilitycited by 256
- 2018On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detectioncited by 159
- 2020Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertaintycited by 129
- 2020Learning to Complement Humanscited by 124
- 2020"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humanscited by 86
Built on by
Not cited yet.