Dissenting Explanations: Leveraging Disagreement to Reduce Model Overreliance
Not on the map. Why?
Abstract (arXiv)
While explainability is a desirable characteristic of increasingly complex black-box models, modern explanation methods have been shown to be inconsistent and contradictory. The semantics of explanations is not always fully understood - to what extent do explanations "explain" a decision and to what extent do they merely advocate for a decision? Can we help humans gain insights from explanations accompanying correct predictions and not over-rely on incorrect predictions advocated for by explanations? With this perspective in mind, we introduce the notion of dissenting explanations: conflicting predictions with accompanying explanations. We first explore the advantage of dissenting explanations in the setting of model multiplicity, where multiple models with similar performance may have different predictions. In such cases, providing dissenting explanations could be done by invoking the explanations of disagreeing models. Through a pilot study, we demonstrate that dissenting explanations reduce overreliance on model predictions, without reducing overall accuracy. Motivated by the utility of dissenting explanations we present both global and local methods for their generation.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 14 Jul 2023.
Builds on
18 of 30 references.
References · 18
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 449
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
- 2018All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneouslycited by 373
- 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
- 2020A Survey on the Explainability of Supervised Machine Learningcited by 227
- 2019Improving Adversarial Robustness via Promoting Ensemble Diversitycited by 213
- 2019Predictive Multiplicity in Classificationcited by 166
- 2018On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detectioncited by 159
6 more
- 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 159
- 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 139
- 2022Explanations Can Reduce Overreliance on AI Systems During Decision-Makingcited by 111
- 2020"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humanscited by 86
- 2022Which Explanation Should I Choose? A Function Approximation Perspective to Characterizing Post Hoc Explanationscited by 77
- 2021DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimationcited by 48
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 2.
5 papers.
- 2026How AI Impacts Skill Formationcited by 24
- 2024Why do explanations fail? A typology and discussion on failures in XAIcited by 6
- 2025Beyond the Single-Best Model: Rashomon Partial Dependence Profile for Trustworthy Explanations in AutoMLcited by 6
- 2023Rescue: Ranking LLM Responses with Partial Ordering to Improve Response Generationcited by 4
- 2026Quality Without Usefulness: LLM-Generated XAI Narratives as Trust Heuristics Rather Than Decision Aidscited by 2
- 2026Quality Without Usefulness: LLM-Generated XAI Narratives as Trust Heuristics Rather Than Decision Aids26 May 2026
- 2026How AI Impacts Skill Formation28 Jan 2026
- 2025Beyond the Single-Best Model: Rashomon Partial Dependence Profile for Trustworthy Explanations in AutoML19 Jul 2025
- 2024Why do explanations fail? A typology and discussion on failures in XAI22 May 2024
- 2023Rescue: Ranking LLM Responses with Partial Ordering to Improve Response Generation15 Nov 2023