Contrastive Explanations That Anticipate Human Misconceptions Can Improve Human Decision-Making Skills
Not on the map. Why?
Abstract (arXiv)
People's decision-making abilities often fail to improve or may even erode when they rely on AI for decision-support, even when the AI provides informative explanations. We argue this is partly because people intuitively seek contrastive explanations, which clarify the difference between the AI's decision and their own reasoning, while most AI systems offer "unilateral" explanations that justify the AI's decision but do not account for users' thinking. To align human-AI knowledge on decision tasks, we introduce a framework for generating human-centered contrastive explanations that explain the difference between AI's choice and a predicted, likely human choice about the same task. Results from a large-scale experiment (N = 628) demonstrate that contrastive explanations significantly enhance users' independent decision-making skills compared to unilateral explanations, without sacrificing decision accuracy. Amid rising deskilling concerns, our research demonstrates that incorporating human reasoning into AI design can foster human skill development.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 45 of its 105 references that are in the map. First posted on arXiv 5 Oct 2024.
Builds on
45 of 105 references.
References · 45
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
- 2018Explanations based on the Missing: Towards Contrastive Explanations with Pertinent Negativescited by 261
- 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 138
- 2021To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-makingcited by 118
- 2020The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategiescited by 91
- 2023Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanationscited by 80
33 more
- 2021Contrastive Explanations for Model Interpretabilitycited by 75
- 2024"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trustcited by 67
- 2022TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversationscited by 65
- 2023Explainable AI is Dead, Long Live Explainable AI! Hypothesis-driven decision supportcited by 65
- 2018Contrastive Explanation: A Structural-Model Approachcited by 64
- 2020One Explanation Does Not Fit All: The Promise of Interactive Explanations for Machine Learning Transparencycited by 64
- 2022Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learningcited by 53
- 2023Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistakescited by 51
- 2023Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrongcited by 51
- 2023Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systemscited by 40
- 2018Generating Counterfactual Explanations with Natural Languagecited by 37
- 2021Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lenscited by 35
- 2023Improving Human-AI Collaboration With Descriptions of AI Behaviorcited by 35
- 2018Contrastive Explanations with Local Foil Treescited by 34
- 2022Who Goes First? Influences of Human-AI Workflow on Decision Making in Clinical Imagingcited by 32
- 2021Teaching Humans When To Defer to a Classifier via Exemplarscited by 29
- 2023Selective Explanations: Leveraging Human Input to Align Explainable AIcited by 29
- 2023How Knowledge Workers Think Generative AI Will (Not) Transform Their Industriescited by 29
- 2024"Are You Really Sure?" Understanding the Effects of Human Self-Confidence Calibration in AI-Assisted Decision Makingcited by 26
- 2023Effective Human-AI Teams via Learned Natural Language Rules and Onboardingcited by 20
- 2021GAM Changer: Editing Generalized Additive Models with Interactive Visualizationcited by 18
- 2022Learning When to Advise Human Decision Makerscited by 18
- 2021From Human Explanation to Model Interpretability: A Framework Based on Weight of Evidencecited by 17
- 2023Accuracy-Time Tradeoffs in AI-Assisted Decision Making under Time Pressurecited by 17
- 2023User Experience Design Professionals' Perceptions of Generative Artificial Intelligencecited by 16
- 2024Does More Advice Help? The Effects of Second Opinions in AI-Assisted Decision Makingcited by 14
- 2024Ivie: Lightweight Anchored Explanations of Just-Generated Codecited by 14
- 2023Overcoming Algorithm Aversion: A Comparison between Process and Outcome Controlcited by 12
- 2023Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledgecited by 6
- 2018CarePre: An Intelligent Clinical Decision Assistance Systemcited by 4
- 2024From Evidence to Decision: Exploring Evaluative AIcited by 3
- 2024Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Processcited by 3
- 2024(De)Noise: Moderating the Inconsistency Between Human Decision-Makerscited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 7.
11 papers.
- 2025Exploring the Impact of Explainable AI and Cognitive Capabilities on Users' Decisionscited by 1
- 2026From Junior to Senior: Allocating Agency and Navigating Professional Growth in Agentic AI-Mediated Software Engineeringcited by 1
- 2026Can Agents Distinguish Visually Hard-to-Separate Diseases in a Zero-Shot Setting? A Pilot Studycited by 1
- 2026More Isn't Always Better: Balancing Decision Accuracy and Conformity Pressures in Multi-AI Advicecited by 1
- 2024An Empirical Examination of the Evaluative AI Frameworkcited by 0
- 2025Beyond Autocomplete: Designing CopilotLens Towards Transparent and Explainable AI Coding Agentscited by 0
- 2025Unequal Uncertainty: Rethinking Algorithmic Interventions for Mitigating Discrimination from AIcited by 0
- 2026Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understandingcited by 0
- 2026Epistemic Transfer in AI-Assisted Verification: A Framework and Evaluation Protocolcited by 0
- 2026LLMs as Oracles: Reliance on LLMs for Subjective Personal Questionscited by 0
- 2026Beyond "ChatGPT Can Make Mistakes": Designing Interventions to Support Metacognitive Monitoring in AI-Assisted Workcited by 0
- 2026Beyond "ChatGPT Can Make Mistakes": Designing Interventions to Support Metacognitive Monitoring in AI-Assisted Work15 Sep 2026
- 2026LLMs as Oracles: Reliance on LLMs for Subjective Personal Questions13 Sep 2026
- 2026Epistemic Transfer in AI-Assisted Verification: A Framework and Evaluation Protocol9 Aug 2026
- 2026Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding26 Mar 2026
- 2026More Isn't Always Better: Balancing Decision Accuracy and Conformity Pressures in Multi-AI Advice23 Mar 2026
- 2026Can Agents Distinguish Visually Hard-to-Separate Diseases in a Zero-Shot Setting? A Pilot Study26 Feb 2026
- 2026From Junior to Senior: Allocating Agency and Navigating Professional Growth in Agentic AI-Mediated Software Engineering31 Jan 2026
- 2025Unequal Uncertainty: Rethinking Algorithmic Interventions for Mitigating Discrimination from AI11 Aug 2025
- 2025Beyond Autocomplete: Designing CopilotLens Towards Transparent and Explainable AI Coding Agents24 Jun 2025
- 2025Exploring the Impact of Explainable AI and Cognitive Capabilities on Users' Decisions2 May 2025
- 2024An Empirical Examination of the Evaluative AI Framework13 Nov 2024