mlsanityData to 7 Oct 2026

Contrastive Explanations That Anticipate Human Misconceptions Can Improve Human Decision-Making Skills

arXiv 2410.04253 ↗First posted 5 Oct 2024cs.HC cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

People's decision-making abilities often fail to improve or may even erode when they rely on AI for decision-support, even when the AI provides informative explanations. We argue this is partly because people intuitively seek contrastive explanations, which clarify the difference between the AI's decision and their own reasoning, while most AI systems offer "unilateral" explanations that justify the AI's decision but do not account for users' thinking. To align human-AI knowledge on decision tasks, we introduce a framework for generating human-centered contrastive explanations that explain the difference between AI's choice and a predicted, likely human choice about the same task. Results from a large-scale experiment (N = 628) demonstrate that contrastive explanations significantly enhance users' independent decision-making skills compared to unilateral explanations, without sacrificing decision accuracy. Amid rising deskilling concerns, our research demonstrates that incorporating human reasoning into AI design can foster human skill development.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 45 of its 105 references that are in the map. First posted on arXiv 5 Oct 2024.

Builds on

45 of 105 references.

References · 45

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  3. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  4. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
  5. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  6. 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
  7. 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
  8. 2018Explanations based on the Missing: Towards Contrastive Explanations with Pertinent Negativescited by 261
  9. 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 138
  10. 2021To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-makingcited by 118
  11. 2020The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategiescited by 91
  12. 2023Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanationscited by 80
33 more
  1. 2021Contrastive Explanations for Model Interpretabilitycited by 75
  2. 2024"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trustcited by 67
  3. 2022TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversationscited by 65
  4. 2023Explainable AI is Dead, Long Live Explainable AI! Hypothesis-driven decision supportcited by 65
  5. 2018Contrastive Explanation: A Structural-Model Approachcited by 64
  6. 2020One Explanation Does Not Fit All: The Promise of Interactive Explanations for Machine Learning Transparencycited by 64
  7. 2022Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learningcited by 53
  8. 2023Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistakescited by 51
  9. 2023Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrongcited by 51
  10. 2023Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systemscited by 40
  11. 2018Generating Counterfactual Explanations with Natural Languagecited by 37
  12. 2021Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lenscited by 35
  13. 2023Improving Human-AI Collaboration With Descriptions of AI Behaviorcited by 35
  14. 2018Contrastive Explanations with Local Foil Treescited by 34
  15. 2022Who Goes First? Influences of Human-AI Workflow on Decision Making in Clinical Imagingcited by 32
  16. 2021Teaching Humans When To Defer to a Classifier via Exemplarscited by 29
  17. 2023Selective Explanations: Leveraging Human Input to Align Explainable AIcited by 29
  18. 2023How Knowledge Workers Think Generative AI Will (Not) Transform Their Industriescited by 29
  19. 2024"Are You Really Sure?" Understanding the Effects of Human Self-Confidence Calibration in AI-Assisted Decision Makingcited by 26
  20. 2023Effective Human-AI Teams via Learned Natural Language Rules and Onboardingcited by 20
  21. 2021GAM Changer: Editing Generalized Additive Models with Interactive Visualizationcited by 18
  22. 2022Learning When to Advise Human Decision Makerscited by 18
  23. 2021From Human Explanation to Model Interpretability: A Framework Based on Weight of Evidencecited by 17
  24. 2023Accuracy-Time Tradeoffs in AI-Assisted Decision Making under Time Pressurecited by 17
  25. 2023User Experience Design Professionals' Perceptions of Generative Artificial Intelligencecited by 16
  26. 2024Does More Advice Help? The Effects of Second Opinions in AI-Assisted Decision Makingcited by 14
  27. 2024Ivie: Lightweight Anchored Explanations of Just-Generated Codecited by 14
  28. 2023Overcoming Algorithm Aversion: A Comparison between Process and Outcome Controlcited by 12
  29. 2023Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledgecited by 6
  30. 2018CarePre: An Intelligent Clinical Decision Assistance Systemcited by 4
  31. 2024From Evidence to Decision: Exploring Evaluative AIcited by 3
  32. 2024Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Processcited by 3
  33. 2024(De)Noise: Moderating the Inconsistency Between Human Decision-Makerscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 7.

11 papers.