Exploring the Impact of Explainable AI and Cognitive Capabilities on Users' Decisions
Not on the map. Why?
Abstract (arXiv)
Artificial Intelligence (AI) systems are increasingly used for decision-making across domains, raising debates over the information and explanations they should provide. Most research on Explainable AI (XAI) has focused on feature-based explanations, with less attention on alternative styles. Personality traits like the Need for Cognition (NFC) can also lead to different decision-making outcomes among low and high NFC individuals. We investigated how presenting AI information (prediction, confidence, and accuracy) and different explanation styles (example-based, feature-based, rule-based, and counterfactual) affect accuracy, reliance on AI, and cognitive load in a loan application scenario. We also examined low and high NFC individuals' differences in prioritizing XAI interface elements (loan attributes, AI information, and explanations), accuracy, and cognitive load. Our findings show that high AI confidence significantly increases reliance on AI while reducing cognitive load. Feature-based explanations did not enhance accuracy compared to other conditions. Although counterfactual explanations were less understandable, they enhanced overall accuracy, increasing reliance on AI and reducing cognitive load when AI predictions were correct. Both low and high NFC individuals prioritized explanations after loan attributes, leaving AI information as the least important. However, we found no significant differences between low and high NFC groups in accuracy or cognitive load, raising questions about the role of personality traits in AI-assisted decision-making. These findings highlight the need for user-centric personalization in XAI interfaces, incorporating diverse explanation styles and exploring multiple personality traits and other user characteristics to optimize human-AI collaboration.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 53 of its 153 references that are in the map. First posted on arXiv 2 May 2025.
Builds on
53 of 153 references.
References · 53
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,515
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,055
- 2017On Calibration of Modern Neural Networkscited by 4,902
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,088
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 614
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
- 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
- 2020Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior?cited by 190
- 2018On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detectioncited by 159
- 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 138
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
38 more
- 2021To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-makingcited by 118
- 2022Explanations Can Reduce Overreliance on AI Systems During Decision-Makingcited by 111
- 2019Human-Centered Tools for Coping with Imperfect Algorithms during Medical Decision-Makingcited by 109
- 2021HIVE: Evaluating the Human Interpretability of Visual Explanationscited by 105
- 2018'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisionscited by 91
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2023Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanationscited by 73
- 2021Classifier Calibration: A survey on how to assess and improve predicted class probabilitiescited by 71
- 2023Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Makingcited by 67
- 2020Towards Unifying Feature Attribution and Counterfactual Explanations: Different Means to the Same Endcited by 66
- 2020Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-makingcited by 59
- 2022Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learningcited by 53
- 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 53
- 2023In Search of Verifiability: Explanations Rarely Enable Complementary Performance in AI-Advised Decision Makingcited by 50
- 2020Aleatoric and Epistemic Uncertainty with Random Forestscited by 42
- 2023Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systemscited by 41
- 2020ViCE: Visual Counterfactual Explanations for Machine Learning Modelscited by 34
- 2022Who Goes First? Influences of Human-AI Workflow on Decision Making in Clinical Imagingcited by 32
- 2019Explaining Models: An Empirical Study of How Explanations Impact Fairness Judgmentcited by 31
- 2023Selective Explanations: Leveraging Human Input to Align Explainable AIcited by 29
- 2024"Are You Really Sure?" Understanding the Effects of Human Self-Confidence Calibration in AI-Assisted Decision Makingcited by 26
- 2025Is Conversational XAI All You Need? Human-AI Decision Making With a Conversational XAI Assistantcited by 26
- 2023The Impact of Imperfect XAI on Human-AI Decision-Makingcited by 21
- 2022"There Is Not Enough Information": On the Effects of Explanations on Perceptions of Informational Fairness and Trustworthiness in Automated Decision-Makingcited by 19
- 2025As Confidence Aligns: Exploring the Effect of AI Confidence on Human Self-confidence in Human-AI Decision Makingcited by 19
- 2015Large-scale probabilistic predictors with and without guarantees of validitycited by 18
- 2023Directive Explanations for Monitoring the Risk of Diabetes Onset: Introducing Directive Data-Centric Explanations and Combinations to Support What-If Explorationscited by 18
- 2023Human-AI collaboration is not very collaborative yet: A taxonomy of interaction patterns in AI-assisted decision making from a systematic reviewcited by 18
- 2023Impact Of Explainable AI On Cognitive Load: Insights From An Empirical Studycited by 15
- 2024EXMOS: Explanatory Model Steering Through Multifaceted Explanations and Data Configurationscited by 14
- 2024Contrastive Explanations That Anticipate Human Misconceptions Can Improve Human Decision-Making Skillscited by 14
- 2024Towards Optimizing Human-Centric Objectives in AI-Assisted Decision-Making With Offline Reinforcement Learningcited by 13
- 2023Using AI Uncertainty Quantification to Improve Human Decision-Makingcited by 11
- 2024Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Makingcited by 11
- 2022Explaining Classifications to Non Experts: An XAI User Study of Post Hoc Explanations for a Classifier When People Lack Expertisecited by 8
- 2024Exploiting Preference Elicitation in Interactive and User-centered Algorithmic Recourse: An Initial Explorationcited by 8
- 2021Vis Ex Machina: An Analysis of Trust in Human versus Algorithmically Generated Visualization Recommendationscited by 4
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.