From Evidence to Decision: Exploring Evaluative AI
Not on the map. Why?
Abstract (arXiv)
This paper presents a hypothesis-driven approach to improve AI-supported decision-making that is based on the Evaluative AI paradigm - a conceptual framework that proposes providing users with evidence for or against a given hypothesis. We propose an implementation of Evaluative AI by extending the Weight of Evidence framework, leading to hypothesis-driven models that support both tabular and image data. We demonstrate the application of the new decision-support approach in two domains: housing price prediction and skin cancer diagnosis. The findings show promising results in improving human decisions, as well as providing insights on the strengths and weaknesses of different decision-support approaches.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 88 references that are in the map. First posted on arXiv 2 Feb 2024.
Builds on
19 of 88 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2020Problems with Shapley-value-based explanations as feature importance measurescited by 198
- 2020Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertaintycited by 128
- 2020Invertible Concept-based Explanations for CNN Models with Non-negative Concept Activation Vectorscited by 119
- 2023Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanationscited by 73
- 2023Explainable AI is Dead, Long Live Explainable AI! Hypothesis-driven decision supportcited by 65
7 more
- 2020Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-makingcited by 59
- 2022Improving Expert Predictions with Conformal Predictioncited by 54
- 2022Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learningcited by 53
- 2022Who Goes First? Influences of Human-AI Workflow on Decision Making in Clinical Imagingcited by 32
- 2023Towards Trustable Skin Cancer Diagnosis via Rewriting Model's Decisioncited by 27
- 2021From Human Explanation to Model Interpretability: A Framework Based on Weight of Evidencecited by 17
- 2021The Impact of Algorithmic Risk Assessments on Human Predictions and its Analysis via Crowdsourcing Studiescited by 13
Built on by
Citing papers per year: 2024: 2; 2025: 0; 2026: 1.
3 papers.
- 2024Contrastive Explanations That Anticipate Human Misconceptions Can Improve Human Decision-Making Skillscited by 11
- 2024Visual Evaluative AI: A Hypothesis-Driven Tool with Concept-Based Explanations and Weight of Evidencecited by 1
- 2026Assessing Alignment and Stability of Feature Importance Explanations via Weight of Evidencecited by 0
- 2026Assessing Alignment and Stability of Feature Importance Explanations via Weight of Evidence31 Aug 2026
- 2024Contrastive Explanations That Anticipate Human Misconceptions Can Improve Human Decision-Making Skills5 Oct 2024
- 2024Visual Evaluative AI: A Hypothesis-Driven Tool with Concept-Based Explanations and Weight of Evidence13 May 2024