Explaining Groups of Instances Counterfactually for XAI: A Use Case, Algorithm and User Study for Group-Counterfactuals
Not on the map. Why?
Abstract (arXiv)
Counterfactual explanations are an increasingly popular form of post hoc explanation due to their (i) applicability across problem domains, (ii) proposed legal compliance (e.g., with GDPR), and (iii) reliance on the contrastive nature of human explanation. Although counterfactual explanations are normally used to explain individual predictive-instances, we explore a novel use case in which groups of similar instances are explained in a collective fashion using ``group counterfactuals'' (e.g., to highlight a repeating pattern of illness in a group of patients). These group counterfactuals meet a human preference for coherent, broad explanations covering multiple events/instances. A novel, group-counterfactual algorithm is proposed to generate high-coverage explanations that are faithful to the to-be-explained model. This explanation strategy is also evaluated in a large, controlled user study (N=207), using objective (i.e., accuracy) and subjective (i.e., confidence, explanation satisfaction, and trust) psychological measures. The results show that group counterfactuals elicit modest but definite improvements in people's understanding of an AI system. The implications of these findings for counterfactual methods and for XAI are discussed.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 37 of its 66 references that are in the map. First posted on arXiv 16 Mar 2023.
Builds on
37 of 66 references.
References · 37
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 612
- 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 443
- 2019Counterfactual Visual Explanationscited by 312
- 2018Explanations based on the Missing: Towards Contrastive Explanations with Pertinent Negativescited by 261
- 2018Metrics for Explainable AI: Challenges and Prospectscited by 257
- 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
- 2019FACE: Feasible and Actionable Counterfactual Explanationscited by 232
- 2018Local Rule-Based Explanations of Black Box Decision Systemscited by 165
25 more
- 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
- 2020Multi-Objective Counterfactual Explanationscited by 157
- 2020Algorithmic recourse under imperfect causal knowledge: a probabilistic approachcited by 139
- 2019Towards Realistic Individual Recourse and Actionable Explanations in Black-Box Decision Making Systemscited by 128
- 2019The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasonscited by 115
- 2021Counterfactual Explanations Can Be Manipulatedcited by 113
- 2021If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniquescited by 82
- 2020Good Counterfactuals and Where to Find Them: A Case-Based Technique for Generating Counterfactuals for Explainable AI (XAI)cited by 79
- 2019An Evaluation of the Human-Interpretability of Explanationcited by 71
- 2020One Explanation Does Not Fit All: The Promise of Interactive Explanations for Machine Learning Transparencycited by 64
- 2020Instance-based Counterfactual Explanations for Time Series Classificationcited by 64
- 2021NICE: An Algorithm for Nearest Instance Counterfactual Explanationscited by 62
- 2020On Generating Plausible Counterfactual and Semi-Factual Explanations for Deep Learningcited by 60
- 2021The Use and Misuse of Counterfactuals in Ethical Machine Learningcited by 52
- 2018Interpretable Credit Application Predictions With Counterfactual Explanationscited by 43
- 2022Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AIcited by 40
- 2019Why Does My Model Fail? Contrastive Local Explanations for Retail Forecastingcited by 31
- 2020Explaining Groups of Points in Low-Dimensional Representationscited by 16
- 2022Features of Explainability: How users understand counterfactual and causal explanations for categorical and continuous features in XAIcited by 16
- 2022Keep Your Friends Close and Your Counterfactuals Closer: Improved Learning From Closest Rather Than Plausible Counterfactual Explanations in an Abstract Settingcited by 11
- 2022Let's Go to the Alien Zoo: Introducing an Experimental Framework to Study Usability of Counterfactual Explanations for Machine Learningcited by 9
- 2022One Explanation to Rule them All -- Ensemble Consistent Explanationscited by 7
- 2023Users are the North Star for AI Transparencycited by 5
- 2022Improving Model Understanding and Trust with Counterfactual Explanations of Model Confidencecited by 4
- 2021Predicting Illness for a Sustainable Dairy Agriculture: Predicting and Explaining the Onset of Mastitis in Dairy Cowscited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 8.
9 papers.
- 2024AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systemscited by 7
- 2024Counterfactual Metarules for Local and Global Recoursecited by 7
- 2024Distributional Counterfactual Explanations With Optimal Transportcited by 6
- 2024GLANCE: Global Actions in a Nutshell for Counterfactual Explainabilitycited by 6
- 2024A Two-Stage Algorithm for Cost-Efficient Multi-instance Counterfactual Explanationscited by 5
- 2023Reason to explain: Interactive contrastive explanations (REASONX)cited by 2
- 2024Collective Counterfactual Explanations: Balancing Individual Goals and Collective Dynamicscited by 1
- 2024One-for-many Counterfactual Explanations by Column Generationcited by 1
- 2024Explainable bank failure prediction models: Counterfactual explanations to reduce the failure riskcited by 1
- 2024Explainable bank failure prediction models: Counterfactual explanations to reduce the failure risk14 Jul 2024
- 2024GLANCE: Global Actions in a Nutshell for Counterfactual Explainability29 May 2024
- 2024Counterfactual Metarules for Local and Global Recourse29 May 2024
- 2024A Two-Stage Algorithm for Cost-Efficient Multi-instance Counterfactual Explanations2 Mar 2024
- 2024One-for-many Counterfactual Explanations by Column Generation12 Feb 2024
- 2024AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systems9 Feb 2024
- 2024Collective Counterfactual Explanations: Balancing Individual Goals and Collective Dynamics7 Feb 2024
- 2024Distributional Counterfactual Explanations With Optimal Transport23 Jan 2024
- 2023Reason to explain: Interactive contrastive explanations (REASONX)29 May 2023