Towards Attributions of Input Variables in a Coalition
Not on the map. Why?
Abstract (arXiv)
This paper focuses on the fundamental challenge of partitioning input variables in attribution methods for Explainable AI, particularly in Shapley value-based approaches. Previous methods always compute attributions given a predefined partition but lack theoretical guidance on how to form meaningful variable partitions. We identify that attribution conflicts arise when the attribution of a coalition differs from the sum of its individual variables' attributions. To address this, we analyze the numerical effects of AND-OR interactions in AI models and extend the Shapley value to a new attribution metric for variable coalitions. Our theoretical findings reveal that specific interactions cause attribution conflicts, and we propose three metrics to evaluate coalition faithfulness. Experiments on synthetic data, NLP, image classification, and the game of Go validate our approach, demonstrating consistency with human intuition and practical applicability.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 46 references that are in the map. First posted on arXiv 23 Sep 2023.
Builds on
23 of 46 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2019The many Shapley values for model explanationcited by 344
- 2019The Shapley Taylor Interaction Indexcited by 143
- 2019Explaining Deep Neural Networks with a Polynomial Time Algorithm for Shapley Values Approximationcited by 115
- 2020Explaining Explanations: Axiomatic Feature Interactions for Deep Networkscited by 103
11 more
- 2021Sampling Permutations for Shapley Value Estimationcited by 102
- 2018Model Agnostic Supervised Local Explanationscited by 83
- 2017Detecting Statistical Interactions from Neural Network Weightscited by 80
- 2020How does this interaction affect me? Interpretable attribution for feature interactionscited by 73
- 2018Hierarchical interpretations for neural network predictionscited by 66
- 2019Accelerating Self-Play Learning in Gocited by 64
- 2021Discovering and Explaining the Representation Bottleneck of DNNscited by 42
- 2021Joint Shapley values: a measure of joint feature importancecited by 15
- 2023Technical Note: Defining and Quantifying AND-OR Interactions for Faithful and Concise Explanation of DNNscited by 12
- 2021Can We Faithfully Represent Masked States to Compute Shapley Values on a DNN?cited by 10
- 2022Batch Normalization Is Blind to the First and Second Derivatives of the Losscited by 3
Built on by
Citing papers per year: 2023: 1.
1 paper.