Increasing Performance And Sample Efficiency With Model-agnostic Interactive Feature Attributions
Not on the map. Why?
Abstract (arXiv)
Model-agnostic feature attributions can provide local insights in complex ML models. If the explanation is correct, a domain expert can validate and trust the model's decision. However, if it contradicts the expert's knowledge, related work only corrects irrelevant features to improve the model. To allow for unlimited interaction, in this paper we provide model-agnostic implementations for two popular explanation methods (Occlusion and Shapley values) to enforce entirely different attributions in the complex model. For a particular set of samples, we use the corrected feature attributions to generate extra local data, which is used to retrain the model to have the right explanation for the samples. Through simulated and real data experiments on a variety of models we show how our proposed approach can significantly improve the model's performance only by augmenting its training dataset based on corrected explanations. Adding our interactive explanations to active learning settings increases the sample efficiency significantly and outperforms existing explanatory interactive strategies. Additionally we explore how a domain expert can provide feature attributions which are sufficiently correct to improve the model.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 22 references that are in the map. First posted on arXiv 28 Jun 2023.
Builds on
13 of 22 references.
References · 13
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2019The many Shapley values for model explanationcited by 344
- 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 294
- 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
- 2020Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Reviewcited by 174
- 2020Making deep neural networks right for the right scientific reasons by interacting with their explanationscited by 142
- 2019Sanity Checks for Saliency Metricscited by 119
- 2021How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanationscited by 58
- 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 53
1 more
Built on by
Citing papers per year: 2025: 1.
1 paper.