mlsanityData to 14 Oct 2026

Increasing Performance And Sample Efficiency With Model-agnostic Interactive Feature Attributions

arXiv 2306.16431 ↗First posted 28 Jun 2023cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Model-agnostic feature attributions can provide local insights in complex ML models. If the explanation is correct, a domain expert can validate and trust the model's decision. However, if it contradicts the expert's knowledge, related work only corrects irrelevant features to improve the model. To allow for unlimited interaction, in this paper we provide model-agnostic implementations for two popular explanation methods (Occlusion and Shapley values) to enforce entirely different attributions in the complex model. For a particular set of samples, we use the corrected feature attributions to generate extra local data, which is used to retrain the model to have the right explanation for the samples. Through simulated and real data experiments on a variety of models we show how our proposed approach can significantly improve the model's performance only by augmenting its training dataset based on corrected explanations. Adding our interactive explanations to active learning settings increases the sample efficiency significantly and outperforms existing explanatory interactive strategies. Additionally we explore how a domain expert can provide feature attributions which are sufficiently correct to improve the model.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 22 references that are in the map. First posted on arXiv 28 Jun 2023.

Builds on

13 of 22 references.

References · 13

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  3. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  4. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  5. 2019The many Shapley values for model explanationcited by 344
  6. 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 294
  7. 2020Explaining by Removing: A Unified Framework for Model Explanationcited by 218
  8. 2020Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Reviewcited by 174
  9. 2020Making deep neural networks right for the right scientific reasons by interacting with their explanationscited by 142
  10. 2019Sanity Checks for Saliency Metricscited by 119
  11. 2021How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanationscited by 58
  12. 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 53
1 more
  1. 2022A Typology for Exploring the Mitigation of Shortcut Behaviorcited by 7

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.