Transparent Trade-offs between Properties of Explanations
Not on the map. Why?
Abstract (arXiv)
When explaining black-box machine learning models, it's often important for explanations to have certain desirable properties. Most existing methods `encourage' desirable properties in their construction of explanations. In this work, we demonstrate that these forms of encouragement do not consistently create explanations with the properties that are supposedly being targeted. Moreover, they do not allow for any control over which properties are prioritized when different properties are at odds with each other. We propose to directly optimize explanations for desired properties. Our direct approach not only produces explanations with optimal properties more consistently but also empowers users to control trade-offs between different properties, allowing them to create explanations with exactly what is needed for a particular task.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 30 references that are in the map. First posted on arXiv 31 Oct 2024.
Builds on
21 of 30 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2017Interpretation of Neural Networks is Fragilecited by 443
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 440
- 2019On the (In)fidelity and Sensitivity for Explanationscited by 309
9 more
- 2020Evaluating and Aggregating Feature-based Model Explanationscited by 185
- 2021What I Cannot Predict, I Do Not Understand: A Human-Centered Evaluation Framework for Explainability Methodscited by 98
- 2022The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanationscited by 41
- 2022Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AIcited by 40
- 2020Smoothed Geometry for Robust Attributioncited by 38
- 2022What Makes a Good Explanation?: A Harmonized View of Properties of Explanationscited by 21
- 2022Why Should I Choose You? AutoXAI: A Framework for Selecting and Tuning eXplainable AI Solutionscited by 10
- 2024Provably Better Explanations with Optimized Aggregation of Feature Attributionscited by 6
- 2024A Sim2Real Approach for Identifying Task-Relevant Properties in Interpretable Machine Learningcited by 2
Built on by
Not cited yet.