A Unified Framework for Evaluating and Enhancing the Transparency of Explainable AI Methods via Perturbation-Gradient Consensus Attribution
Not on the map. Why?
Abstract (arXiv)
Explainable Artificial Intelligence (XAI) methods are increasingly used in safety-critical domains, yet there is no unified framework to jointly evaluate fidelity, interpretability, robustness, fairness, and completeness. We address this gap through two contributions. First, we propose a multi-criteria evaluation framework that formalizes these five criteria using principled metrics: fidelity via prediction-gap analysis; interpretability via a composite concentration-coherence-contrast score; robustness via cosine-similarity perturbation stability; fairness via Jensen-Shannon divergence across demographic groups; and completeness via feature-ablation coverage. These are integrated using an entropy-weighted dynamic scoring scheme that adapts to domain-specific priorities. Second, we introduce Perturbation-Gradient Consensus Attribution (PGCA), which fuses grid-based perturbation importance with Grad-CAM++ through consensus amplification and adaptive contrast enhancement, combining perturbation fidelity with gradient-based spatial precision. We evaluate across five domains (brain tumor MRI, plant disease, security screening, gender, and sunglass detection) using fine-tuned ResNet-50 models. PGCA achieves the best performance in fidelity (2.22 ± 1.62), interpretability (3.89 ± 0.33), and fairness (4.95 ± 0.03), with statistically significant improvements over baselines (p < 10-7). Sensitivity analysis shows stable rankings (Kendall's (τ ≥ 0.88)). Code and results are publicly available.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 5 Dec 2024.
Builds on
20 of 35 references.
References · 20
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
8 more
- 2016The Mythos of Model Interpretabilitycited by 721
- 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
- 2018On the Robustness of Interpretability Methodscited by 314
- 2019On the (In)fidelity and Sensitivity for Explanationscited by 310
- 2018Manipulating and Measuring Model Interpretabilitycited by 256
- 2016Using Deep Learning for Image-Based Plant Disease Detectioncited by 219
- 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171
- 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 126
Built on by
Citing papers per year: 2025: 1.
1 paper.