mlsanityData to 14 Oct 2026

A Unified Framework for Evaluating and Enhancing the Transparency of Explainable AI Methods via Perturbation-Gradient Consensus Attribution

arXiv 2412.03884 ↗First posted 5 Dec 2024cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Explainable Artificial Intelligence (XAI) methods are increasingly used in safety-critical domains, yet there is no unified framework to jointly evaluate fidelity, interpretability, robustness, fairness, and completeness. We address this gap through two contributions. First, we propose a multi-criteria evaluation framework that formalizes these five criteria using principled metrics: fidelity via prediction-gap analysis; interpretability via a composite concentration-coherence-contrast score; robustness via cosine-similarity perturbation stability; fairness via Jensen-Shannon divergence across demographic groups; and completeness via feature-ablation coverage. These are integrated using an entropy-weighted dynamic scoring scheme that adapts to domain-specific priorities. Second, we introduce Perturbation-Gradient Consensus Attribution (PGCA), which fuses grid-based perturbation importance with Grad-CAM++ through consensus amplification and adaptive contrast enhancement, combining perturbation fidelity with gradient-based spatial precision. We evaluate across five domains (brain tumor MRI, plant disease, security screening, gender, and sunglass detection) using fine-tuned ResNet-50 models. PGCA achieves the best performance in fidelity (2.22 ± 1.62), interpretability (3.89 ± 0.33), and fairness (4.95 ± 0.03), with statistically significant improvements over baselines (p < 10-7). Sensitivity analysis shows stable rankings (Kendall's (τ ≥ 0.88)). Code and results are publicly available.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 5 Dec 2024.

Builds on

20 of 35 references.

References · 20

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  5. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  6. 2016Equality of Opportunity in Supervised Learningcited by 2,007
  7. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
  8. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  9. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
  10. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
  11. 2018A Survey Of Methods For Explaining Black Box Modelscited by 973
  12. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
8 more
  1. 2016The Mythos of Model Interpretabilitycited by 721
  2. 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
  3. 2018On the Robustness of Interpretability Methodscited by 314
  4. 2019On the (In)fidelity and Sensitivity for Explanationscited by 310
  5. 2018Manipulating and Measuring Model Interpretabilitycited by 256
  6. 2016Using Deep Learning for Image-Based Plant Disease Detectioncited by 219
  7. 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171
  8. 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 126

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.