# Combining Similarity and Adversarial Learning to Generate Visual Explanation: Application to Medical Image Classification

arXiv: https://arxiv.org/abs/2012.07332 · HTML: https://mlsanity.com/paper/2012.07332/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Dec 2020.

## Built on by (most cited first, 3 of 3)

- [White Box Methods for Explanations of Convolutional Neural Networks in Image Classification Tasks](https://mlsanity.com/paper/2104.02548/) (2021)
- [Leveraging Conditional Generative Models in a General Explanation Framework of Classifier Decisions](https://mlsanity.com/paper/2106.10947/) (2021)
- [Counterfactual Image Generation for adversarially robust and interpretable Classifiers](https://mlsanity.com/paper/2310.00761/) (2023)

## Abstract (arXiv)

Explaining decisions of black-box classifiers is paramount in sensitive domains such as medical imaging since clinicians confidence is necessary for adoption. Various explanation approaches have been proposed, among which perturbation based approaches are very promising. Within this class of methods, we leverage a learning framework to produce our visual explanations method. From a given classifier, we train two generators to produce from an input image the so called similar and adversarial images. The similar image shall be classified as the input image whereas the adversarial shall not. Visual explanation is built as the difference between these two generated images. Using metrics from the literature, our method outperforms state-of-the-art approaches. The proposed approach is model-agnostic and has a low computation burden at prediction time. Thus, it is adapted for real-time systems. Finally, we show that random geometric augmentations applied to the original image play a regularization role that improves several previously proposed explanation methods. We validate our approach on a large chest X-ray database.