Xplique: A Deep Learning Explainability Toolbox
Not on the map. Why?
Abstract (arXiv)
Today's most advanced machine-learning models are hardly scrutable. The key challenge for explainability methods is to help assisting researchers in opening up these black boxes, by revealing the strategy that led to a given decision, by characterizing their internal states or by studying the underlying data representation. To address this challenge, we have developed Xplique: a software library for explainability which includes representative explainability methods as well as associated evaluation metrics. It interfaces with one of the most popular learning libraries: Tensorflow as well as other libraries including PyTorch, scikit-learn and Theano. The code is licensed under the MIT license and is freely available at github.com/deel-ai/xplique.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 37 of its 51 references that are in the map. First posted on arXiv 9 Jun 2022.
Builds on
37 of 51 references.
References · 37
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2020Concept Bottleneck Modelscited by 1,022
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
25 more
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
- 2020Captum: A unified and generic model interpretability library for PyTorchcited by 542
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 467
- 2017Interpretation of Neural Networks is Fragilecited by 443
- 2019On the (In)fidelity and Sensitivity for Explanationscited by 309
- 2019On Completeness-aware Concept-Based Explanations in Deep Neural Networkscited by 239
- 2018Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systemscited by 234
- 2020Evaluating and Aggregating Feature-based Model Explanationscited by 185
- 2019Sanity Checks for Saliency Metricscited by 119
- 2016Multifaceted Feature Visualization: Uncovering the Different Types of Features Learned By Each Neuron in Deep Neural Networkscited by 106
- 2021What I Cannot Predict, I Do Not Understand: A Human-Centered Evaluation Framework for Explainability Methodscited by 98
- 2019When Explanations Lie: Why Many Modified BP Attributions Failcited by 92
- 2019An Evaluation of the Human-Interpretability of Explanationcited by 71
- 2019Understanding Neural Networks via Feature Visualization: A surveycited by 65
- 2021Look at the Variance! Efficient Black-box Explanations with Sobol-based Sensitivity Analysiscited by 65
- 2020Evaluations and Methods for Explanation through Robustness Analysiscited by 51
- 2020IROF: a low resource evaluation metric for explanation methodscited by 45
- 2022Don't Lie to Me! Robust and Efficient Explainability with Verified Perturbation Analysiscited by 38
- 2021DISSECT: Disentangled Simultaneous Explanations via Concept Traversalscited by 37
- 2019Do Explanations Reflect Decisions? A Machine-centric Strategy to Quantify the Performance of Explainability Algorithmscited by 32
- 2022Human-Centered Concept Explanations for Neural Networkscited by 23
- 2021Best of both worlds: local and global explanations with human-understandable conceptscited by 22
- 2018Noise-adding Methods of Saliency Map as Series of Higher Order Partial Derivativecited by 11
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 6; 2025: 7; 2026: 3.
24 papers.
Sort:
By area:
- 2022CRAFT: Concept Recursive Activation FacTorization for Explainabilitycited by 177
- 2023A Holistic Approach to Unifying Automatic Concept Extraction and Concept Importance Estimationcited by 108
- 2025Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Modelscited by 67
- 2022Making Sense of Dependence: Efficient Black-box Explanations Using Dependence Measurecited by 33
- 2023Unlocking Feature Visualization for Deeper Networks with MAgnitude Constrained Optimizationcited by 26
- 2024Benchmarking XAI Explanations with Human-Aligned Evaluationscited by 8
- 2023Saliency-Bench: A Comprehensive Benchmark for Evaluating Visual Explanationscited by 6
- 2025Uncertainty Propagation in XAI: A Comparison of Analytical and Empirical Estimatorscited by 6
- 2023Assessment of the Reliablity of a Model's Decision by Generalizing Attribution to the Wavelet Domaincited by 5
- 2025Representational Similarity via Interpretable Visual Conceptscited by 5
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networkscited by 3
- 2023DCNFIS: Deep Convolutional Neuro-Fuzzy Inference Systemcited by 2
12 more
- 2024Quanda: An Interpretability Toolkit for Training Data Attribution Evaluation and Beyondcited by 2
- 2025A Survey on Interpretability in Visual Recognitioncited by 2
- 2023Deep Natural Language Feature Learning for Interpretable Predictioncited by 1
- 2025Measuring the (Un)Faithfulness of Concept-Based Explanationscited by 1
- 2025Interpreto: An Explainability Library for Transformerscited by 1
- 2025Back to the Baseline: Examining Baseline Effects on Explainability Metricscited by 1
- 2024NormEnsembleXAI: Unveiling the Strengths and Weaknesses of XAI Ensemble Techniquescited by 0
- 2024Unlearning-based Neural Interpretationscited by 0
- 2024XAI-based Feature Selection for Improved Network Intrusion Detection Systemscited by 0
- 2024PCIM: Learning Pixel Attributions via Pixel-wise Channel Isolation Mixing in High Content Imagingcited by 0
- 2026The Impact of Lesion Focus on the Performance of AI-Based Melanoma Classificationcited by 0
- 2026Building Trust in Artificial Intelligence: A Necessity for Railway Applicationscited by 0
- 2026Building Trust in Artificial Intelligence: A Necessity for Railway Applications16 Sep 2026
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networks11 Mar 2026
- 2026The Impact of Lesion Focus on the Performance of AI-Based Melanoma Classification1 Jan 2026
- 2025Back to the Baseline: Examining Baseline Effects on Explainability Metrics12 Dec 2025
- 2025Interpreto: An Explainability Library for Transformers10 Dec 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025Measuring the (Un)Faithfulness of Concept-Based Explanations15 Apr 2025
- 2025Uncertainty Propagation in XAI: A Comparison of Analytical and Empirical Estimators1 Apr 2025
- 2025Representational Similarity via Interpretable Visual Concepts19 Mar 2025
- 2025Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Models18 Feb 2025
- 2024PCIM: Learning Pixel Attributions via Pixel-wise Channel Isolation Mixing in High Content Imaging3 Dec 2024
- 2024Benchmarking XAI Explanations with Human-Aligned Evaluations4 Nov 2024
12 more
- 2024XAI-based Feature Selection for Improved Network Intrusion Detection Systems14 Oct 2024
- 2024Unlearning-based Neural Interpretations10 Oct 2024
- 2024Quanda: An Interpretability Toolkit for Training Data Attribution Evaluation and Beyond9 Oct 2024
- 2024NormEnsembleXAI: Unveiling the Strengths and Weaknesses of XAI Ensemble Techniques30 Jan 2024
- 2023Deep Natural Language Feature Learning for Interpretable Prediction9 Nov 2023
- 2023Saliency-Bench: A Comprehensive Benchmark for Evaluating Visual Explanations12 Oct 2023
- 2023DCNFIS: Deep Convolutional Neuro-Fuzzy Inference System11 Aug 2023
- 2023A Holistic Approach to Unifying Automatic Concept Extraction and Concept Importance Estimation11 Jun 2023
- 2023Unlocking Feature Visualization for Deeper Networks with MAgnitude Constrained Optimization11 Jun 2023
- 2023Assessment of the Reliablity of a Model's Decision by Generalizing Attribution to the Wavelet Domain24 May 2023
- 2022CRAFT: Concept Recursive Activation FacTorization for Explainability17 Nov 2022
- 2022Making Sense of Dependence: Efficient Black-box Explanations Using Dependence Measure13 Jun 2022
- 2024Unlearning-based Neural Interpretationscited by 0
- 2024Unlearning-based Neural Interpretations10 Oct 2024
- 2022CRAFT: Concept Recursive Activation FacTorization for Explainabilitycited by 177
- 2023A Holistic Approach to Unifying Automatic Concept Extraction and Concept Importance Estimationcited by 108
- 2025Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Modelscited by 67
- 2022Making Sense of Dependence: Efficient Black-box Explanations Using Dependence Measurecited by 33
- 2023Unlocking Feature Visualization for Deeper Networks with MAgnitude Constrained Optimizationcited by 26
- 2023Saliency-Bench: A Comprehensive Benchmark for Evaluating Visual Explanationscited by 6
- 2025Uncertainty Propagation in XAI: A Comparison of Analytical and Empirical Estimatorscited by 6
- 2023Assessment of the Reliablity of a Model's Decision by Generalizing Attribution to the Wavelet Domaincited by 5
- 2025Representational Similarity via Interpretable Visual Conceptscited by 5
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networkscited by 3
- 2023DCNFIS: Deep Convolutional Neuro-Fuzzy Inference Systemcited by 2
- 2024Quanda: An Interpretability Toolkit for Training Data Attribution Evaluation and Beyondcited by 2
12 most cited of 22 All 22 (JSON)
- 2026Building Trust in Artificial Intelligence: A Necessity for Railway Applications16 Sep 2026
- 2026FAME: Formal Abstract Minimal Explanation for Neural Networks11 Mar 2026
- 2026The Impact of Lesion Focus on the Performance of AI-Based Melanoma Classification1 Jan 2026
- 2025Back to the Baseline: Examining Baseline Effects on Explainability Metrics12 Dec 2025
- 2025Interpreto: An Explainability Library for Transformers10 Dec 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025Measuring the (Un)Faithfulness of Concept-Based Explanations15 Apr 2025
- 2025Uncertainty Propagation in XAI: A Comparison of Analytical and Empirical Estimators1 Apr 2025
- 2025Representational Similarity via Interpretable Visual Concepts19 Mar 2025
- 2025Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Models18 Feb 2025
- 2024PCIM: Learning Pixel Attributions via Pixel-wise Channel Isolation Mixing in High Content Imaging3 Dec 2024
- 2024XAI-based Feature Selection for Improved Network Intrusion Detection Systems14 Oct 2024
12 newest of 22 All 22 (JSON)