DLBacktrace: A Model Agnostic Explainability for any Deep Learning Models
Not on the map. Why?
Abstract (arXiv)
The rapid growth of AI has led to more complex deep learning models, often operating as opaque "black boxes" with limited transparency in their decision-making. This lack of interpretability poses challenges, especially in high-stakes applications where understanding model output is crucial. This work highlights the importance of interpretability in fostering trust, accountability, and responsible deployment. To address these challenges, we introduce DLBacktrace, a novel, model-agnostic technique designed to provide clear insights into deep learning model decisions across a wide range of domains and architectures, including MLPs, CNNs, and Transformer-based LLM models. We present a comprehensive overview of DLBacktrace and benchmark its performance against established interpretability methods such as SHAP, LIME, and GradCAM. Our results demonstrate that DLBacktrace effectively enhances understanding of model behavior across diverse tasks. DLBacktrace is compatible with models developed in both PyTorch and TensorFlow, supporting architectures such as BERT, ResNet, U-Net, and custom DNNs for tabular data. The library is open-sourced and available at https://github.com/AryaXAI/DLBacktrace .
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 30 of its 38 references that are in the map. First posted on arXiv 19 Nov 2024.
Builds on
30 of 38 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2016Concrete Problems in AI Safetycited by 1,582
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
18 more
- 2018Scalable agent alignment via reward modeling: a research directioncited by 438
- 2019On the (In)fidelity and Sensitivity for Explanationscited by 309
- 2020Evaluating and Aggregating Feature-based Model Explanationscited by 185
- 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171
- 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 156
- 2024AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformerscited by 116
- 2024Rethinking Interpretability in the Era of Large Language Modelscited by 110
- 2019When Explanations Lie: Why Many Modified BP Attributions Failcited by 92
- 2022Sensible AI: Re-imagining Interpretability and Explainability using Sensemaking Theorycited by 32
- 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMscited by 24
- 2023Incorporating Attribution Importance for Improving Faithfulness Metricscited by 14
- 2024Latent Concept-based Explanation of NLP Modelscited by 13
- 2020Challenging common interpretability assumptions in feature attribution explanationscited by 11
- 2024BEExAI: Benchmark to Evaluate Explainable AIcited by 11
- 2024Interpretability Needs a New Paradigmcited by 10
- 2024Towards Compositional Interpretability for XAIcited by 10
- 2024Normalized AOPC: Fixing Misleading Faithfulness Metrics for Feature Attribution Explainabilitycited by 10
- 2024Challenges and Opportunities in Text Generation Explainabilitycited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.