mlsanityData to 7 Oct 2026

DLBacktrace: A Model Agnostic Explainability for any Deep Learning Models

arXiv 2411.12643 ↗First posted 19 Nov 2024cs.LG cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

The rapid growth of AI has led to more complex deep learning models, often operating as opaque "black boxes" with limited transparency in their decision-making. This lack of interpretability poses challenges, especially in high-stakes applications where understanding model output is crucial. This work highlights the importance of interpretability in fostering trust, accountability, and responsible deployment. To address these challenges, we introduce DLBacktrace, a novel, model-agnostic technique designed to provide clear insights into deep learning model decisions across a wide range of domains and architectures, including MLPs, CNNs, and Transformer-based LLM models. We present a comprehensive overview of DLBacktrace and benchmark its performance against established interpretability methods such as SHAP, LIME, and GradCAM. Our results demonstrate that DLBacktrace effectively enhances understanding of model behavior across diverse tasks. DLBacktrace is compatible with models developed in both PyTorch and TensorFlow, supporting architectures such as BERT, ResNet, U-Net, and custom DNNs for tabular data. The library is open-sourced and available at https://github.com/AryaXAI/DLBacktrace .

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 30 of its 38 references that are in the map. First posted on arXiv 19 Nov 2024.

Builds on

30 of 38 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  5. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  6. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  7. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  8. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  9. 2016Concrete Problems in AI Safetycited by 1,582
  10. 2018Sanity Checks for Saliency Mapscited by 1,149
  11. 2017SmoothGrad: removing noise by adding noisecited by 1,097
  12. 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
18 more
  1. 2018Scalable agent alignment via reward modeling: a research directioncited by 438
  2. 2019On the (In)fidelity and Sensitivity for Explanationscited by 309
  3. 2020Evaluating and Aggregating Feature-based Model Explanationscited by 185
  4. 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171
  5. 2022The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspectivecited by 156
  6. 2024AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformerscited by 116
  7. 2024Rethinking Interpretability in the Era of Large Language Modelscited by 110
  8. 2019When Explanations Lie: Why Many Modified BP Attributions Failcited by 92
  9. 2022Sensible AI: Re-imagining Interpretability and Explainability using Sensemaking Theorycited by 32
  10. 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMscited by 24
  11. 2023Incorporating Attribution Importance for Improving Faithfulness Metricscited by 14
  12. 2024Latent Concept-based Explanation of NLP Modelscited by 13
  13. 2020Challenging common interpretability assumptions in feature attribution explanationscited by 11
  14. 2024BEExAI: Benchmark to Evaluate Explainable AIcited by 11
  15. 2024Interpretability Needs a New Paradigmcited by 10
  16. 2024Towards Compositional Interpretability for XAIcited by 10
  17. 2024Normalized AOPC: Fixing Misleading Faithfulness Metrics for Feature Attribution Explainabilitycited by 10
  18. 2024Challenges and Opportunities in Text Generation Explainabilitycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.