Interpreting Deep Neural Networks with the Package innsight
Not on the map. Why?
Abstract (arXiv)
The R package innsight offers a general toolbox for revealing variable-wise interpretations of deep neural networks' predictions with so-called feature attribution methods. Aside from the unified and user-friendly framework, the package stands out in three ways: It is generally the first R package implementing feature attribution methods for neural networks. Secondly, it operates independently of the deep learning library allowing the interpretation of models from any R package, including keras, torch, neuralnet, and even custom models. Despite its flexibility, innsight benefits internally from the torch package's fast and efficient array calculations, which builds on LibTorch - PyTorch's C++ backend - without a Python dependency. Finally, it offers a variety of visualization tools for tabular, signal, image data or a combination of these. Additionally, the plots can be rendered interactively using the plotly package.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 20 of its 55 references that are in the map. First posted on arXiv 19 Jun 2023.
Builds on
20 of 55 references.
References · 20
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2020Captum: A unified and generic model interpretability library for PyTorchcited by 542
- 2018All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneouslycited by 364
- 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 343
- 2016Not Just a Black Box: Learning Important Features Through Propagating Activation Differencescited by 295
8 more
- 2015Explaining NonLinear Classification Decisions with Deep Taylor Decompositioncited by 248
- 2016Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Modelscited by 212
- 2020A Patient-Centric Dataset of Images and Metadata for Identifying Melanomas Using Clinical Contextcited by 146
- 2019Towards Best Practice in Explaining Neural Network Decisions with LRPcited by 70
- 2018iNNvestigate neural networks!cited by 58
- 2021Software for Dataset-wide XAI: From Local Explanations to Global Insights with Zennit, CoRelAy, and ViRelAycited by 53
- 2018A Simple and Effective Model-Based Variable Importance Measurecited by 50
- 2019Explainable artificial intelligence model to predict acute critical illness from electronic health recordscited by 42
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.