Influence-Directed Explanations for Deep Convolutional Networks
Not on the map. Why?
Abstract (arXiv)
We study the problem of explaining a rich class of behavioral properties of deep neural networks. Distinctively, our influence-directed explanations approach this problem by peering inside the network to identify neurons with high influence on a quantity and distribution of interest, using an axiomatically-justified influence measure, and then providing an interpretation for the concepts these neurons represent. We evaluate our approach by demonstrating a number of its unique capabilities on convolutional neural networks trained on ImageNet. Our evaluation demonstrates that influence-directed explanations (1) identify influential concepts that generalize across instances, (2) can be used to extract the "essence" of what the network learned about a class, and (3) isolate individual features the network uses to make decisions and distinguish related classes.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 5; 2023: 6; 2024: 9; 2025: 3; 2026: 1.
31 papers.
Sort:
By area:
- 2024Stochastic Concept Bottleneck Modelscited by 51
- 2021Consistent Counterfactuals for Deep Modelscited by 37
- 2024Beyond Concept Bottleneck Models: How to Make Black Boxes Intervenable?cited by 28
- 2021Finding Discriminative Filters for Specific Degradations in Blind Super-Resolutioncited by 26
- 2024Optimal ablation for interpretabilitycited by 25
- 2021Selective Ensembles for Consistent Predictionscited by 23
- 2021Robust Models Are More Interpretable Because Attributions Look Normalcited by 21
- 2024Restore Anything with Masks: Leveraging Mask Image Modeling for Blind All-in-One Image Restorationcited by 20
- 2024Decomposing and Editing Predictions by Modeling Model Computationcited by 19
- 2022The Manifold Hypothesis for Gradient-Based Explanationscited by 16
- 2021MIMIC-IF: Interpretability and Fairness Evaluation of Deep Learning Models on MIMIC-IV Datasetcited by 15
- 2022Debiasing Deep Chest X-Ray Classifiers using Intra- and Post-processing Methodscited by 15
19 more
- 2021Classification-Regression for Chart Comprehensioncited by 11
- 2022RoCourseNet: Distributionally Robust Training of a Prediction Aware Recourse Modelcited by 11
- 2023Investigating the Effect of Misalignment on Membership Privacy in the White-box Settingcited by 9
- 2025Measuring Leakage in Concept-Based Methods: An Information Theoretic Approachcited by 9
- 2024Tree-Based Leakage Inspection and Control in Concept Bottleneck Modelscited by 8
- 2022On the Robustness of Explanations of Deep Neural Network Models: A Surveycited by 5
- 2023Generalizing Backpropagation for Gradient-Based Interpretabilitycited by 5
- 2021TorchEsegeta: Framework for Interpretability and Explainability of Image-based Deep Learning Modelscited by 4
- 2023Rationalizing Predictions by Adversarial Information Calibrationcited by 4
- 2023FedDefender: Backdoor Attack Defense in Federated Learningcited by 4
- 2024Validating Mechanistic Interpretations: An Axiomatic Approachcited by 4
- 2022Faithful Explanations for Deep Graph Modelscited by 2
- 2025RAM++: Robust Representation Learning via Adaptive Mask for All-in-One Image Restorationcited by 1
- 2023ExplainFix: Explainable Spatially Fixed Deep Networkscited by 0
- 2023DXAI: Explaining Classification by Image Decompositioncited by 0
- 2024Y-Drop: A Conductance based Dropout for fully connected layerscited by 0
- 2024Mechanistic Interpretability of Reinforcement Learning Agentscited by 0
- 2025C-SWAP: Explainability-Aware Structured Pruning for Efficient Neural Networks Compressioncited by 0
- 2026From Interpretability Methods to Interpretable Modelscited by 0
- 2026From Interpretability Methods to Interpretable Models4 Sep 2026
- 2025C-SWAP: Explainability-Aware Structured Pruning for Efficient Neural Networks Compression21 Oct 2025
- 2025RAM++: Robust Representation Learning via Adaptive Mask for All-in-One Image Restoration15 Sep 2025
- 2025Measuring Leakage in Concept-Based Methods: An Information Theoretic Approach13 Apr 2025
- 2024Mechanistic Interpretability of Reinforcement Learning Agents30 Oct 2024
- 2024Tree-Based Leakage Inspection and Control in Concept Bottleneck Models8 Oct 2024
- 2024Restore Anything with Masks: Leveraging Mask Image Modeling for Blind All-in-One Image Restoration28 Sep 2024
- 2024Optimal ablation for interpretability16 Sep 2024
- 2024Y-Drop: A Conductance based Dropout for fully connected layers11 Sep 2024
- 2024Validating Mechanistic Interpretations: An Axiomatic Approach18 Jul 2024
- 2024Stochastic Concept Bottleneck Models27 Jun 2024
- 2024Decomposing and Editing Predictions by Modeling Model Computation17 Apr 2024
19 more
- 2024Beyond Concept Bottleneck Models: How to Make Black Boxes Intervenable?24 Jan 2024
- 2023DXAI: Explaining Classification by Image Decomposition30 Dec 2023
- 2023Generalizing Backpropagation for Gradient-Based Interpretability6 Jul 2023
- 2023FedDefender: Backdoor Attack Defense in Federated Learning2 Jul 2023
- 2023Investigating the Effect of Misalignment on Membership Privacy in the White-box Setting8 Jun 2023
- 2023ExplainFix: Explainable Spatially Fixed Deep Networks18 Mar 2023
- 2023Rationalizing Predictions by Adversarial Information Calibration15 Jan 2023
- 2022On the Robustness of Explanations of Deep Neural Network Models: A Survey9 Nov 2022
- 2022Debiasing Deep Chest X-Ray Classifiers using Intra- and Post-processing Methods26 Jul 2022
- 2022The Manifold Hypothesis for Gradient-Based Explanations15 Jun 2022
- 2022RoCourseNet: Distributionally Robust Training of a Prediction Aware Recourse Model1 Jun 2022
- 2022Faithful Explanations for Deep Graph Models24 May 2022
- 2021Classification-Regression for Chart Comprehension29 Nov 2021
- 2021Selective Ensembles for Consistent Predictions16 Nov 2021
- 2021TorchEsegeta: Framework for Interpretability and Explainability of Image-based Deep Learning Models16 Oct 2021
- 2021Consistent Counterfactuals for Deep Models6 Oct 2021
- 2021Finding Discriminative Filters for Specific Degradations in Blind Super-Resolution2 Aug 2021
- 2021Robust Models Are More Interpretable Because Attributions Look Normal20 Mar 2021
- 2021MIMIC-IF: Interpretability and Fairness Evaluation of Deep Learning Models on MIMIC-IV Dataset12 Feb 2021
- 2024Stochastic Concept Bottleneck Modelscited by 51
- 2021Consistent Counterfactuals for Deep Modelscited by 37
- 2024Beyond Concept Bottleneck Models: How to Make Black Boxes Intervenable?cited by 28
- 2021Finding Discriminative Filters for Specific Degradations in Blind Super-Resolutioncited by 26
- 2024Optimal ablation for interpretabilitycited by 25
- 2021Selective Ensembles for Consistent Predictionscited by 23
- 2021Robust Models Are More Interpretable Because Attributions Look Normalcited by 21
- 2024Restore Anything with Masks: Leveraging Mask Image Modeling for Blind All-in-One Image Restorationcited by 20
- 2024Decomposing and Editing Predictions by Modeling Model Computationcited by 19
- 2022The Manifold Hypothesis for Gradient-Based Explanationscited by 16
- 2021MIMIC-IF: Interpretability and Fairness Evaluation of Deep Learning Models on MIMIC-IV Datasetcited by 15
- 2022Debiasing Deep Chest X-Ray Classifiers using Intra- and Post-processing Methodscited by 15
12 most cited of 29 All 29 (JSON)
- 2026From Interpretability Methods to Interpretable Models4 Sep 2026
- 2025C-SWAP: Explainability-Aware Structured Pruning for Efficient Neural Networks Compression21 Oct 2025
- 2025RAM++: Robust Representation Learning via Adaptive Mask for All-in-One Image Restoration15 Sep 2025
- 2025Measuring Leakage in Concept-Based Methods: An Information Theoretic Approach13 Apr 2025
- 2024Tree-Based Leakage Inspection and Control in Concept Bottleneck Models8 Oct 2024
- 2024Restore Anything with Masks: Leveraging Mask Image Modeling for Blind All-in-One Image Restoration28 Sep 2024
- 2024Optimal ablation for interpretability16 Sep 2024
- 2024Y-Drop: A Conductance based Dropout for fully connected layers11 Sep 2024
- 2024Stochastic Concept Bottleneck Models27 Jun 2024
- 2024Decomposing and Editing Predictions by Modeling Model Computation17 Apr 2024
- 2024Beyond Concept Bottleneck Models: How to Make Black Boxes Intervenable?24 Jan 2024
- 2023DXAI: Explaining Classification by Image Decomposition30 Dec 2023
12 newest of 29 All 29 (JSON)