Explaining Deep Learning Models using Causal Inference
Not on the map. Why?
Abstract (arXiv)
Although deep learning models have been successfully applied to a variety of tasks, due to the millions of parameters, they are becoming increasingly opaque and complex. In order to establish trust for their widespread commercial use, it is important to formalize a principled framework to reason over these models. In this work, we use ideas from causal inference to describe a general framework to reason over CNN models. Specifically, we build a Structural Causal Model (SCM) as an abstraction over a specific aspect of the CNN. We also formulate a method to quantitatively rank the filters of a convolution layer according to their counterfactual importance. We illustrate our approach with popular CNN architectures such as LeNet5, VGG19, and ResNet32.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 3; 2024: 2; 2025: 3.
18 papers.
Sort:
By area:
- 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 205
- 2021Generative Causal Explanations for Graph Neural Networkscited by 124
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
- 2022Causality-based Neural Network Repaircited by 47
- 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Studycited by 24
- 2022Evaluation Methods and Measures for Causal Learning Algorithmscited by 23
- 2022Deep Causal Learning: Representation, Discovery and Inferencecited by 11
- 2023Causality Analysis for Evaluating the Security of Large Language Modelscited by 11
- 2021Unsupervised Causal Binary Concepts Discovery with VAE for Black-box Model Explanationcited by 8
- 2021Causal Learning for Socially Responsible AIcited by 7
- 2023SUNY: A Visual Interpretation Framework for Convolutional Neural Networks from a Necessary and Sufficient Perspectivecited by 5
6 more
- 2025Causal-Guided Detoxify Backdoor Attack of Open-Weight LoRA Modelscited by 3
- 2024CausAdv: A Causal-based Framework for Detecting Adversarial Examplescited by 2
- 2024Investigating and unmasking feature-level vulnerabilities of CNNs to adversarial perturbationscited by 1
- 2025ChainReaction: Causal Chain-Guided Reasoning for Modular and Explainable Causal-Why Video Question Answeringcited by 1
- 2021On Causal Inference for Data-free Structured Pruningcited by 0
- 2025Causality-Driven Neural Network Repair: Challenges and Opportunitiescited by 0
- 2025Causal-Guided Detoxify Backdoor Attack of Open-Weight LoRA Models22 Dec 2025
- 2025ChainReaction: Causal Chain-Guided Reasoning for Modular and Explainable Causal-Why Video Question Answering28 Aug 2025
- 2025Causality-Driven Neural Network Repair: Challenges and Opportunities24 Apr 2025
- 2024CausAdv: A Causal-based Framework for Detecting Adversarial Examples29 Oct 2024
- 2024Investigating and unmasking feature-level vulnerabilities of CNNs to adversarial perturbations31 May 2024
- 2023Causality Analysis for Evaluating the Security of Large Language Models13 Dec 2023
- 2023SUNY: A Visual Interpretation Framework for Convolutional Neural Networks from a Necessary and Sufficient Perspective1 Mar 2023
- 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretability11 Jan 2023
- 2022Deep Causal Learning: Representation, Discovery and Inference7 Nov 2022
- 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Study26 Apr 2022
- 2022Causality-based Neural Network Repair20 Apr 2022
- 2022Evaluation Methods and Measures for Causal Learning Algorithms7 Feb 2022
6 more
- 2021On Causal Inference for Data-free Structured Pruning19 Dec 2021
- 2021Unsupervised Causal Binary Concepts Discovery with VAE for Black-box Model Explanation9 Sep 2021
- 2021Causal Learning for Socially Responsible AI25 Apr 2021
- 2021Generative Causal Explanations for Graph Neural Networks14 Apr 2021
- 2021Explainability of deep vision-based autonomous driving systems: Review and challenges13 Jan 2021
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challenges1 Jan 2021
- 2022Causality-based Neural Network Repaircited by 47
- 2022Causality-based Neural Network Repair20 Apr 2022
- 2021Generative Causal Explanations for Graph Neural Networkscited by 124
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challengescited by 56
- 2022Evaluation Methods and Measures for Causal Learning Algorithmscited by 23
- 2022Deep Causal Learning: Representation, Discovery and Inferencecited by 11
- 2021Unsupervised Causal Binary Concepts Discovery with VAE for Black-box Model Explanationcited by 8
- 2021Causal Learning for Socially Responsible AIcited by 7
- 2023SUNY: A Visual Interpretation Framework for Convolutional Neural Networks from a Necessary and Sufficient Perspectivecited by 5
- 2025Causal-Guided Detoxify Backdoor Attack of Open-Weight LoRA Modelscited by 3
- 2024CausAdv: A Causal-based Framework for Detecting Adversarial Examplescited by 2
- 2024Investigating and unmasking feature-level vulnerabilities of CNNs to adversarial perturbationscited by 1
- 2021On Causal Inference for Data-free Structured Pruningcited by 0
- 2025Causal-Guided Detoxify Backdoor Attack of Open-Weight LoRA Models22 Dec 2025
- 2024CausAdv: A Causal-based Framework for Detecting Adversarial Examples29 Oct 2024
- 2024Investigating and unmasking feature-level vulnerabilities of CNNs to adversarial perturbations31 May 2024
- 2023SUNY: A Visual Interpretation Framework for Convolutional Neural Networks from a Necessary and Sufficient Perspective1 Mar 2023
- 2022Deep Causal Learning: Representation, Discovery and Inference7 Nov 2022
- 2022Evaluation Methods and Measures for Causal Learning Algorithms7 Feb 2022
- 2021On Causal Inference for Data-free Structured Pruning19 Dec 2021
- 2021Unsupervised Causal Binary Concepts Discovery with VAE for Black-box Model Explanation9 Sep 2021
- 2021Causal Learning for Socially Responsible AI25 Apr 2021
- 2021Generative Causal Explanations for Graph Neural Networks14 Apr 2021
- 2021Explainability of deep vision-based autonomous driving systems: Review and challenges13 Jan 2021
- 2021Socially Responsible AI Algorithms: Issues, Purposes, and Challenges1 Jan 2021