Causal Learning and Explanation of Deep Neural Networks via Autoencoded Activations
Not on the map. Why?
Abstract (arXiv)
Deep neural networks are complex and opaque. As they enter application in a variety of important and safety critical domains, users seek methods to explain their output predictions. We develop an approach to explaining deep neural networks by constructing causal models on salient concepts contained in a CNN. We develop methods to extract salient concepts throughout a target network by using autoencoders trained to extract human-understandable representations of network activations. We then build a bayesian causal model using these extracted concepts as variables in order to explain image classification. Finally, we use this causal model to identify and visualize features with significant causal influence on final classification.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 6; 2023: 4; 2024: 2; 2025: 2.
23 papers.
Sort:
By area:
- 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 205
- 2023Recent Advancements in End-to-End Autonomous Driving using Deep Learning: A Surveycited by 103
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2022Causality-based Neural Network Repaircited by 47
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
- 2021STEEX: Steering Counterfactual Explanations with Semanticscited by 40
- 2021Defining and Quantifying the Emergence of Sparse Concepts in DNNscited by 36
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2022OCTET: Object-aware Counterfactual Explanationscited by 28
- 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Studycited by 24
- 2022Evaluation Methods and Measures for Causal Learning Algorithmscited by 23
- 2024Towards Compositional Interpretability for XAIcited by 12
11 more
- 2021Can We Faithfully Represent Masked States to Compute Shapley Values on a DNN?cited by 10
- 2021Detecting Multi-Sensor Fusion Errors in Advanced Driver-Assistance Systemscited by 8
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutionscited by 7
- 2023Explaining Language Models' Predictions with High-Impact Conceptscited by 7
- 2023SUNY: A Visual Interpretation Framework for Convolutional Neural Networks from a Necessary and Sufficient Perspectivecited by 5
- 2024GIFT: A Framework Towards Global Interpretable Faithful Textual Explanations of Vision Classifierscited by 2
- 2021Explainability-aided Domain Generalization for Image Classificationcited by 1
- 2022Explanatory causal effects for model agnostic explanationscited by 1
- 2022Neural Bayesian Network Understudycited by 0
- 2025Causally-informed Deep Learning towards Explainable and Generalizable Outcomes Prediction in Critical Carecited by 0
- 2025A Model of Causal Explanation on Neural Networks for Tabular Datacited by 0
- 2025A Model of Causal Explanation on Neural Networks for Tabular Data25 Dec 2025
- 2025Causally-informed Deep Learning towards Explainable and Generalizable Outcomes Prediction in Critical Care4 Feb 2025
- 2024GIFT: A Framework Towards Global Interpretable Faithful Textual Explanations of Vision Classifiers23 Nov 2024
- 2024Towards Compositional Interpretability for XAI25 Jun 2024
- 2023Recent Advancements in End-to-End Autonomous Driving using Deep Learning: A Survey10 Jul 2023
- 2023Explaining Language Models' Predictions with High-Impact Concepts3 May 2023
- 2023SUNY: A Visual Interpretation Framework for Convolutional Neural Networks from a Necessary and Sufficient Perspective1 Mar 2023
- 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretability11 Jan 2023
- 2022OCTET: Object-aware Counterfactual Explanations22 Nov 2022
- 2022Neural Bayesian Network Understudy15 Nov 2022
- 2022Explanatory causal effects for model agnostic explanations23 Jun 2022
- 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Study26 Apr 2022
11 more
- 2022Causality-based Neural Network Repair20 Apr 2022
- 2022Evaluation Methods and Measures for Causal Learning Algorithms7 Feb 2022
- 2021STEEX: Steering Counterfactual Explanations with Semantics17 Nov 2021
- 2021Defining and Quantifying the Emergence of Sparse Concepts in DNNs11 Nov 2021
- 2021Detecting Multi-Sensor Fusion Errors in Advanced Driver-Assistance Systems14 Sep 2021
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions20 Jul 2021
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Survey2 Jul 2021
- 2021Can We Faithfully Represent Masked States to Compute Shapley Values on a DNN?22 May 2021
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safety29 Apr 2021
- 2021Explainability-aided Domain Generalization for Image Classification5 Apr 2021
- 2021Explainability of deep vision-based autonomous driving systems: Review and challenges13 Jan 2021
- 2022Causality-based Neural Network Repaircited by 47
- 2022Causality-based Neural Network Repair20 Apr 2022
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
- 2021STEEX: Steering Counterfactual Explanations with Semanticscited by 40
- 2021Defining and Quantifying the Emergence of Sparse Concepts in DNNscited by 36
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2022OCTET: Object-aware Counterfactual Explanationscited by 28
- 2022Evaluation Methods and Measures for Causal Learning Algorithmscited by 23
- 2024Towards Compositional Interpretability for XAIcited by 12
- 2021Can We Faithfully Represent Masked States to Compute Shapley Values on a DNN?cited by 10
- 2021Detecting Multi-Sensor Fusion Errors in Advanced Driver-Assistance Systemscited by 8
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutionscited by 7
- 2023Explaining Language Models' Predictions with High-Impact Conceptscited by 7
12 most cited of 19 All 19 (JSON)
- 2025A Model of Causal Explanation on Neural Networks for Tabular Data25 Dec 2025
- 2025Causally-informed Deep Learning towards Explainable and Generalizable Outcomes Prediction in Critical Care4 Feb 2025
- 2024GIFT: A Framework Towards Global Interpretable Faithful Textual Explanations of Vision Classifiers23 Nov 2024
- 2024Towards Compositional Interpretability for XAI25 Jun 2024
- 2023Explaining Language Models' Predictions with High-Impact Concepts3 May 2023
- 2023SUNY: A Visual Interpretation Framework for Convolutional Neural Networks from a Necessary and Sufficient Perspective1 Mar 2023
- 2022OCTET: Object-aware Counterfactual Explanations22 Nov 2022
- 2022Neural Bayesian Network Understudy15 Nov 2022
- 2022Explanatory causal effects for model agnostic explanations23 Jun 2022
- 2022Evaluation Methods and Measures for Causal Learning Algorithms7 Feb 2022
- 2021STEEX: Steering Counterfactual Explanations with Semantics17 Nov 2021
- 2021Defining and Quantifying the Emergence of Sparse Concepts in DNNs11 Nov 2021
12 newest of 19 All 19 (JSON)