Explaining Classifiers with Causal Concept Effect (CaCE)
Not on the map. Why?
Abstract (arXiv)
How can we understand classification decisions made by deep neural networks? Many existing explainability methods rely solely on correlations and fail to account for confounding, which may result in potentially misleading explanations. To overcome this problem, we define the Causal Concept Effect (CaCE) as the causal effect of (the presence or absence of) a human-interpretable concept on a deep neural net's predictions. We show that the CaCE measure can avoid errors stemming from confounding. Estimating CaCE is difficult in situations where we cannot easily simulate the do-operator. To mitigate this problem, we use a generative model, specifically a Variational AutoEncoder (VAE), to measure VAE-CaCE. In an extensive experimental analysis, we show that the VAE-CaCE is able to estimate the true concept causal effect, compared to baselines for a number of datasets including high dimensional images.
Key facts. Cited by 135 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 30; 2023: 19; 2024: 27; 2025: 19; 2026: 13.
135 papers.
Sort:
By area:
- 2022Post-hoc Concept Bottleneck Modelscited by 293
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2021Acquisition of Chess Knowledge in AlphaZerocited by 123
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 2021Counterfactual Generative Networkscited by 111
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 98
- 2021CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithmscited by 86
- 2021Leveraging Sparse Linear Layers for Debuggable Deep Networkscited by 82
- 2022Concept Bottleneck Model with Additional Unsupervised Conceptscited by 79
- 2021Editing a classifier by rewriting its prediction rulescited by 65
- 2022CEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model Behaviorcited by 55
38 more
- 2021Entropy-based Logic Explanations of Neural Networkscited by 51
- 2022A Causal Lens for Controllable Text Generationcited by 45
- 2023Faithful Explanations of Black-box NLP Models Using LLM-generated Counterfactualscited by 44
- 2021ELLA: Exploration through Learned Language Abstractioncited by 42
- 2023Bridging the Human-AI Knowledge Gap: Concept Discovery and Transfer in AlphaZerocited by 42
- 2023Learning to Receive Help: Intervention-Aware Concept Embedding Modelscited by 41
- 2021What if This Modified That? Syntactic Interventions via Counterfactual Embeddingscited by 39
- 2021DISSECT: Disentangled Simultaneous Explanations via Concept Traversalscited by 37
- 2023Explain Any Concept: Segment Anything Meets Concept-Based Explanationcited by 37
- 2022Cycle-Consistent Counterfactuals by Latent Transformationscited by 33
- 2023Interpreting Pretrained Language Models via Concept Bottleneckscited by 33
- 2022Causal Proxy Models for Concept-Based Model Explanationscited by 29
- 2024Causal Concept Graph Models: Beyond Causal Opacity in Deep Learningcited by 29
- 2022Explainable AI for clinical and remote health applications: a survey on tabular and time series datacited by 24
- 2023A Glitch in the Matrix? Locating and Detecting Language Model Grounding with Fakepediacited by 24
- 2024The Quest for the Right Mediator: Surveying Mechanistic Interpretability Through the Lens of Causal Mediation Analysiscited by 24
- 2022Evaluation Methods and Measures for Causal Learning Algorithmscited by 23
- 2022Human-Centered Concept Explanations for Neural Networkscited by 23
- 2022Unit Testing for Concepts in Neural Networkscited by 23
- 2021Best of both worlds: local and global explanations with human-understandable conceptscited by 22
- 2021On Causally Disentangled Representationscited by 22
- 2022Understanding and Enhancing Robustness of Concept-based Modelscited by 22
- 2022Concept Embedding Analysis: A Reviewcited by 20
- 2022Concept Gradient: Concept-based Interpretation Without Linear Assumptioncited by 20
- 2024Counterfactual Image Editingcited by 20
- 2021Rationalization through Conceptscited by 19
- 2022Unpacking Large Language Models with Conceptual Consistencycited by 18
- 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?cited by 18
- 2025Causally Reliable Concept Bottleneck Modelscited by 17
- 2022ECLAD: Extracting Concepts with Local Aggregated Descriptorscited by 15
- 2023The Co-12 Recipe for Evaluating Interpretable Part-Prototype Image Classifierscited by 15
- 2021Model-Based Counterfactual Synthesizer for Interpretationcited by 14
- 2021Learn-Explain-Reinforce: Counterfactual Reasoning and Its Guidance to Reinforce an Alzheimer's Disease Diagnosis Modelcited by 14
- 2021Latent Space Explanation by Interventioncited by 13
- 2022Do Users Benefit From Interpretable Vision? A User Study, Baseline, And Datasetcited by 13
- 2022Spatial-temporal Concept based Explanation of 3D ConvNetscited by 12
- 2022Adapting to Latent Subgroup Shifts via Concepts and Proxiescited by 12
- 2023Causal reasoning in typical computer vision taskscited by 12
50 most cited of 135 All 135 (JSON)
- 2026Decomposition of Evidence, Contradiction, and Fragility in Perturbation Responses13 Aug 2026
- 2026Local Label-Informed Feature Transfer for Generating Ground-Truth Medical Images: A Comparison of GAN- and Diffusion-Based Approaches21 Jul 2026
- 2026ConceptCF: Concept-based Counterfactuals for the Explainability of Time Series21 Jul 2026
- 2026TRACE: A Concept Bottleneck Model for Longitudinal 3D Glioblastoma Response Assessment29 Jun 2026
- 2026Faithful Action-unit Causal Reasoning for Counterfactually Faithful Emotion Explanations14 Jun 2026
- 2026Position: Explainable AI is Causality in Disguise30 Mar 2026
- 2026CVGL: Causal Learning and Geometric Topology13 Mar 2026
- 2026STATe-of-Thoughts: Structured Action Templates for Tree-of-Thoughts15 Feb 2026
- 2026CLEAR-HPV: Interpretable concept discovery for human-papillomavirus-associated morphology in whole-slide histology4 Feb 2026
- 2026Interpreting and Controlling Model Behavior via Constitutions for Atomic Concept Edits23 Jan 2026
- 2026Explainable AI to Improve Machine Learning Reliability for Industrial Cyber-Physical Systems22 Jan 2026
- 2026LIBERTy: A Causal Framework for Benchmarking Concept-Based Explanations of LLMs with Structural Counterfactuals15 Jan 2026
38 more
- 2026TimeSAE: Causal Sparse Decoding for Faithful Explanations of Black-Box Time Series Models14 Jan 2026
- 2025CAuSE: Decoding Multimodal Classifiers using Faithful Natural Language Explanation7 Dec 2025
- 2025Exploring and Leveraging Class Vectors for Classifier Editing13 Oct 2025
- 2025Towards explainable decision support using hybrid neural models for logistic terminal automation9 Sep 2025
- 2025Automatic Reviewers Fail to Detect Faulty Reasoning in Research Papers: A New Counterfactual Evaluation Framework29 Aug 2025
- 2025GCAV: A Global Concept Activation Vector Framework for Cross-Layer Consistency in Interpretability28 Aug 2025
- 2025Foundations of Interpretable Models1 Aug 2025
- 2025A Concept-based approach to Voice Disorder Detection23 Jul 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025Explainable Artificial Intelligence in Biomedical Image Analysis: A Comprehensive Survey9 Jul 2025
- 2025Do you see what I see? An Ambiguous Optical Illusion Dataset exposing limitations of Explainable AI27 May 2025
- 2025Enhancing the Comprehensibility of Text Explanations via Unsupervised Concept Discovery26 May 2025
- 2025On Measuring Intrinsic Causal Attributions in Deep Neural Networks14 May 2025
- 2025C-SHAP for time series: An approach to high-level temporal explanations15 Apr 2025
- 2025Explaining Low Perception Model Competency with High-Competency Counterfactuals7 Apr 2025
- 2025Quantifying Symptom Causality in Clinical Decision Making: An Exploration Using CausaLM25 Mar 2025
- 2025VisionLogic: Discovering and Grounding Decision-Relevant Visual Concepts13 Mar 2025
- 2025Locally Explaining Prediction Behavior via Gradual Interventions and Measuring Property Gradients7 Mar 2025
- 2025Causally Reliable Concept Bottleneck Models6 Mar 2025
- 2025Sample-efficient Learning of Concepts with Theoretical Guarantees: from Data to Concepts without Interventions10 Feb 2025
- 2024Explaining in Diffusion: Explaining a Classifier Through Hierarchical Semantics with Text-to-Image Diffusion Models24 Dec 2024
- 2024GIFT: A Framework Towards Global Interpretable Faithful Textual Explanations of Vision Classifiers23 Nov 2024
- 2024Linking Model Intervention to Causal Interpretation in Model Explanation21 Oct 2024
- 2024Structural Causality-based Generalizable Concept Discovery Models20 Oct 2024
- 2024Seeing Through VisualBERT: A Causal Adventure on Memetic Landscapes17 Oct 2024
- 2024Beyond Attribution: Unified Concept-Level Explanations16 Oct 2024
- 2024Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go?20 Sep 2024
- 2024The Quest for the Right Mediator: Surveying Mechanistic Interpretability Through the Lens of Causal Mediation Analysis2 Aug 2024
- 2024CoLiDR: Concept Learning using Aggregated Disentangled Representations27 Jul 2024
- 2024Linearly-Interpretable Concept Embedding Models for Text Analysis20 Jun 2024
- 2024Causal Concept Graph Models: Beyond Causal Opacity in Deep Learning26 May 2024
- 2024Explaining Time Series Classification Predictions via Causal Attributions24 May 2024
- 2024Less is More: Discovering Concise Network Explanations24 May 2024
- 2024A Self-explaining Neural Architecture for Generalizable Concept Learning1 May 2024
- 2024Evaluating Readability and Faithfulness of Concept-based Explanations29 Apr 2024
- 2024Measuring Feature Dependency of Neural Networks by Collapsing Feature Dimensions in the Data Manifold18 Apr 2024
- 2024Knowledge graphs for empirical concept retrieval10 Apr 2024
- 2024A survey on Concept-based Approaches For Model Improvement21 Mar 2024
50 newest of 135 All 135 (JSON)
- 2023Causal reasoning in typical computer vision taskscited by 12
- 2025Automatic Reviewers Fail to Detect Faulty Reasoning in Research Papers: A New Counterfactual Evaluation Frameworkcited by 11
- 2026STATe-of-Thoughts: Structured Action Templates for Tree-of-Thoughtscited by 0
- 2026Faithful Action-unit Causal Reasoning for Counterfactually Faithful Emotion Explanationscited by 0
- 2026Faithful Action-unit Causal Reasoning for Counterfactually Faithful Emotion Explanations14 Jun 2026
- 2026STATe-of-Thoughts: Structured Action Templates for Tree-of-Thoughts15 Feb 2026
- 2025Automatic Reviewers Fail to Detect Faulty Reasoning in Research Papers: A New Counterfactual Evaluation Framework29 Aug 2025
- 2023Causal reasoning in typical computer vision tasks26 Jul 2023
- 2022Post-hoc Concept Bottleneck Modelscited by 293
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2021Acquisition of Chess Knowledge in AlphaZerocited by 123
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 2021Counterfactual Generative Networkscited by 111
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 98
- 2021CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithmscited by 86
- 2021Leveraging Sparse Linear Layers for Debuggable Deep Networkscited by 82
- 2022Concept Bottleneck Model with Additional Unsupervised Conceptscited by 79
- 2021Editing a classifier by rewriting its prediction rulescited by 65
- 2022CEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model Behaviorcited by 55
12 most cited of 127 All 127 (JSON)
- 2026Decomposition of Evidence, Contradiction, and Fragility in Perturbation Responses13 Aug 2026
- 2026Local Label-Informed Feature Transfer for Generating Ground-Truth Medical Images: A Comparison of GAN- and Diffusion-Based Approaches21 Jul 2026
- 2026ConceptCF: Concept-based Counterfactuals for the Explainability of Time Series21 Jul 2026
- 2026TRACE: A Concept Bottleneck Model for Longitudinal 3D Glioblastoma Response Assessment29 Jun 2026
- 2026Position: Explainable AI is Causality in Disguise30 Mar 2026
- 2026CVGL: Causal Learning and Geometric Topology13 Mar 2026
- 2026CLEAR-HPV: Interpretable concept discovery for human-papillomavirus-associated morphology in whole-slide histology4 Feb 2026
- 2026Interpreting and Controlling Model Behavior via Constitutions for Atomic Concept Edits23 Jan 2026
- 2026Explainable AI to Improve Machine Learning Reliability for Industrial Cyber-Physical Systems22 Jan 2026
- 2026LIBERTy: A Causal Framework for Benchmarking Concept-Based Explanations of LLMs with Structural Counterfactuals15 Jan 2026
- 2025CAuSE: Decoding Multimodal Classifiers using Faithful Natural Language Explanation7 Dec 2025
- 2025Exploring and Leveraging Class Vectors for Classifier Editing13 Oct 2025
12 newest of 127 All 127 (JSON)