Unsupervised Causal Binary Concepts Discovery with VAE for Black-box Model Explanation
Not on the map. Why?
Abstract (arXiv)
We aim to explain a black-box classifier with the form: `data X is classified as class Y because X textithas A, B and textitdoes not have C' in which A, B, and C are high-level concepts. The challenge is that we have to discover in an unsupervised manner a set of concepts, i.e., A, B and C, that is useful for the explaining the classifier. We first introduce a structural generative model that is suitable to express and discover such concepts. We then propose a learning process that simultaneously learns the data distribution and encourages certain concepts to have a large causal influence on the classifier output. Our method also allows easy integration of user's prior knowledge to induce high interpretability of concepts. Using multiple datasets, we demonstrate that our method can discover useful binary concepts for explanation.
Key facts. Cited by 8 papers in the map (data through 13 Oct 2026). Builds on 23 of its 39 references that are in the map. First posted on arXiv 9 Sep 2021.
Builds on
23 of 39 references.
References · 23
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,713
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,328
- 2013Auto-Encoding Variational Bayescited by 4,024
- 2017Axiomatic Attribution for Deep Networkscited by 3,368
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,316
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,142
- 2014Striving for Simplicity: The All Convolutional Netcited by 989
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 934
- 2018Understanding disentangling in β-VAEcited by 334
- 2018Explanations based on the Missing: Towards Contrastive Explanations with Pertinent Negativescited by 262
- 2019On Completeness-aware Concept-Based Explanations in Deep Neural Networkscited by 239
- 2017CausalGAN: Learning Causal Implicit Generative Models with Adversarial Trainingcited by 152
11 more
- 2019Explaining Classifiers with Causal Concept Effect (CaCE)cited by 135
- 2019Towards Realistic Individual Recourse and Actionable Explanations in Black-Box Decision Making Systemscited by 130
- 2019CXPlain: Causal Explanations for Model Interpretation under Uncertaintycited by 98
- 2020Generative causal explanations of black-box classifierscited by 41
- 2018Explaining Deep Learning Models using Causal Inferencecited by 18
- 2019Explaining Visual Models by Causal Attributioncited by 18
- 2021Benchmarks, Algorithms, and Metrics for Hierarchical Disentanglementcited by 12
- 2019Learning Interpretable Models with Causal Guaranteescited by 11
- 2020PatchVAE: Learning Local Latent Codes for Recognitioncited by 10
- 2020Discond-VAE: Disentangling Continuous Factors from the Discretecited by 4
- 2019Improving Disentangled Representation Learning with the Beta Bernoulli Processcited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 2; 2025: 0; 2026: 1.
8 papers.
- 2023Causal Reinforcement Learning: A Surveycited by 22
- 2022ECLAD: Extracting Concepts with Local Aggregated Descriptorscited by 15
- 2022Deep Causal Learning: Representation, Discovery and Inferencecited by 11
- 2024A survey on Concept-based Approaches For Model Improvementcited by 8
- 2023Statistically Significant Concept-based Explanation of Image Classifiers via Model Knockoffscited by 4
- 2023SurroCBM: Concept Bottleneck Surrogate Models for Generative Post-hoc Explanationcited by 2
- 2024LatentExplainer: Explaining Latent Representations in Deep Generative Models with Multimodal Large Language Modelscited by 1
- 2026Towards Verified and Targeted Explanations through Formal Methodscited by 0
- 2026Towards Verified and Targeted Explanations through Formal Methods5 Apr 2026
- 2024LatentExplainer: Explaining Latent Representations in Deep Generative Models with Multimodal Large Language Models21 Jun 2024
- 2024A survey on Concept-based Approaches For Model Improvement21 Mar 2024
- 2023SurroCBM: Concept Bottleneck Surrogate Models for Generative Post-hoc Explanation11 Oct 2023
- 2023Causal Reinforcement Learning: A Survey4 Jul 2023
- 2023Statistically Significant Concept-based Explanation of Image Classifiers via Model Knockoffs27 May 2023
- 2022Deep Causal Learning: Representation, Discovery and Inference7 Nov 2022
- 2022ECLAD: Extracting Concepts with Local Aggregated Descriptors9 Jun 2022