A Framework for Learning Ante-hoc Explainable Models via Concepts
Not on the map. Why?
Abstract (arXiv)
Self-explaining deep models are designed to learn the latent concept-based explanations implicitly during training, which eliminates the requirement of any post-hoc explanation generation technique. In this work, we propose one such model that appends an explanation generation module on top of any basic network and jointly trains the whole module that shows high predictive performance and generates meaningful explanations in terms of concepts. Our training strategy is suitable for unsupervised concept learning with much lesser parameter space requirements compared to baseline methods. Our proposed model also has provision for leveraging self-supervision on concepts to extract better explanations. However, with full concept supervision, we achieve the best predictive performance compared to recently proposed concept-based explainable models. We report both qualitative and quantitative results with our method, which shows better performance than recently proposed concept-based explainability methods. We reported exhaustive results with two datasets without ground truth concepts, i.e., CIFAR10, ImageNet, and two datasets with ground truth concepts, i.e., AwA2, CUB-200, to show the effectiveness of our method for both cases. To the best of our knowledge, we are the first ante-hoc explanation generation method to show results with a large-scale dataset such as ImageNet.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 22 of its 38 references that are in the map. First posted on arXiv 25 Aug 2021.
Builds on
22 of 38 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2016Colorful Image Colorizationcited by 1,113
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
- 2020Concept Bottleneck Modelscited by 1,022
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
10 more
- 2016The Mythos of Model Interpretabilitycited by 716
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2019On Completeness-aware Concept-Based Explanations in Deep Neural Networkscited by 239
- 2020Concept Whitening for Interpretable Image Recognitioncited by 225
- 2016Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Predictioncited by 217
- 2018Learning Deep Disentangled Embeddings with the F-Statistic Losscited by 101
- 2020Now You See Me (CME): Concept-based Model Extractioncited by 51
- 2020Robust and Stable Black Box Explanationscited by 47
- 2020Self-Enhanced GNN: Improving Graph Neural Networks Using Model Outputscited by 11
Built on by
Citing papers per year: 2022: 2; 2023: 15; 2024: 16; 2025: 9; 2026: 3.
45 papers.
Sort:
By area:
- 2023Probabilistic Concept Bottleneck Modelscited by 101
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 97
- 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Predictioncited by 41
- 2023Auxiliary Losses for Learning Generalizable Concept-based Modelscited by 35
- 2024Energy-Based Concept Bottleneck Models: Unifying Prediction, Concept Intervention, and Probabilistic Interpretationscited by 33
- 2022Explainable Deep Learning Methods in Medical Image Classification: A Surveycited by 31
- 2023Coherent Concept-based Explanations in Medical Image and Its Application to Skin Lesion Diagnosiscited by 26
- 2023Variational Information Pursuit for Interpretable Predictionscited by 25
- 2024Visual Concept Connectome (VCC): Open World Concept Discovery and their Interlayer Connections in Deep Modelscited by 22
- 2024Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlookscited by 18
- 2024Concept-Attention Whitening for Interpretable Skin Lesion Diagnosiscited by 11
- 2023Dividing and Conquering a BlackBox to a Mixture of Interpretable Models: Route, Interpret, Repeatcited by 10
33 more
- 2024Evaluating Readability and Faithfulness of Concept-based Explanationscited by 10
- 2024A survey on Concept-based Approaches For Model Improvementcited by 8
- 20233VL: Using Trees to Improve Vision-Language Models' Interpretabilitycited by 7
- 2024A Survey of Explainable Knowledge Tracingcited by 7
- 2024EQ-CBM: A Probabilistic Concept Bottleneck with Energy-based Models and Quantized Vectorscited by 6
- 2024Towards Multi-dimensional Explanation Alignment for Medical Classificationcited by 6
- 2025Neural Probabilistic Circuits: Enabling Compositional and Interpretable Predictions through Logical Reasoningcited by 6
- 2025LogicCBMs: Logic-Enhanced Concept-Based Learningcited by 5
- 2023Img2Tab: Automatic Class Relevant Concept Discovery from StyleGAN Features for Explainable Image Classificationcited by 4
- 2023A Survey of Explainable AI in Deep Visual Modeling: Methods and Metricscited by 4
- 2023Statistically Significant Concept-based Explanation of Image Classifiers via Model Knockoffscited by 4
- 2023Survey on AI Ethics: A Socio-technical Perspectivecited by 4
- 2025A Comprehensive Survey on the Risks and Limitations of Concept-based Modelscited by 4
- 2022Explainable fetal ultrasound quality assessment with progressive concept bottleneck modelscited by 3
- 2023Towards credible visual model interpretation with path attributioncited by 3
- 2024A Self-explaining Neural Architecture for Generalizable Concept Learningcited by 3
- 2024Concept Complement Bottleneck Model for Interpretable Medical Image Diagnosiscited by 3
- 2025Stable Vision Concept Transformers for Medical Diagnosiscited by 3
- 2023Explainable AI for clinical risk prediction: a survey of concepts, methods, and modalitiescited by 2
- 2024Advancing Ante-Hoc Explainable Models through Generative Adversarial Networkscited by 2
- 2024Restyling Unsupervised Concept Based Interpretable Networks with Generative Modelscited by 2
- 2025A Survey on Interpretability in Visual Recognitioncited by 2
- 2025Enhancing Pre-trained Representation Classifiability can Boost its Interpretabilitycited by 2
- 2023Deephys: Deep Electrophysiology, Debugging Neural Networks under Distribution Shiftscited by 1
- 2023Streamlining models with explanations in the learning loopcited by 0
- 2024MulCPred: Learning Multi-modal Concepts for Explainable Pedestrian Action Predictioncited by 0
- 2024Sparse Prototype Network for Explainable Pedestrian Behavior Predictioncited by 0
- 2025Survival Concept-Based Learning Modelscited by 0
- 2025Uncertainty-Aware Information Pursuit for Interpretable and Reliable Medical Image Analysiscited by 0
- 2025Transparent Visual Reasoning via Object-Centric Agent Collaborationcited by 0
- 2026TimeSAE: Causal Sparse Decoding for Faithful Explanations of Black-Box Time Series Modelscited by 0
- 2026Formal Concept Lattices are Good Semantic Scaffolds for Concept-Based Learningcited by 0
- 2026Beyond Heatmaps: Unsupervised Concept-Graph Reasoning for Interpretable Visual Explanationcited by 0
- 2026Beyond Heatmaps: Unsupervised Concept-Graph Reasoning for Interpretable Visual Explanation1 Jul 2026
- 2026Formal Concept Lattices are Good Semantic Scaffolds for Concept-Based Learning3 Jun 2026
- 2026TimeSAE: Causal Sparse Decoding for Faithful Explanations of Black-Box Time Series Models14 Jan 2026
- 2025LogicCBMs: Logic-Enhanced Concept-Based Learning8 Dec 2025
- 2025Enhancing Pre-trained Representation Classifiability can Boost its Interpretability28 Oct 2025
- 2025Transparent Visual Reasoning via Object-Centric Agent Collaboration28 Sep 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025Uncertainty-Aware Information Pursuit for Interpretable and Reliable Medical Image Analysis20 Jun 2025
- 2025Stable Vision Concept Transformers for Medical Diagnosis5 Jun 2025
- 2025A Comprehensive Survey on the Risks and Limitations of Concept-based Models25 May 2025
- 2025Survival Concept-Based Learning Models9 Feb 2025
- 2025Neural Probabilistic Circuits: Enabling Compositional and Interpretable Predictions through Logical Reasoning13 Jan 2025
33 more
- 2024Towards Multi-dimensional Explanation Alignment for Medical Classification28 Oct 2024
- 2024Concept Complement Bottleneck Model for Interpretable Medical Image Diagnosis20 Oct 2024
- 2024Sparse Prototype Network for Explainable Pedestrian Behavior Prediction16 Oct 2024
- 2024Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks3 Oct 2024
- 2024EQ-CBM: A Probabilistic Concept Bottleneck with Energy-based Models and Quantized Vectors22 Sep 2024
- 2024MulCPred: Learning Multi-modal Concepts for Explainable Pedestrian Action Prediction14 Sep 2024
- 2024Restyling Unsupervised Concept Based Interpretable Networks with Generative Models1 Jul 2024
- 2024A Self-explaining Neural Architecture for Generalizable Concept Learning1 May 2024
- 2024Evaluating Readability and Faithfulness of Concept-based Explanations29 Apr 2024
- 2024Concept-Attention Whitening for Interpretable Skin Lesion Diagnosis9 Apr 2024
- 2024Visual Concept Connectome (VCC): Open World Concept Discovery and their Interlayer Connections in Deep Models2 Apr 2024
- 2024A survey on Concept-based Approaches For Model Improvement21 Mar 2024
- 2024A Survey of Explainable Knowledge Tracing12 Mar 2024
- 2024Energy-Based Concept Bottleneck Models: Unifying Prediction, Concept Intervention, and Probabilistic Interpretations25 Jan 2024
- 2024Advancing Ante-Hoc Explainable Models through Generative Adversarial Networks9 Jan 2024
- 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Prediction3 Jan 2024
- 20233VL: Using Trees to Improve Vision-Language Models' Interpretability28 Dec 2023
- 2023Concept-based Explainable Artificial Intelligence: A Survey20 Dec 2023
- 2023Survey on AI Ethics: A Socio-technical Perspective28 Nov 2023
- 2023Auxiliary Losses for Learning Generalizable Concept-based Models18 Nov 2023
- 2023Explainable AI for clinical risk prediction: a survey of concepts, methods, and modalities16 Aug 2023
- 2023Dividing and Conquering a BlackBox to a Mixture of Interpretable Models: Route, Interpret, Repeat7 Jul 2023
- 2023Probabilistic Concept Bottleneck Models2 Jun 2023
- 2023Statistically Significant Concept-based Explanation of Image Classifiers via Model Knockoffs27 May 2023
- 2023Towards credible visual model interpretation with path attribution23 May 2023
- 2023Coherent Concept-based Explanations in Medical Image and Its Application to Skin Lesion Diagnosis10 Apr 2023
- 2023Deephys: Deep Electrophysiology, Debugging Neural Networks under Distribution Shifts17 Mar 2023
- 2023Streamlining models with explanations in the learning loop15 Feb 2023
- 2023Variational Information Pursuit for Interpretable Predictions6 Feb 2023
- 2023A Survey of Explainable AI in Deep Visual Modeling: Methods and Metrics31 Jan 2023
- 2023Img2Tab: Automatic Class Relevant Concept Discovery from StyleGAN Features for Explainable Image Classification16 Jan 2023
- 2022Explainable fetal ultrasound quality assessment with progressive concept bottleneck models19 Nov 2022
- 2022Explainable Deep Learning Methods in Medical Image Classification: A Survey10 May 2022
- 2023Probabilistic Concept Bottleneck Modelscited by 101
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 97
- 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Predictioncited by 41
- 2023Auxiliary Losses for Learning Generalizable Concept-based Modelscited by 35
- 2024Energy-Based Concept Bottleneck Models: Unifying Prediction, Concept Intervention, and Probabilistic Interpretationscited by 33
- 2022Explainable Deep Learning Methods in Medical Image Classification: A Surveycited by 31
- 2023Coherent Concept-based Explanations in Medical Image and Its Application to Skin Lesion Diagnosiscited by 26
- 2023Variational Information Pursuit for Interpretable Predictionscited by 25
- 2024Visual Concept Connectome (VCC): Open World Concept Discovery and their Interlayer Connections in Deep Modelscited by 22
- 2024Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlookscited by 18
- 2024Concept-Attention Whitening for Interpretable Skin Lesion Diagnosiscited by 11
- 2023Dividing and Conquering a BlackBox to a Mixture of Interpretable Models: Route, Interpret, Repeatcited by 10
12 most cited of 42 All 42 (JSON)
- 2026Beyond Heatmaps: Unsupervised Concept-Graph Reasoning for Interpretable Visual Explanation1 Jul 2026
- 2026Formal Concept Lattices are Good Semantic Scaffolds for Concept-Based Learning3 Jun 2026
- 2026TimeSAE: Causal Sparse Decoding for Faithful Explanations of Black-Box Time Series Models14 Jan 2026
- 2025LogicCBMs: Logic-Enhanced Concept-Based Learning8 Dec 2025
- 2025Enhancing Pre-trained Representation Classifiability can Boost its Interpretability28 Oct 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025Uncertainty-Aware Information Pursuit for Interpretable and Reliable Medical Image Analysis20 Jun 2025
- 2025Stable Vision Concept Transformers for Medical Diagnosis5 Jun 2025
- 2025A Comprehensive Survey on the Risks and Limitations of Concept-based Models25 May 2025
- 2025Survival Concept-Based Learning Models9 Feb 2025
- 2024Towards Multi-dimensional Explanation Alignment for Medical Classification28 Oct 2024
- 2024Concept Complement Bottleneck Model for Interpretable Medical Image Diagnosis20 Oct 2024
12 newest of 42 All 42 (JSON)