Interpretable Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
This paper proposes a method to modify traditional convolutional neural networks (CNNs) into interpretable CNNs, in order to clarify knowledge representations in high conv-layers of CNNs. In an interpretable CNN, each filter in a high conv-layer represents a certain object part. We do not need any annotations of object parts or textures to supervise the learning process. Instead, the interpretable CNN automatically assigns each filter in a high conv-layer with an object part during the learning process. Our method can be applied to different types of CNNs with different structures. The clear knowledge representation in an interpretable CNN can help people understand the logics inside a CNN, i.e., based on which patterns the CNN makes the decision. Experiments showed that filters in an interpretable CNN were more semantically meaningful than those in traditional CNNs.
Key facts. Cited by 161 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 50; 2022: 43; 2023: 31; 2024: 21; 2025: 10; 2026: 6.
161 papers.
Sort:
By area:
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Thinking Like Transformerscited by 182
- 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 126
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 97
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2022Diffusion Models for Counterfactual Explanationscited by 79
- 2021Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needscited by 64
- 2022ProtoPFormer: Concentrating on Prototypical Parts in Vision Transformers for Interpretable Image Recognitioncited by 63
- 2021Synthetic Benchmarks for Scientific Research in Explainable Machine Learningcited by 59
38 more
- 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Surveycited by 52
- 2021Unveiling the Potential of Structure Preserving for Weakly Supervised Object Localizationcited by 46
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
- 2021This looks more like that: Enhancing Self-Explaining Models by Prototypical Relevance Propagationcited by 43
- 2021STEEX: Steering Counterfactual Explanations with Semanticscited by 40
- 2021HYDRA: Hypergradient Data Relevance Analysis for Interpreting Deep Neural Networkscited by 38
- 2022TopicFM: Robust and Interpretable Topic-Assisted Feature Matchingcited by 32
- 2021Towards Interpretable Deep Metric Learning with Structural Matchingcited by 30
- 2022OCTET: Object-aware Counterfactual Explanationscited by 28
- 2023Text-to-Image Models for Counterfactual Explanations: a Black-Box Approachcited by 28
- 2021Danish Fungi 2020 -- Not Just Another Image Recognition Datasetcited by 27
- 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Studycited by 24
- 2021Carrying out CNN Channel Pruning in a White Boxcited by 22
- 2022Gait Recognition in the Wild with Multi-hop Temporal Switchcited by 22
- 2021Improving Molecular Graph Neural Network Explainability with Orthonormalization and Induced Sparsitycited by 20
- 2021CX-ToM: Counterfactual Explanations with Theory-of-Mind for Enhancing Human Trust in Image Recognition Modelscited by 20
- 2022Concept Embedding Analysis: A Reviewcited by 20
- 2022Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection---Extended Versioncited by 19
- 2021A Game-Theoretic Taxonomy of Visual Concepts in DNNscited by 16
- 2021Interpretable Compositional Convolutional Neural Networkscited by 15
- 2021A Survey on Understanding, Visualizations, and Explanation of Deep Neural Networkscited by 14
- 2023Illuminati: Towards Explaining Graph Neural Networks for Cybersecurity Analysiscited by 14
- 2022Interventional Multi-Instance Learning with Deconfounded Instance-Level Predictioncited by 13
- 2022Sparsely-gated Mixture-of-Expert Layers for CNN Interpretabilitycited by 13
- 2023Explainability in AI Policies: A Critical Review of Communications, Reports, Regulations, and Standards in the EU, US, and UKcited by 13
- 2021Towards Interpretable Deep Networks for Monocular Depth Estimationcited by 12
- 2022Attributable Visual Similarity Learningcited by 12
- 2023Interpretability of Machine Learning: Recent Advances and Future Prospectscited by 12
- 2025MOL: Joint Estimation of Micro-Expression, Optical Flow, and Landmark via Transformer-Graph-Style Convolutioncited by 12
- 2021Comprehensible Convolutional Neural Networks via Guided Concept Learningcited by 11
- 2021An Overview of Human Activity Recognition Using Wearable Sensors: Healthcare and Artificial Intelligencecited by 11
- 2022Explaining Deep Convolutional Neural Networks via Latent Visual-Semantic Filter Attentioncited by 11
- 2023Evaluating the Stability of Semantic Concept Representations in CNNs for Robust Explainabilitycited by 11
- 2021When and How to Fool Explainable Models (and Humans) with Adversarial Examplescited by 10
- 2023Interpretable and Robust AI in EEG Systems: A Surveycited by 10
- 2023TopicFM+: Boosting Accuracy and Efficiency of Topic-Assisted Feature Matchingcited by 10
- 2022ME-D2N: Multi-Expert Domain Decompositional Network for Cross-Domain Few-Shot Learningcited by 9
- 2023Q-SENN: Quantized Self-Explaining Neural Networkscited by 9
50 most cited of 161 All 161 (JSON)
- 2026Towards interpretable AI with quantum annealing feature selection28 Apr 2026
- 2026Jellyfish: Zero-Shot Federated Unlearning Scheme with Knowledge Disentanglement5 Apr 2026
- 2026Probabilistic Abstract Interpretation on Neural Networks via Grids Approximation26 Mar 2026
- 2026Rethinking the Harmonic Loss via Non-Euclidean Distance Layers10 Mar 2026
- 2026RACC: Representation-Aware Coverage Criteria for LLM Safety Testing2 Feb 2026
- 2026Explaining Machine Learning Predictive Models through Conditional Expectation Methods12 Jan 2026
- 2025LeCoT: revisiting network architecture for two-view correspondence pruning10 Nov 2025
- 2025NM-Hebb: Coupling Local Hebbian Plasticity with Metric Learning for More Accurate and Interpretable CNNs27 Aug 2025
- 2025Towards Optimal Convolutional Transfer Learning Architectures for Breast Lesion Classification and ACL Tear Detection25 Aug 2025
- 2025Towards White-Box Deep Wireless Sensing29 Jul 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025MOL: Joint Estimation of Micro-Expression, Optical Flow, and Landmark via Transformer-Graph-Style Convolution17 Jun 2025
38 more
- 2025ArchShapeNet:An Interpretable 3D-CNN Framework for Evaluating Architectural Shapes14 Jun 2025
- 2025Towards Better Generalization and Interpretability in Unsupervised Concept-Based Models2 Jun 2025
- 2025ReGA: Model-Based Safeguard for LLMs via Representation-Guided Abstraction2 Jun 2025
- 2025Capturing Semantic Flow of ML-based Systems13 Mar 2025
- 2024Explaining Model Overfitting in CNNs via GMM Clustering12 Dec 2024
- 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Survey3 Dec 2024
- 2024Learning Predictive Checklists with Probabilistic Logic Programming25 Nov 2024
- 2024GIFT: A Framework Towards Global Interpretable Faithful Textual Explanations of Vision Classifiers23 Nov 2024
- 2024Adapting Visualization Techniques for Time-Series Anomaly Detection: From Convolutional Neural Networks to Convolutional-Recurrent Neural Networks7 Nov 2024
- 2024EMWaveNet: Physically Explainable Neural Network Based on Electromagnetic Propagation for SAR Target Recognition13 Oct 2024
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction30 Aug 2024
- 2024Interpretable breast cancer classification using CNNs on mammographic images23 Aug 2024
- 2024Improving Network Interpretability via Explanation Consistency Evaluation8 Aug 2024
- 2024META-ANOVA: Screening interactions for interpretable machine learning2 Aug 2024
- 2024Restyling Unsupervised Concept Based Interpretable Networks with Generative Models1 Jul 2024
- 2024Enabling Regional Explainability by Automatic and Model-agnostic Rule Extraction25 Jun 2024
- 2024ConceptHash: Interpretable Fine-Grained Hashing via Concept Discovery12 Jun 2024
- 2024Length-scale study in deep learning prediction for non-small cell lung cancer brain metastasis1 Jun 2024
- 2024Post-hoc and manifold explanations analysis of facial expression data based on deep learning29 Apr 2024
- 2024Towards Explaining Hypercomplex Neural Networks26 Mar 2024
- 2024SIMAP: A simplicial-map layer for neural networks22 Mar 2024
- 2024HOLMES: HOLonym-MEronym based Semantic inspection for Convolutional Image Classifiers13 Mar 2024
- 2024Neural Additive Image Model: Interpretation through Interpolation6 Mar 2024
- 2024Path Choice Matters for Clear Attribution in Path Methods19 Jan 2024
- 2024Model-Agnostic Interpretation Framework in Machine Learning: A Comparative Study in NBA Sports5 Jan 2024
- 2023Q-SENN: Quantized Self-Explaining Neural Networks21 Dec 2023
- 2023Concept-based Explainable Artificial Intelligence: A Survey20 Dec 2023
- 2023Model-agnostic Body Part Relevance Assessment for Pedestrian Detection27 Nov 2023
- 2023Interpretable A-posteriori Error Indication for Graph Neural Network Surrogate Models13 Nov 2023
- 2023Explainable AI for Earth Observation: Current Methods, Open Challenges, and Opportunities8 Nov 2023
- 2023Automated Natural Language Explanation of Deep Visual Neurons with Large Models16 Oct 2023
- 2023Learning Transferable Conceptual Prototypes for Interpretable Unsupervised Domain Adaptation12 Oct 2023
- 2023Interpretability-Aware Vision Transformer14 Sep 2023
- 2023Text-to-Image Models for Counterfactual Explanations: a Black-Box Approach14 Sep 2023
- 2023A Strong and Simple Deep Learning Baseline for BCI MI Decoding11 Sep 2023
- 2023Disentanglement Learning via Topology24 Aug 2023
- 2023Improving Generalization of Image Captioning with Unsupervised Prompt Learning5 Aug 2023
- 2023TbExplain: A Text-based Explanation Method for Scene Classification Models with the Statistical Prediction Correction19 Jul 2023
50 newest of 161 All 161 (JSON)
- 2022Diffusion Models for Counterfactual Explanationscited by 79
- 2022Diffusion Models for Counterfactual Explanations29 Mar 2022
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Thinking Like Transformerscited by 182
- 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 126
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 97
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2021Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needscited by 64
- 2022ProtoPFormer: Concentrating on Prototypical Parts in Vision Transformers for Interpretable Image Recognitioncited by 63
- 2021Synthetic Benchmarks for Scientific Research in Explainable Machine Learningcited by 59
- 2021Unveiling the Potential of Structure Preserving for Weakly Supervised Object Localizationcited by 46
12 most cited of 153 All 153 (JSON)
- 2026Towards interpretable AI with quantum annealing feature selection28 Apr 2026
- 2026Probabilistic Abstract Interpretation on Neural Networks via Grids Approximation26 Mar 2026
- 2026Explaining Machine Learning Predictive Models through Conditional Expectation Methods12 Jan 2026
- 2025LeCoT: revisiting network architecture for two-view correspondence pruning10 Nov 2025
- 2025NM-Hebb: Coupling Local Hebbian Plasticity with Metric Learning for More Accurate and Interpretable CNNs27 Aug 2025
- 2025Towards Optimal Convolutional Transfer Learning Architectures for Breast Lesion Classification and ACL Tear Detection25 Aug 2025
- 2025Towards White-Box Deep Wireless Sensing29 Jul 2025
- 2025A Survey on Interpretability in Visual Recognition15 Jul 2025
- 2025MOL: Joint Estimation of Micro-Expression, Optical Flow, and Landmark via Transformer-Graph-Style Convolution17 Jun 2025
- 2025ArchShapeNet:An Interpretable 3D-CNN Framework for Evaluating Architectural Shapes14 Jun 2025
- 2025Towards Better Generalization and Interpretability in Unsupervised Concept-Based Models2 Jun 2025
- 2025Capturing Semantic Flow of ML-based Systems13 Mar 2025
12 newest of 153 All 153 (JSON)