Towards Robust Interpretability with Self-Explaining Neural Networks
Not on the map. Why?
Abstract (arXiv)
Most recent work on interpretability of complex machine learning models has focused on estimating textita posteriori explanations for previously trained models around specific predictions. textitSelf-explaining models where interpretability plays a key role already during learning have received much less attention. We propose three desiderata for explanations in general -- explicitness, faithfulness, and stability -- and show that existing methods do not satisfy them. In response, we design self-explaining models in stages, progressively generalizing linear classifiers to complex yet architecturally explicit models. Faithfulness and stability are enforced via regularization specifically tailored to such models. Experimental results across various benchmark datasets show that our framework offers a promising direction for reconciling model complexity and interpretability.
Key facts. Cited by 505 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 91; 2022: 93; 2023: 90; 2024: 102; 2025: 78; 2026: 51.
505 papers.
Sort:
By area:
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 246
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2022Towards Faithful Model Explanation in NLP: A Surveycited by 129
- 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processingcited by 126
- 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 126
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2021Acquisition of Chess Knowledge in AlphaZerocited by 120
- 2023Probabilistic Concept Bottleneck Modelscited by 101
38 more
- 2021Interpretable Image Classification with Differentiable Prototypes Assignmentcited by 97
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 97
- 2021CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithmscited by 85
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2021Few-Shot Self-Rationalization with Natural Language Promptscited by 83
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2022Concept Bottleneck Model with Additional Unsupervised Conceptscited by 79
- 2022Diffusion Models for Counterfactual Explanationscited by 79
- 2021Towards Self-Explainable Graph Neural Networkcited by 75
- 2022GlanceNets: Interpretabile, Leak-proof Concept-based Modelscited by 73
- 2023Evaluating Large Language Models on Controlled Generation Taskscited by 73
- 2021XProtoNet: Diagnosis in Chest Radiography with Global and Local Explanationscited by 72
- 2023Discover and Cure: Concept-aware Mitigation of Spurious Correlationcited by 71
- 2024VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidancecited by 65
- 2023A Closer Look at the Intervention Procedure of Concept Bottleneck Modelscited by 63
- 2022Concept Embedding Models: Beyond the Accuracy-Explainability Trade-Offcited by 61
- 2021Synthetic Benchmarks for Scientific Research in Explainable Machine Learningcited by 59
- 2022Visual Recognition with Deep Nearest Centroidscited by 59
- 2021How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanationscited by 58
- 2022Concept Activation Regions: A Generalized Framework For Concept-Based Explanationscited by 57
- 2021Convolutional Dynamic Alignment Networks for Interpretable Classificationscited by 54
- 2022Concept-level Debugging of Part-Prototype Networkscited by 52
- 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 52
- 2021Entropy-based Logic Explanations of Neural Networkscited by 51
- 2023Learning Bottleneck Concepts in Image Classificationcited by 49
- 2023FunnyBirds: A Synthetic Vision Dataset for a Part-Based Analysis of Explainable AI Methodscited by 49
- 2023Adversarial attacks and defenses in explainable artificial intelligence: A surveycited by 47
- 2021A Framework for Learning Ante-hoc Explainable Models via Conceptscited by 45
- 2021Interpretable Models for Granger Causality Using Self-explaining Neural Networkscited by 44
- 2021SelfExplain: A Self-Explaining Architecture for Neural Text Classifierscited by 44
- 2021This looks more like that: Enhancing Self-Explaining Models by Prototypical Relevance Propagationcited by 43
- 2023Causal Discovery from Temporal Data: An Overview and New Perspectivescited by 43
- 2021Evaluating Robustness of Counterfactual Explanationscited by 41
- 2021Shapley Explanation Networkscited by 41
- 2023Learning to Receive Help: Intervention-Aware Concept Embedding Modelscited by 41
- 2021Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Aheadcited by 40
- 2022Fairness via Explanation Quality: Evaluating Disparities in the Quality of Post hoc Explanationscited by 40
- 2022Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AIcited by 40
50 most cited of 505 All 505 (JSON)
- 2026Learnable Time-Frequency Masks for Explaining Time-Series Classifiers24 Sep 2026
- 2026From Interpretability Methods to Interpretable Models4 Sep 2026
- 2026Transfiver: Human-AI Co-Inference through a Shared Editable State3 Sep 2026
- 2026Explainable Artificial Intelligence (XAI) in Computational Pathology: Definitions, Taxonomy, and Recommendations28 Aug 2026
- 2026Graphical Design of Interpretable Architectures19 Aug 2026
- 2026Can Neural Networks Learn by Experimenting on Themselves? Self-Interventional Learning from Functional Consequences to Predictive Self-Knowledge14 Aug 2026
- 2026Measuring Explainer Stability via Attribution Separability3 Aug 2026
- 2026Does Explainability Transfer? A Controlled Benchmark of Attribution Methods on Vision Transformers and CNNs3 Aug 2026
- 2026qZACH-ViT: Quantization-Aware Intrinsic Explanations with Recursive Attribution-Stabilized Optimization16 Jul 2026
- 2026Counterfactual Optimal Action Trees (COAT): Interpretable Prescriptive Policies from Observational Data15 Jul 2026
- 2026Training, Reading, and Editing Legible Transformers9 Jul 2026
- 2026Explainable Control Framework (XCF) based on Fuzzy Model-Agnostic Explanation and LLM Agent-Supported Interface24 Jun 2026
38 more
- 2026Input-Dependent Fisher Information for Local Sensitivity Analysis of Medical Image Classifiers15 Jun 2026
- 2026In Defense of Information Leakage in Concept-based Models9 Jun 2026
- 2026Evaluating Local Explainability Metrics for Machine Learning Models on Tabular Data26 May 2026
- 2026Investigating Concept Alignment Using Implausible Category Members20 May 2026
- 2026Learning Quantifiable Visual Explanations Without Ground-Truth18 May 2026
- 2026GCE-MIL: Faithful and Recoverable Evidence for Multiple Instance Learning in Whole-Slide Imaging17 May 2026
- 2026α-TCAV: A Unified Framework for Testing with Concept Activation Vectors15 May 2026
- 2026GESD: Beyond Outcome-Oriented Fairness14 May 2026
- 2026Multi-Dimensional Model Integrity and Responsibility Assessment Index and Scoring Framework14 May 2026
- 2026From Local to Global to Mechanistic: An iERF-Centered Unified Framework for Interpreting Vision Models1 May 2026
- 2026Towards Intrinsic Interpretability of Large Language Models:A Survey of Design Principles and Architectures17 Apr 2026
- 2026Expert-Guided Class-Conditional Goodness-of-Fit Scores for Interpretable Classification with Informative Missingness: An Application to Seismic Monitoring16 Apr 2026
- 2026Robust Explanations for User Trust in Enterprise NLP Systems13 Apr 2026
- 2026DINO-QPM: Adapting Visual Foundation Models for Globally Interpretable Image Classification8 Apr 2026
- 2026Post-hoc Self-explanation of CNNs30 Mar 2026
- 2026First-Mover Bias in Gradient Boosting Explanations: Mechanism, Detection, and Resolution22 Mar 2026
- 2026Does AI See like Art Historians? Interpreting How Vision Language Models Recognize Artistic Style11 Mar 2026
- 2026This Looks Distinctly Like That: Grounding Interpretable Recognition in Stiefel Geometry against Neural Collapse9 Mar 2026
- 2026SCAN: Visual Explanations with Self-Confidence and Analysis Networks4 Mar 2026
- 2026Hierarchical Concept-based Interpretable Models27 Feb 2026
- 2026Behavior Learning (BL): Learning Hierarchical Optimization Structures from Data23 Feb 2026
- 2026Unifying Formal Explanations: A Complexity-Theoretic Perspective20 Feb 2026
- 2026Provably Explaining Neural Additive Models19 Feb 2026
- 2026EXCODER: EXplainable Classification Of DiscretE time series Representations13 Feb 2026
- 2026Power Interpretable Causal ODE Networks: A Unified Model for Explainable Anomaly Detection and Root Cause Analysis in Power Systems13 Feb 2026
- 2026Hierarchical Concept Embedding & Pursuit for Interpretable Image Classification11 Feb 2026
- 2026Structurally Separated Uncertainty in Supervised Latent Variable Models11 Feb 2026
- 2026OmniSapiens: A Foundation Model for Social Behavior Processing via Heterogeneity-Aware Relative Policy Optimization11 Feb 2026
- 2026ECG-IMN: Interpretable Mesomorphic Neural Networks for 12-Lead Electrocardiogram Interpretation10 Feb 2026
- 2026Efficient Representations are Controllable Representations8 Feb 2026
- 2026From Features to Actions: Explainability in Traditional and Agentic AI Systems6 Feb 2026
- 2026How Understanding Forecast Uncertainty Resolves the Explainability Problem in Machine Learning Models30 Jan 2026
- 2026ConceptACT: Episode-Level Concepts for Sample-Efficient Robotic Imitation Learning23 Jan 2026
- 2026Actionable Interpretability Must Be Defined in Terms of Symmetries19 Jan 2026
- 2026TimeSAE: Causal Sparse Decoding for Faithful Explanations of Black-Box Time Series Models14 Jan 2026
- 2026Reasoning Stabilization Point: A Training-Time Signal for Stable Evidence and Shortcut Reliance12 Jan 2026
- 2026The Normalized Difference Layer: A Differentiable Spectral Index Formulation for Deep Learning11 Jan 2026
- 2026Aligned explanations in neural networks7 Jan 2026
50 newest of 505 All 505 (JSON)
- 2024Neural Concept Bindercited by 14
- 2025ILLC: Iterative Layer-by-Layer Compression for Enhancing Structural Faithfulness in SpArXcited by 0
- 2025Transparent Visual Reasoning via Object-Centric Agent Collaborationcited by 0
- 2026Reasoning Stabilization Point: A Training-Time Signal for Stable Evidence and Shortcut Reliancecited by 0
- 2026Reasoning Stabilization Point: A Training-Time Signal for Stable Evidence and Shortcut Reliance12 Jan 2026
- 2025Transparent Visual Reasoning via Object-Centric Agent Collaboration28 Sep 2025
- 2025ILLC: Iterative Layer-by-Layer Compression for Enhancing Structural Faithfulness in SpArX5 Mar 2025
- 2024Neural Concept Binder14 Jun 2024
- 2022Diffusion Models for Counterfactual Explanationscited by 79
- 2022Diffusion Models for Counterfactual Explanations29 Mar 2022
- 2024Unlearning-based Neural Interpretationscited by 0
- 2024Unlearning-based Neural Interpretations10 Oct 2024
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 489
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 246
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2022Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations and Beyondcited by 171
- 2021Benchmarking and Survey of Explanation Methods for Black Box Modelscited by 136
- 2022Towards Faithful Model Explanation in NLP: A Surveycited by 129
- 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processingcited by 126
- 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 126
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2021Acquisition of Chess Knowledge in AlphaZerocited by 120
- 2023Probabilistic Concept Bottleneck Modelscited by 101
12 most cited of 490 All 490 (JSON)
- 2026Learnable Time-Frequency Masks for Explaining Time-Series Classifiers24 Sep 2026
- 2026From Interpretability Methods to Interpretable Models4 Sep 2026
- 2026Transfiver: Human-AI Co-Inference through a Shared Editable State3 Sep 2026
- 2026Explainable Artificial Intelligence (XAI) in Computational Pathology: Definitions, Taxonomy, and Recommendations28 Aug 2026
- 2026Graphical Design of Interpretable Architectures19 Aug 2026
- 2026Can Neural Networks Learn by Experimenting on Themselves? Self-Interventional Learning from Functional Consequences to Predictive Self-Knowledge14 Aug 2026
- 2026Measuring Explainer Stability via Attribution Separability3 Aug 2026
- 2026Does Explainability Transfer? A Controlled Benchmark of Attribution Methods on Vision Transformers and CNNs3 Aug 2026
- 2026qZACH-ViT: Quantization-Aware Intrinsic Explanations with Recursive Attribution-Stabilized Optimization16 Jul 2026
- 2026Counterfactual Optimal Action Trees (COAT): Interpretable Prescriptive Policies from Observational Data15 Jul 2026
- 2026Training, Reading, and Editing Legible Transformers9 Jul 2026
- 2026Explainable Control Framework (XCF) based on Fuzzy Model-Agnostic Explanation and LLM Agent-Supported Interface24 Jun 2026
12 newest of 490 All 490 (JSON)