Explainable Neural Networks based on Additive Index Models
Not on the map. Why?
Abstract (arXiv)
Machine Learning algorithms are increasingly being used in recent years due to their flexibility in model fitting and increased predictive performance. However, the complexity of the models makes them hard for the data analyst to interpret the results and explain them without additional tools. This has led to much research in developing various approaches to understand the model behavior. In this paper, we present the Explainable Neural Network (xNN), a structured neural network designed especially to learn interpretable features. Unlike fully connected neural networks, the features engineered by the xNN can be extracted from the network in a relatively straightforward manner and the results displayed. With appropriate regularization, the xNN provides a parsimonious explanation of the relationship between the features and the output. We illustrate this interpretable feature--engineering property on simulated examples.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 7; 2023: 7; 2024: 6; 2025: 4; 2026: 1.
33 papers.
Sort:
- 2021How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanationscited by 58
- 2021Defining and Quantifying the Emergence of Sparse Concepts in DNNscited by 36
- 2023Does a Neural Network Really Encode Symbolic Concepts?cited by 27
- 2023Explainable, Interpretable & Trustworthy AI for Intelligent Digital Twin: Case Study on Remaining Useful Lifecited by 19
- 2021Model Explainability in Deep Learning Based Natural Language Processingcited by 14
- 2021LocalGLMnet: interpretable deep learning for tabular datacited by 14
- 2024Towards the Dynamics of a DNN Learning Symbolic Interactionscited by 13
- 2022A Survey of Neural Treescited by 7
- 2022GAM(e) changer or not? An evaluation of interpretable machine learning models based on additive model constraintscited by 6
- 2023Interpretable Machine Learning based on Functional ANOVA Framework: Algorithms and Comparisonscited by 4
- 2021Bias, Fairness, and Accountability with AI and ML Algorithmscited by 3
- 2022Using Model-Based Trees with Boosting to Fit Low-Order Functional ANOVA Modelscited by 3
21 more
- 2023On marginal feature attributions of tree-based modelscited by 3
- 2025FAME: Introducing Fuzzy Additive Models for Explainable AIcited by 3
- 2023Approximation of group explainers with coalition structure using Monte Carlo sampling on the product space of coalitions and featurescited by 2
- 2024An AI Architecture with the Capability to Explain Recognition Resultscited by 2
- 2024Improving Network Interpretability via Explanation Consistency Evaluationcited by 2
- 2024Less Discriminatory Alternative and Interpretable XGBoost Framework for Binary Classificationcited by 2
- 2021Towards interpreting ML-based automated malware detection models: a surveycited by 1
- 2023Monotone Tree-Based GAMI Models by Adapting XGBoostcited by 1
- 2024Are Logistic Models Really Interpretable?cited by 1
- 2024An AI Architecture with the Capability to Classify and Explain Hardware Trojanscited by 1
- 2021Neural Networks and Denotationcited by 0
- 2021Linear Iterative Feature Embedding: An Ensemble Framework for Interpretable Modelcited by 0
- 2022Semantic interpretation for convolutional neural networks: What makes a cat a cat?cited by 0
- 2022Interpretable Feature Engineering for Time Series Predictors using Attention Networkscited by 0
- 2022Deep Explainable Learning with Graph Based Data Assessing and Rule Reasoningcited by 0
- 2022Rethinking Log Odds: Linear Probability Modelling and Expert Advice in Interpretable Machine Learningcited by 0
- 2023On the explainability of quantum neural networks based on variational quantum circuitscited by 0
- 2025Sparse Deep Additive Model with Interactions: Enhancing Interpretability and Predictabilitycited by 0
- 2025Onto-Epistemological Analysis of AI Explanationscited by 0
- 2025When, How Long and How Much? Interpretable Neural Networks for Time Series Regression by Learning to Mask and Aggregatecited by 0
- 2026Explainability Methods for Hardware Trojan Detection: A Systematic Comparisoncited by 0
- 2026Explainability Methods for Hardware Trojan Detection: A Systematic Comparison26 Jan 2026
- 2025When, How Long and How Much? Interpretable Neural Networks for Time Series Regression by Learning to Mask and Aggregate3 Dec 2025
- 2025Onto-Epistemological Analysis of AI Explanations3 Oct 2025
- 2025Sparse Deep Additive Model with Interactions: Enhancing Interpretability and Predictability27 Sep 2025
- 2025FAME: Introducing Fuzzy Additive Models for Explainable AI9 Apr 2025
- 2024Less Discriminatory Alternative and Interpretable XGBoost Framework for Binary Classification24 Oct 2024
- 2024Improving Network Interpretability via Explanation Consistency Evaluation8 Aug 2024
- 2024Towards the Dynamics of a DNN Learning Symbolic Interactions27 Jul 2024
- 2024An AI Architecture with the Capability to Classify and Explain Hardware Trojans5 Jul 2024
- 2024Are Logistic Models Really Interpretable?19 Jun 2024
- 2024An AI Architecture with the Capability to Explain Recognition Results13 Jun 2024
- 2023Monotone Tree-Based GAMI Models by Adapting XGBoost5 Sep 2023
21 more
- 2023Interpretable Machine Learning based on Functional ANOVA Framework: Algorithms and Comparisons25 May 2023
- 2023Approximation of group explainers with coalition structure using Monte Carlo sampling on the product space of coalitions and features17 Mar 2023
- 2023Does a Neural Network Really Encode Symbolic Concepts?25 Feb 2023
- 2023On marginal feature attributions of tree-based models16 Feb 2023
- 2023Explainable, Interpretable & Trustworthy AI for Intelligent Digital Twin: Case Study on Remaining Useful Life17 Jan 2023
- 2023On the explainability of quantum neural networks based on variational quantum circuits12 Jan 2023
- 2022Rethinking Log Odds: Linear Probability Modelling and Expert Advice in Interpretable Machine Learning11 Nov 2022
- 2022Deep Explainable Learning with Graph Based Data Assessing and Rule Reasoning9 Nov 2022
- 2022A Survey of Neural Trees7 Sep 2022
- 2022Using Model-Based Trees with Boosting to Fit Low-Order Functional ANOVA Models14 Jul 2022
- 2022Interpretable Feature Engineering for Time Series Predictors using Attention Networks23 May 2022
- 2022GAM(e) changer or not? An evaluation of interpretable machine learning models based on additive model constraints19 Apr 2022
- 2022Semantic interpretation for convolutional neural networks: What makes a cat a cat?16 Apr 2022
- 2021Defining and Quantifying the Emergence of Sparse Concepts in DNNs11 Nov 2021
- 2021LocalGLMnet: interpretable deep learning for tabular data23 Jul 2021
- 2021Model Explainability in Deep Learning Based Natural Language Processing14 Jun 2021
- 2021Bias, Fairness, and Accountability with AI and ML Algorithms13 May 2021
- 2021Linear Iterative Feature Embedding: An Ensemble Framework for Interpretable Model18 Mar 2021
- 2021Neural Networks and Denotation15 Mar 2021
- 2021How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanations21 Jan 2021
- 2021Towards interpreting ML-based automated malware detection models: a survey15 Jan 2021
- 2021How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanationscited by 58
- 2021Defining and Quantifying the Emergence of Sparse Concepts in DNNscited by 36
- 2023Does a Neural Network Really Encode Symbolic Concepts?cited by 27
- 2023Explainable, Interpretable & Trustworthy AI for Intelligent Digital Twin: Case Study on Remaining Useful Lifecited by 19
- 2021Model Explainability in Deep Learning Based Natural Language Processingcited by 14
- 2021LocalGLMnet: interpretable deep learning for tabular datacited by 14
- 2024Towards the Dynamics of a DNN Learning Symbolic Interactionscited by 13
- 2022A Survey of Neural Treescited by 7
- 2022GAM(e) changer or not? An evaluation of interpretable machine learning models based on additive model constraintscited by 6
- 2023Interpretable Machine Learning based on Functional ANOVA Framework: Algorithms and Comparisonscited by 4
- 2021Bias, Fairness, and Accountability with AI and ML Algorithmscited by 3
- 2022Using Model-Based Trees with Boosting to Fit Low-Order Functional ANOVA Modelscited by 3
12 most cited of 33 All 33 (JSON)
- 2026Explainability Methods for Hardware Trojan Detection: A Systematic Comparison26 Jan 2026
- 2025When, How Long and How Much? Interpretable Neural Networks for Time Series Regression by Learning to Mask and Aggregate3 Dec 2025
- 2025Onto-Epistemological Analysis of AI Explanations3 Oct 2025
- 2025Sparse Deep Additive Model with Interactions: Enhancing Interpretability and Predictability27 Sep 2025
- 2025FAME: Introducing Fuzzy Additive Models for Explainable AI9 Apr 2025
- 2024Less Discriminatory Alternative and Interpretable XGBoost Framework for Binary Classification24 Oct 2024
- 2024Improving Network Interpretability via Explanation Consistency Evaluation8 Aug 2024
- 2024Towards the Dynamics of a DNN Learning Symbolic Interactions27 Jul 2024
- 2024An AI Architecture with the Capability to Classify and Explain Hardware Trojans5 Jul 2024
- 2024Are Logistic Models Really Interpretable?19 Jun 2024
- 2024An AI Architecture with the Capability to Explain Recognition Results13 Jun 2024
- 2023Monotone Tree-Based GAMI Models by Adapting XGBoost5 Sep 2023
12 newest of 33 All 33 (JSON)