Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead
Not on the map. Why?
Abstract (arXiv)
Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creating methods for explaining these black box models will alleviate some of these problems, but trying to textitexplain black box models, rather than creating models that are textitinterpretable in the first place, is likely to perpetuate bad practices and can potentially cause catastrophic harm to society. There is a way forward -- it is to design models that are inherently interpretable. This manuscript clarifies the chasm between explaining black boxes and using inherently interpretable models, outlines several key reasons why explainable black boxes should be avoided in high-stakes decisions, identifies challenges to interpretable machine learning, and provides several example applications where interpretable models could potentially replace black box models in criminal justice, healthcare, and computer vision.
Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 9; 2023: 8; 2024: 11; 2025: 2; 2026: 1.
40 papers.
Sort:
By area:
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 126
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 51
- 2022Augmenting Interpretable Models with LLMs during Trainingcited by 38
- 2021Local Interpretations for Explainable Natural Language Processing: A Surveycited by 31
- 2023A Survey on Explainability of Graph Neural Networkscited by 29
- 2021Foundations of Symbolic Languages for Model Interpretabilitycited by 26
- 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMscited by 25
- 2024Bayesian Concept Bottleneck Models with LLM Priorscited by 17
- 2023CI-GNN: A Granger Causality-Inspired Graph Neural Network for Interpretable Brain Network-Based Psychiatric Diagnosiscited by 16
- 2022Diagnosing AI Explanation Methods with Folk Concepts of Behaviorcited by 15
- 2022Fast Interpretable Greedy-Tree Sumscited by 13
28 more
- 2025Simulating Society Requires Simulating Thoughtcited by 13
- 2024Towards Modeling Uncertainties of Self-explaining Neural Networks via Conformal Predictioncited by 10
- 2022Interpretation of Black Box NLP Models: A Surveycited by 9
- 2022Provable concept learning for interpretable predictions using variational autoencoderscited by 9
- 2021Developing a Fidelity Evaluation Approach for Interpretable Machine Learningcited by 8
- 2022Automated Learning of Interpretable Models with Quantified Uncertaintycited by 8
- 2021Bridging Breiman's Brook: From Algorithmic Modeling to Statistical Learningcited by 7
- 2022Higher-order Neural Additive Models: An Interpretable Machine Learning Model with Feature Interactionscited by 7
- 2024Learning a Decision Tree Algorithm with Transformerscited by 6
- 2023Less is More: The Influence of Pruning on the Explainability of CNNscited by 5
- 2023The Blame Problem in Evaluating Local Explanations, and How to Tackle itcited by 5
- 2022"Explanation" is Not a Technical Term: The Problem of Ambiguity in XAIcited by 4
- 2024Semantic Objective Functions: A distribution-aware method for adding logical constraints in deep learningcited by 4
- 2024Towards Few-shot Self-explaining Graph Neural Networkscited by 4
- 2024Learning accurate and interpretable tree-based modelscited by 3
- 2021Towards Trustworthy Deception Detection: Benchmarking Model Robustness across Domains, Modalities, and Languagescited by 2
- 2022Analogies and Feature Attributions for Model Agnostic Explanation of Similarity Learnerscited by 2
- 2023Topological Interpretability for Deep-Learningcited by 2
- 2024Transparent Networks for Multivariate Time Seriescited by 2
- 2021Interpreting and improving deep-learning models with reality checkscited by 1
- 2021Combining Transformers with Natural Language Explanationscited by 1
- 2023Finding the Needle in a Haystack: Unsupervised Rationale Extraction from Long Text Classifierscited by 1
- 2024Comparative Analysis of Black-Box and White-Box Machine Learning Model in Phishing Detectioncited by 1
- 2026Agentic-imodels: Evolving agentic interpretability tools via autoresearchcited by 1
- 2023BELLA: Black box model Explanations by Local Linear Approximationscited by 0
- 2023Having Second Thoughts? Let's hear itcited by 0
- 2024Searching for internal symbols underlying deep learningcited by 0
- 2025Efficient and Interpretable Neural Networks Using Complex Lehmer Transformcited by 0
- 2026Agentic-imodels: Evolving agentic interpretability tools via autoresearch5 May 2026
- 2025Simulating Society Requires Simulating Thought8 Jun 2025
- 2025Efficient and Interpretable Neural Networks Using Complex Lehmer Transform25 Jan 2025
- 2024Comparative Analysis of Black-Box and White-Box Machine Learning Model in Phishing Detection3 Dec 2024
- 2024Bayesian Concept Bottleneck Models with LLM Priors21 Oct 2024
- 2024Transparent Networks for Multivariate Time Series14 Oct 2024
- 2024Towards Few-shot Self-explaining Graph Neural Networks14 Aug 2024
- 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMs27 Jul 2024
- 2024Searching for internal symbols underlying deep learning31 May 2024
- 2024Learning accurate and interpretable tree-based models24 May 2024
- 2024Semantic Objective Functions: A distribution-aware method for adding logical constraints in deep learning3 May 2024
- 2024Learning a Decision Tree Algorithm with Transformers6 Feb 2024
28 more
- 2024Black-Box Access is Insufficient for Rigorous AI Audits25 Jan 2024
- 2024Towards Modeling Uncertainties of Self-explaining Neural Networks via Conformal Prediction3 Jan 2024
- 2023Having Second Thoughts? Let's hear it26 Nov 2023
- 2023The Blame Problem in Evaluating Local Explanations, and How to Tackle it5 Oct 2023
- 2023A Survey on Explainability of Graph Neural Networks2 Jun 2023
- 2023BELLA: Black box model Explanations by Local Linear Approximations18 May 2023
- 2023Topological Interpretability for Deep-Learning15 May 2023
- 2023Finding the Needle in a Haystack: Unsupervised Rationale Extraction from Long Text Classifiers14 Mar 2023
- 2023Less is More: The Influence of Pruning on the Explainability of CNNs17 Feb 2023
- 2023CI-GNN: A Granger Causality-Inspired Graph Neural Network for Interpretable Brain Network-Based Psychiatric Diagnosis4 Jan 2023
- 2022Higher-order Neural Additive Models: An Interpretable Machine Learning Model with Feature Interactions30 Sep 2022
- 2022Augmenting Interpretable Models with LLMs during Training23 Sep 2022
- 2022"Explanation" is Not a Technical Term: The Problem of Ambiguity in XAI27 Jun 2022
- 2022Automated Learning of Interpretable Models with Quantified Uncertainty12 Apr 2022
- 2022Provable concept learning for interpretable predictions using variational autoencoders1 Apr 2022
- 2022Interpretation of Black Box NLP Models: A Survey31 Mar 2022
- 2022Analogies and Feature Attributions for Model Agnostic Explanation of Similarity Learners2 Feb 2022
- 2022Fast Interpretable Greedy-Tree Sums28 Jan 2022
- 2022Diagnosing AI Explanation Methods with Folk Concepts of Behavior27 Jan 2022
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networks2 Dec 2021
- 2021Foundations of Symbolic Languages for Model Interpretability5 Oct 2021
- 2021Combining Transformers with Natural Language Explanations2 Sep 2021
- 2021Interpreting and improving deep-learning models with reality checks16 Aug 2021
- 2021Developing a Fidelity Evaluation Approach for Interpretable Machine Learning16 Jun 2021
- 2021Towards Trustworthy Deception Detection: Benchmarking Model Robustness across Domains, Modalities, and Languages23 Apr 2021
- 2021Attention, please! A survey of Neural Attention Models in Deep Learning31 Mar 2021
- 2021Local Interpretations for Explainable Natural Language Processing: A Survey20 Mar 2021
- 2021Bridging Breiman's Brook: From Algorithmic Modeling to Statistical Learning23 Feb 2021
- 2025Simulating Society Requires Simulating Thoughtcited by 13
- 2025Simulating Society Requires Simulating Thought8 Jun 2025
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 126
- 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 51
- 2022Augmenting Interpretable Models with LLMs during Trainingcited by 38
- 2021Local Interpretations for Explainable Natural Language Processing: A Surveycited by 31
- 2023A Survey on Explainability of Graph Neural Networkscited by 29
- 2021Foundations of Symbolic Languages for Model Interpretabilitycited by 26
- 2024Bayesian Concept Bottleneck Models with LLM Priorscited by 17
- 2023CI-GNN: A Granger Causality-Inspired Graph Neural Network for Interpretable Brain Network-Based Psychiatric Diagnosiscited by 16
- 2022Diagnosing AI Explanation Methods with Folk Concepts of Behaviorcited by 15
- 2022Fast Interpretable Greedy-Tree Sumscited by 13
- 2024Towards Modeling Uncertainties of Self-explaining Neural Networks via Conformal Predictioncited by 10
12 most cited of 36 All 36 (JSON)
- 2025Efficient and Interpretable Neural Networks Using Complex Lehmer Transform25 Jan 2025
- 2024Comparative Analysis of Black-Box and White-Box Machine Learning Model in Phishing Detection3 Dec 2024
- 2024Bayesian Concept Bottleneck Models with LLM Priors21 Oct 2024
- 2024Transparent Networks for Multivariate Time Series14 Oct 2024
- 2024Towards Few-shot Self-explaining Graph Neural Networks14 Aug 2024
- 2024Searching for internal symbols underlying deep learning31 May 2024
- 2024Learning accurate and interpretable tree-based models24 May 2024
- 2024Learning a Decision Tree Algorithm with Transformers6 Feb 2024
- 2024Black-Box Access is Insufficient for Rigorous AI Audits25 Jan 2024
- 2024Towards Modeling Uncertainties of Self-explaining Neural Networks via Conformal Prediction3 Jan 2024
- 2023Having Second Thoughts? Let's hear it26 Nov 2023
- 2023The Blame Problem in Evaluating Local Explanations, and How to Tackle it5 Oct 2023
12 newest of 36 All 36 (JSON)