mlsanityData to 14 Oct 2026

Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead

arXiv 1811.10154 ↗First posted 26 Nov 2018stat.ML cs.LGcited by 40

Not on the map. Why?

Abstract (arXiv)

Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creating methods for explaining these black box models will alleviate some of these problems, but trying to textitexplain black box models, rather than creating models that are textitinterpretable in the first place, is likely to perpetuate bad practices and can potentially cause catastrophic harm to society. There is a way forward -- it is to design models that are inherently interpretable. This manuscript clarifies the chasm between explaining black boxes and using inherently interpretable models, outlines several key reasons why explainable black boxes should be avoided in high-stakes decisions, identifies challenges to interpretable machine learning, and provides several example applications where interpretable models could potentially replace black box models in criminal justice, healthcare, and computer vision.

Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Nov 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 9; 2022: 9; 2023: 8; 2024: 11; 2025: 2; 2026: 1.

40 papers.

Sort:

By area:

  1. 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 126
  2. 2021ProtGNN: Towards Self-Explaining Graph Neural Networkscited by 96
  3. 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 51
  4. 2022Augmenting Interpretable Models with LLMs during Trainingcited by 38
  5. 2021Local Interpretations for Explainable Natural Language Processing: A Surveycited by 31
  6. 2023A Survey on Explainability of Graph Neural Networkscited by 29
  7. 2021Foundations of Symbolic Languages for Model Interpretabilitycited by 26
  8. 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMscited by 25
  9. 2024Bayesian Concept Bottleneck Models with LLM Priorscited by 17
  10. 2023CI-GNN: A Granger Causality-Inspired Graph Neural Network for Interpretable Brain Network-Based Psychiatric Diagnosiscited by 16
  11. 2022Diagnosing AI Explanation Methods with Folk Concepts of Behaviorcited by 15
  12. 2022Fast Interpretable Greedy-Tree Sumscited by 13
28 more
  1. 2025Simulating Society Requires Simulating Thoughtcited by 13
  2. 2024Towards Modeling Uncertainties of Self-explaining Neural Networks via Conformal Predictioncited by 10
  3. 2022Interpretation of Black Box NLP Models: A Surveycited by 9
  4. 2022Provable concept learning for interpretable predictions using variational autoencoderscited by 9
  5. 2021Developing a Fidelity Evaluation Approach for Interpretable Machine Learningcited by 8
  6. 2022Automated Learning of Interpretable Models with Quantified Uncertaintycited by 8
  7. 2021Bridging Breiman's Brook: From Algorithmic Modeling to Statistical Learningcited by 7
  8. 2022Higher-order Neural Additive Models: An Interpretable Machine Learning Model with Feature Interactionscited by 7
  9. 2024Learning a Decision Tree Algorithm with Transformerscited by 6
  10. 2023Less is More: The Influence of Pruning on the Explainability of CNNscited by 5
  11. 2023The Blame Problem in Evaluating Local Explanations, and How to Tackle itcited by 5
  12. 2022"Explanation" is Not a Technical Term: The Problem of Ambiguity in XAIcited by 4
  13. 2024Semantic Objective Functions: A distribution-aware method for adding logical constraints in deep learningcited by 4
  14. 2024Towards Few-shot Self-explaining Graph Neural Networkscited by 4
  15. 2024Learning accurate and interpretable tree-based modelscited by 3
  16. 2021Towards Trustworthy Deception Detection: Benchmarking Model Robustness across Domains, Modalities, and Languagescited by 2
  17. 2022Analogies and Feature Attributions for Model Agnostic Explanation of Similarity Learnerscited by 2
  18. 2023Topological Interpretability for Deep-Learningcited by 2
  19. 2024Transparent Networks for Multivariate Time Seriescited by 2
  20. 2021Interpreting and improving deep-learning models with reality checkscited by 1
  21. 2021Combining Transformers with Natural Language Explanationscited by 1
  22. 2023Finding the Needle in a Haystack: Unsupervised Rationale Extraction from Long Text Classifierscited by 1
  23. 2024Comparative Analysis of Black-Box and White-Box Machine Learning Model in Phishing Detectioncited by 1
  24. 2026Agentic-imodels: Evolving agentic interpretability tools via autoresearchcited by 1
  25. 2023BELLA: Black box model Explanations by Local Linear Approximationscited by 0
  26. 2023Having Second Thoughts? Let's hear itcited by 0
  27. 2024Searching for internal symbols underlying deep learningcited by 0
  28. 2025Efficient and Interpretable Neural Networks Using Complex Lehmer Transformcited by 0