mlsanityData to 7 Oct 2026

Interpretability and Explainability: A Machine Learning Zoo Mini-tour

arXiv 2012.01805 ↗First posted 3 Dec 2020cs.LGcited by 55

Not on the map. Why?

Abstract (arXiv)

In this review, we examine the problem of designing interpretable and explainable machine learning models. Interpretability and explainability lie at the core of many machine learning and statistical applications in medicine, economics, law, and natural sciences. Although interpretability and explainability have escaped a clear universal definition, many techniques motivated by these properties have been developed over the recent 30 years with the focus currently shifting towards deep learning methods. In this review, we emphasise the divide between interpretability and explainability and illustrate these two different research directions with concrete examples of the state-of-the-art. The review is intended for a general machine learning audience with interest in exploring the problems of interpretation and explanation beyond logistic regression or random forest variable importance. This work is not an exhaustive literature survey, but rather a primer focusing selectively on certain lines of research which the authors found interesting or informative.

Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 10; 2022: 11; 2023: 16; 2024: 12; 2025: 5; 2026: 1.

55 papers.

Sort:

By area:

  1. 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Surveycited by 52
  2. 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
  3. 2021Logic Explained Networkscited by 45
  4. 2024On the Challenges and Opportunities in Generative AIcited by 31
  5. 2022Sparse Visual Counterfactual Explanations in Image Spacecited by 30
  6. 2024The Probabilities Also Matter: A More Faithful Metric for Faithfulness of Free-Text Explanations in Large Language Modelscited by 29
  7. 2022What Makes a Good Explanation?: A Harmonized View of Properties of Explanationscited by 21
  8. 2023Neurosymbolic AI for Reasoning over Knowledge Graphs: A Surveycited by 21
  9. 2023Explaining Quantum Circuits with Shapley Values: Towards Explainable Quantum Machine Learningcited by 17
  10. 2021How to Find a Good Explanation for Clustering?cited by 16
  11. 2021FUTURE-AI: Guiding Principles and Consensus Recommendations for Trustworthy Artificial Intelligence in Medical Imagingcited by 13
  12. 2021Explainability Is in the Mind of the Beholder: Establishing the Foundations of Explainable Artificial Intelligencecited by 13
38 more
  1. 2022System Cards for AI-Based Decision-Making for Public Policycited by 11
  2. 2021Ensembles of Random SHAPscited by 8
  3. 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutionscited by 7
  4. 2022Think About the Stakeholders First! Towards an Algorithmic Transparency Playbook for Regulatory Compliancecited by 7
  5. 2021An Imprecise SHAP as a Tool for Explaining the Class Probability Distributions under Limited Training Datacited by 6
  6. 2023The Contextual Lasso: Sparse Linear Models via Deep Neural Networkscited by 6
  7. 2023Survey on Leveraging Uncertainty Estimation Towards Trustworthy Deep Neural Networks: The Case of Reject Option and Post-training Processingcited by 6
  8. 2022A systematic review of biologically-informed deep learning models for cancer: fundamental trends for encoding and interpreting oncology datacited by 5
  9. 2023Symbolic Regression as Feature Engineering Method for Machine and Deep Learning Regression Taskscited by 5
  10. 2021TorchEsegeta: Framework for Interpretability and Explainability of Image-based Deep Learning Modelscited by 4
  11. 2022Can Requirements Engineering Support Explainable Artificial Intelligence? Towards a User-Centric Approach for Explainability Requirementscited by 4
  12. 2023Neurosymbolic AI for Reasoning on Biomedical Knowledge Graphscited by 4
  13. 2023R-Cut: Enhancing Explainability in Vision Transformers with Relationship Weighted Out and Cutcited by 3
  14. 2024Interpretability in Symbolic Regression: a benchmark of Explanatory Methods using the Feynman data setcited by 3
  15. 2024From Logits to Hierarchies: Hierarchical Clustering made Simplecited by 3
  16. 2024Can sparse autoencoders make sense of gene expression latent variable models?cited by 3
  17. 2023MLHOps: Machine Learning for Healthcare Operationscited by 2
  18. 2023torchosr -- a PyTorch extension package for Open Set Recognition models evaluation in Pythoncited by 2
  19. 2023Sanity Checks for Saliency Methods Explaining Object Detectorscited by 2
  20. 2023Improving Explainability of Disentangled Representations using Multipath-Attribution Mappingscited by 2
  21. 2025Checkmate: interpretable and explainable RSVQA is the endgamecited by 2
  22. 2021Resilience of Bayesian Layer-Wise Explanations under Adversarial Attackscited by 1
  23. 2022Interpretable Time Series Clustering Using Local Explanationscited by 1
  24. 2023Trustworthy Representation Learning Across Domainscited by 1
  25. 2023Experimental Insights Towards Explainable and Interpretable Pedestrian Crossing Predictioncited by 1
  26. 2024Taking Class Imbalance Into Account in Open Set Recognition Evaluationcited by 1
  27. 2024Intrinsic Subgraph Generation for Interpretable Graph based Visual Question Answeringcited by 1
  28. 2024NALA: an Effective and Interpretable Entity Alignment Methodcited by 1
  29. 2024Introducing 'Inside' Out of Distributioncited by 1
  30. 2025Combining Bayesian Inference and Reinforcement Learning for Agent Decision Making: A Reviewcited by 1
  31. 2021Context-Sensitive Visualization of Deep Learning Natural Language Processing Modelscited by 0
  32. 2022Testing Granger Non-Causality in Panels with Cross-Sectional Dependenciescited by 0
  33. 2022From Correlation to Causation: Formalizing Interpretable Machine Learning as a Statistical Processcited by 0
  34. 2022Explanation Method for Anomaly Detection on Mixed Numerical and Categorical Spacescited by 0
  35. 2022Explainable Deep Learning to Profile Mitochondrial Disease Using High Dimensional Protein Expression Datacited by 0
  36. 2023A Scalable Space-efficient In-database Interpretability Framework for Embedding-based Semantic SQL Queriescited by 0
  37. 2023Massively-Parallel Heat Map Sorting and Applications To Explainable Clusteringcited by 0
  38. 2023Is Machine Learning Unsafe and Irresponsible in Social Sciences? Paradoxes and Reconsidering from Recidivism Prediction Taskscited by 0

50 most cited of 55 All 55 (JSON)