mlsanityData to 7 Oct 2026

Individual Explanations in Machine Learning Models: A Survey for Practitioners

arXiv 2104.04144 ↗First posted 9 Apr 2021cs.LG cs.AI stat.APcited by 6

Not on the map. Why?

Abstract (arXiv)

In recent years, the use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Although these models can often bring substantial improvements in the accuracy and efficiency of organizations, many governments, institutions, and companies are reluctant to their adoption as their output is often difficult to explain in human-interpretable ways. Hence, these models are often regarded as black-boxes, in the sense that their internal mechanisms can be opaque to human audit. In real-world applications, particularly in domains where decisions can have a sensitive impact--e.g., criminal justice, estimating credit scores, insurance risk, health risks, etc.--model interpretability is desired. Recently, the academic literature has proposed a substantial amount of methods for providing interpretable explanations to machine learning models. This survey reviews the most relevant and novel methods that form the state-of-the-art for addressing the particular problem of explaining individual instances in machine learning. It seeks to provide a succinct review that can guide data science and machine learning practitioners in the search for appropriate methods to their problem domain.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 22 of its 47 references that are in the map. First posted on arXiv 9 Apr 2021.

Builds on

22 of 47 references.

References · 22

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  3. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  4. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  5. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  6. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  7. 2017SmoothGrad: removing noise by adding noisecited by 1,097
  8. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
  9. 2016Distribution-Free Predictive Inference For Regressioncited by 657
  10. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
  11. 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
  12. 2016Not Just a Black Box: Learning Important Features Through Propagating Activation Differencescited by 295
10 more
  1. 2017Right for the Right Reasons: Training Differentiable Models by Constraining their Explanationscited by 293
  2. 2017Real Time Image Saliency for Black Box Classifierscited by 246
  3. 2016Model-Agnostic Interpretability of Machine Learningcited by 219
  4. 2016Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Modelscited by 212
  5. 2018Local Rule-Based Explanations of Black Box Decision Systemscited by 165
  6. 2018Counterfactual Fairness in Text Classification through Robustnesscited by 150
  7. 2019The Dangers of Post-hoc Interpretability: Unjustified Counterfactual Explanationscited by 97
  8. 2019Visualizing Deep Networks by Optimizing with Integrated Gradientscited by 59
  9. 2018Visualizing the Feature Importance for Black Box Modelscited by 55
  10. 2018Learning what and where to attendcited by 8

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 0; 2023: 3; 2024: 2.

6 papers.