mlsanityData to 7 Oct 2026

Understanding User Preferences in Explainable Artificial Intelligence: A Survey and a Mapping Function Proposal

arXiv 2302.03180 ↗First posted 7 Feb 2023cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The increasing complexity of AI systems has led to the growth of the field of Explainable Artificial Intelligence (XAI), which aims to provide explanations and justifications for the outputs of AI algorithms. While there is considerable demand for XAI, there remains a scarcity of studies aimed at comprehensively understanding the practical distinctions among different methods and effectively aligning each method with users individual needs, and ideally, offer a mapping function which can map each user with its specific needs to a method of explainability. This study endeavors to bridge this gap by conducting a thorough review of extant research in XAI, with a specific focus on Explainable Machine Learning (XML), and a keen eye on user needs. Our main objective is to offer a classification of XAI methods within the realm of XML, categorizing current works into three distinct domains: philosophy, theory, and practice, and providing a critical review for each category. Moreover, our study seeks to facilitate the connection between XAI users and the most suitable methods for them and tailor explanations to meet their specific needs by proposing a mapping function that take to account users and their desired properties and suggest an XAI method to them. This entails an examination of prevalent XAI approaches and an evaluation of their properties. The primary outcome of this study is the formulation of a clear and concise strategy for selecting the optimal XAI method to achieve a given goal, all while delivering personalized explanations tailored to individual users.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 65 of its 162 references that are in the map. First posted on arXiv 7 Feb 2023.

Builds on

65 of 162 references.

References · 65

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  4. 2014Going Deeper with Convolutionscited by 4,231
  5. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  6. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  7. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  8. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  9. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  10. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  11. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  12. 2018Sanity Checks for Saliency Mapscited by 1,149
38 more
  1. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
  2. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  3. 2016The Mythos of Model Interpretabilitycited by 716
  4. 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 612
  5. 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
  6. 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 416
  7. 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
  8. 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
  9. 2016European Union regulations on algorithmic decision-making and a "right to explanation"cited by 343
  10. 2017The (Un)reliability of saliency methodscited by 331
  11. 2018Actionable Recourse in Linear Classificationcited by 327
  12. 2019Counterfactual Visual Explanationscited by 312
  13. 2018On the Robustness of Interpretability Methodscited by 310
  14. 2018Metrics for Explainable AI: Challenges and Prospectscited by 257
  15. 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
  16. 2016Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Modelscited by 212
  17. 2019Model-Agnostic Counterfactual Explanations for Consequential Decisionscited by 204
  18. 2021Explainable artificial intelligence (XAI) in deep learning-based medical image analysiscited by 147
  19. 2019Learning Model-Agnostic Counterfactual Explanations for Tabular Datacited by 146
  20. 2019Preserving Causal Constraints in Counterfactual Explanations for Machine Learning Classifierscited by 143
  21. 2022From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagationcited by 141
  22. 2020Algorithmic recourse under imperfect causal knowledge: a probabilistic approachcited by 139
  23. 2018Explaining Explanations in AIcited by 136
  24. 2017What do we need to build explainable AI systems for the medical domain?cited by 127
  25. 2021What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Researchcited by 119
  26. 2020Causal Shapley Values: Exploiting Causal Knowledge to Explain Individual Predictions of Complex Modelscited by 107
  27. 2020Evaluating Saliency Map Explanations for Convolutional Neural Networks: A User Studycited by 86
  28. 2021If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniquescited by 82
  29. 2017What Does Explainable AI Really Mean? A New Conceptualization of Perspectivescited by 72
  30. 2020The Pragmatic Turn in Explainable Artificial Intelligence (XAI)cited by 53
  31. 2021Meaningfully Debugging Model Mistakes using Conceptual Counterfactual Explanationscited by 53
  32. 2020BayLIME: Bayesian Local Interpretable Model-Agnostic Explanationscited by 51
  33. 2020Does Explainable Artificial Intelligence Improve Human Decision-Making?cited by 49
  34. 2019FOCUS: Flexible Optimizable Counterfactual Explanations for Tree Ensemblescited by 43
  35. 2019Model Agnostic Contrastive Explanations for Structured Datacited by 41
  36. 2020Generating Plausible Counterfactual Explanations for Deep Transformers in Financial Text Classificationcited by 40
  37. 2021Explaining Hyperparameter Optimization via Partial Dependence Plotscited by 35
  38. 2023Explainable Deep Reinforcement Learning: State of the Art and Challengescited by 33

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.

  1. 2023Echoes of Biases: How Stigmatizing Language Affects AI Performancecited by 0