mlsanityData to 7 Oct 2026

Beyond Technocratic XAI: The Who, What & How in Explanation Design

arXiv 2508.09231 ↗First posted 12 Aug 2025cs.CY cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

The field of Explainable AI (XAI) offers a wide range of techniques for making complex models interpretable. Yet, in practice, generating meaningful explanations is a context-dependent task that requires intentional design choices to ensure accessibility and transparency. This paper reframes explanation as a situated design process -- an approach particularly relevant for practitioners involved in building and deploying explainable systems. Drawing on prior research and principles from design thinking, we propose a three-part framework for explanation design in XAI: asking Who needs the explanation, What they need explained, and How that explanation should be delivered. We also emphasize the need for ethical considerations, including risks of epistemic inequality, reinforcing social inequities, and obscuring accountability and governance. By treating explanation as a sociotechnical design process, this framework encourages a context-aware approach to XAI that supports effective communication and the development of ethically responsible explanations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 128 references that are in the map. First posted on arXiv 12 Aug 2025.

Builds on

45 of 128 references.

References · 45

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  4. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  5. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  6. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  7. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  8. 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
  9. 2019Attention is not Explanationcited by 916
  10. 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
  11. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
  12. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 579
33 more
  1. 2018e-SNLI: Natural Language Inference with Natural Language Explanationscited by 468
  2. 2018On the Robustness of Interpretability Methodscited by 310
  3. 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
  4. 2016Rationalizing Neural Predictionscited by 281
  5. 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 252
  6. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
  7. 2016Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Modelscited by 212
  8. 2019Explainable Machine Learning in Deploymentcited by 210
  9. 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 155
  10. 2017Fairness in Machine Learning: Lessons from Political Philosophycited by 148
  11. 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
  12. 2021Reframing Human-AI Collaboration for Generating Free-Text Explanationscited by 125
  13. 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 125
  14. 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
  15. 2019The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasonscited by 115
  16. 2020Human-centered Explainable AI: Towards a Reflective Sociotechnical Approachcited by 90
  17. 2020General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning Modelscited by 74
  18. 2024Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inferencecited by 59
  19. 2021How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanationscited by 58
  20. 2021The Who in XAI: How AI Background Shapes Perceptions of AI Explanationscited by 48
  21. 2023Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAIcited by 33
  22. 2024History, Development, and Principles of Large Language Models-An Introductory Surveycited by 30
  23. 2024Properties and Challenges of LLM-Generated Explanationscited by 24
  24. 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMscited by 24
  25. 2022Seamful XAI: Operationalizing Seamful Design in Explainable AIcited by 20
  26. 2022Diagnosing AI Explanation Methods with Folk Concepts of Behaviorcited by 15
  27. 2018Enslaving the Algorithm: From a "Right to an Explanation" to a "Right to Better Decisions"?cited by 14
  28. 2023Being Right for Whose Right Reasons?cited by 12
  29. 2023Using Kernel SHAP XAI Method to optimize the Network Anomaly Detection Modelcited by 10
  30. 2021From Philosophy to Interfaces: an Explanatory Method and a Tool Inspired by Achinstein's Theory of Explanationcited by 8
  31. 2021Explainable AI, but explainable to whom?cited by 7
  32. 2024Beyond Model Interpretability: Socio-Structural Explanations in Machine Learningcited by 6
  33. 2024Legitimate Power, Illegitimate Automation: The problem of ignoring legitimacy in automated decision systemscited by 2

Built on by

Not cited yet.