Beyond Technocratic XAI: The Who, What & How in Explanation Design
Not on the map. Why?
Abstract (arXiv)
The field of Explainable AI (XAI) offers a wide range of techniques for making complex models interpretable. Yet, in practice, generating meaningful explanations is a context-dependent task that requires intentional design choices to ensure accessibility and transparency. This paper reframes explanation as a situated design process -- an approach particularly relevant for practitioners involved in building and deploying explainable systems. Drawing on prior research and principles from design thinking, we propose a three-part framework for explanation design in XAI: asking Who needs the explanation, What they need explained, and How that explanation should be delivered. We also emphasize the need for ethical considerations, including risks of epistemic inequality, reinforcing social inequities, and obscuring accountability and governance. By treating explanation as a sociotechnical design process, this framework encourages a context-aware approach to XAI that supports effective communication and the development of ethically responsible explanations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 128 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
45 of 128 references.
References · 45
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2019Attention is not Explanationcited by 916
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 579
33 more
- 2018e-SNLI: Natural Language Inference with Natural Language Explanationscited by 468
- 2018On the Robustness of Interpretability Methodscited by 310
- 2022From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIcited by 299
- 2016Rationalizing Neural Predictionscited by 281
- 2020Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Surveycited by 252
- 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
- 2016Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Modelscited by 212
- 2019Explainable Machine Learning in Deploymentcited by 210
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 155
- 2017Fairness in Machine Learning: Lessons from Political Philosophycited by 148
- 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
- 2021Reframing Human-AI Collaboration for Generating Free-Text Explanationscited by 125
- 2022OpenXAI: Towards a Transparent Evaluation of Model Explanationscited by 125
- 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
- 2019The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasonscited by 115
- 2020Human-centered Explainable AI: Towards a Reflective Sociotechnical Approachcited by 90
- 2020General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning Modelscited by 74
- 2024Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inferencecited by 59
- 2021How can I choose an explainer? An Application-grounded Evaluation of Post-hoc Explanationscited by 58
- 2021The Who in XAI: How AI Background Shapes Perceptions of AI Explanationscited by 48
- 2023Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAIcited by 33
- 2024History, Development, and Principles of Large Language Models-An Introductory Surveycited by 30
- 2024Properties and Challenges of LLM-Generated Explanationscited by 24
- 2024On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMscited by 24
- 2022Seamful XAI: Operationalizing Seamful Design in Explainable AIcited by 20
- 2022Diagnosing AI Explanation Methods with Folk Concepts of Behaviorcited by 15
- 2018Enslaving the Algorithm: From a "Right to an Explanation" to a "Right to Better Decisions"?cited by 14
- 2023Being Right for Whose Right Reasons?cited by 12
- 2023Using Kernel SHAP XAI Method to optimize the Network Anomaly Detection Modelcited by 10
- 2021From Philosophy to Interfaces: an Explanatory Method and a Tool Inspired by Achinstein's Theory of Explanationcited by 8
- 2021Explainable AI, but explainable to whom?cited by 7
- 2024Beyond Model Interpretability: Socio-Structural Explanations in Machine Learningcited by 6
- 2024Legitimate Power, Illegitimate Automation: The problem of ignoring legitimacy in automated decision systemscited by 2
Built on by
Not cited yet.