mlsanityData to 7 Oct 2026

Explanation Strategies as an Empirical-Analytical Lens for Socio-Technical Contextualization of Machine Learning Interpretability

arXiv 2109.11849 ↗First posted 24 Sep 2021cs.HC cs.AI cs.CYcited by 4

Not on the map. Why?

Abstract (arXiv)

During a research project in which we developed a machine learning (ML) driven visualization system for non-ML experts, we reflected on interpretability research in ML, computer-supported collaborative work and human-computer interaction. We found that while there are manifold technical approaches, these often focus on ML experts and are evaluated in decontextualized empirical studies. We hypothesized that participatory design research may support the understanding of stakeholders' situated sense-making in our project, yet, found guidance regarding ML interpretability inexhaustive. Building on philosophy of technology, we formulated explanation strategies as an empirical-analytical lens explicating how technical explanations mediate the contextual preferences concerning people's interpretations. In this paper, we contribute a report of our proof-of-concept use of explanation strategies to analyze a co-design workshop with non-ML experts, methodological implications for participatory design research, design implications for explanations for non-ML experts and suggest further investigation of technological mediation theories in the ML interpretability space.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 16 of its 83 references that are in the map. First posted on arXiv 24 Sep 2021.

Builds on

16 of 83 references.

References · 16

  1. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  2. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  3. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
  4. 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
  5. 2019Human-Centered Tools for Coping with Imperfect Algorithms during Medical Decision-Makingcited by 109
  6. 2018'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisionscited by 91
  7. 2020Human-centered Explainable AI: Towards a Reflective Sociotechnical Approachcited by 90
  8. 2017Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciencescited by 84
  9. 2020Human Factors in Model Interpretability: Industry Practices, Challenges, and Needscited by 73
  10. 2020CheXplain: Enabling Physicians to Explore and UnderstandData-Driven, AI-Enabled Medical Imaging Analysiscited by 40
  11. 2019"The Human Body is a Black Box": Supporting Clinical Decision-Making with Deep Learningcited by 39
  12. 2021Question-Driven Design Process for Explainable AI User Experiencescited by 31
4 more
  1. 2021Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquirycited by 14
  2. 2018Dice in the Black Box: User Experiences with an Inscrutable Algorithmcited by 7
  3. 2019Interpreting Deep Neural Networks Through Variable Importancecited by 4
  4. 2020Space of Reasons and Mathematical Modelcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 1; 2025: 0; 2026: 1.

4 papers.