Expanding Explainability: Towards Social Transparency in AI systems
Not on the map. Why?
Abstract (arXiv)
As AI-powered systems increasingly mediate consequential decision-making, their explainability is critical for end-users to take informed and accountable actions. Explanations in human-human interactions are socially-situated. AI systems are often socio-organizationally embedded. However, Explainable AI (XAI) approaches have been predominantly algorithm-centered. We take a developmental step towards socially-situated XAI by introducing and exploring Social Transparency (ST), a sociotechnically informed perspective that incorporates the socio-organizational context into explaining AI-mediated decision-making. To explore ST conceptually, we conducted interviews with 29 AI users and practitioners grounded in a speculative design scenario. We suggested constitutive design elements of ST and developed a conceptual framework to unpack ST's effect and implications at the technical, decision-making, and organizational level. The framework showcases how ST can potentially calibrate trust in AI, improve decision-making, facilitate organizational collective actions, and cultivate holistic explainability. Our work contributes to the discourse of Human-Centered XAI by expanding the design space of XAI.
Key facts. Cited by 124 papers in the map (data through 7 Oct 2026). Builds on 24 of its 119 references that are in the map. First posted on arXiv 12 Jan 2021.
Builds on
24 of 119 references.
References · 24
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2016The Mythos of Model Interpretabilitycited by 716
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
- 2018Manipulating and Measuring Model Interpretabilitycited by 256
- 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 251
- 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 182
- 2019One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniquescited by 164
- 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 138
- 2018Explaining Explanations in AIcited by 136
12 more
- 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 100
- 2020Human-centered Explainable AI: Towards a Reflective Sociotechnical Approachcited by 90
- 2020"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humanscited by 86
- 2020Evaluating Saliency Map Explanations for Convolutional Neural Networks: A User Studycited by 86
- 2019Automated Rationale Generation: A Technique for Explainable AI and its Effects on Human Perceptionscited by 81
- 2020Human Factors in Model Interpretability: Industry Practices, Challenges, and Needscited by 73
- 2019explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learningcited by 69
- 2019Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processescited by 53
- 2018Explanation Methods in Deep Learning: Users, Values, Concerns and Challengescited by 49
- 2018The Challenge of Crafting Intelligible Intelligencecited by 46
- 2019What does it mean to solve the problem of discrimination in hiring? Social, technical and legal perspectives from the UK on automated hiring systemscited by 38
- 2018TED: Teaching AI to Explain its Decisionscited by 33
Built on by
Citing papers per year: 2021: 8; 2022: 23; 2023: 25; 2024: 29; 2025: 21; 2026: 18.
124 papers.
Sort:
By area:
- 2022Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AIcited by 169
- 2023Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Modelscited by 144
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2022Explanations Can Reduce Overreliance on AI Systems During Decision-Makingcited by 111
- 2024Relying on the Unreliable: The Impact of Language Models' Reluctance to Express Uncertaintycited by 106
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2022"Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interactioncited by 63
- 2024Design Principles for Generative AI Applicationscited by 57
- 2022Designing for Responsible Trust in AI Systems: A Communication Perspectivecited by 48
- 2022Investigating Explainability of Generative AI for Code through Scenario-based Designcited by 47
- 2023Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systemscited by 40
38 more
- 2021Explainability Pitfalls: Beyond Dark Patterns in Explainable AIcited by 36
- 2023Writer-Defined AI Personas for On-Demand Feedback Generationcited by 36
- 2022Towards Transparency in Dermatology Image Datasets with Skin Tone Annotations by Experts, Crowds, and an Algorithmcited by 35
- 2023Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAIcited by 33
- 2025Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming Supportcited by 33
- 2022Sensible AI: Re-imagining Interpretability and Explainability using Sensemaking Theorycited by 32
- 2022Causal Proxy Models for Concept-Based Model Explanationscited by 29
- 2021Towards Relatable Explainable AI with the Perceptual Processcited by 27
- 2022From plane crashes to algorithmic harm: applicability of safety engineering frameworks for responsible MLcited by 26
- 2021Amortized Generation of Sequential Algorithmic Recourses for Black-box Modelscited by 24
- 2022Seamful XAI: Operationalizing Seamful Design in Explainable AIcited by 20
- 2022Explainable Artificial Intelligence (XAI) from a user perspective- A synthesis of prior literature and problematizing avenues for future researchcited by 20
- 2023Beyond Prompts: Exploring the Design Space of Mixed-Initiative Co-Creativity Systemscited by 20
- 2025As Confidence Aligns: Exploring the Effect of AI Confidence on Human Self-confidence in Human-AI Decision Makingcited by 18
- 2023XAIR: A Framework of Explainable AI in Augmented Realitycited by 17
- 2022Mutual Theory of Mind for Human-AI Communicationcited by 15
- 2023Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"cited by 15
- 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Surveycited by 15
- 2025The challenge of uncertainty quantification of large language models in medicinecited by 14
- 2022Mitigating Covertly Unsafe Text within Natural Language Systemscited by 13
- 2023Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Makingcited by 11
- 2022The Algorithmic Imprintcited by 10
- 2022Human-Centric Research for NLP: Towards a Definition and Guiding Questionscited by 9
- 2022Holding AI to Account: Challenges for the Delivery of Trustworthy AI in Healthcarecited by 9
- 2025Can AI Model the Complexities of Human Moral Decision-Making? A Qualitative Study of Kidney Allocation Decisionscited by 9
- 2023Human-Centered Responsible Artificial Intelligence: Current & Future Trendscited by 8
- 2023A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depressioncited by 8
- 2024Rethinking Explainable Machine Learning as Applied Statisticscited by 8
- 2024Don't be Fooled: The Misinformation Effect of Explanations in Human-AI Collaborationcited by 8
- 2023Why is AI not a Panacea for Data Workers? An Interview Study on Human-AI Collaboration in Data Storytellingcited by 7
- 2024'Since Lawyers are Males..': Examining Implicit Gender Bias in Hindi Language Generation by LLMscited by 7
- 2024Script-Strategy Aligned Generation: Aligning LLMs with Expert-Crafted Dialogue Scripts and Therapeutic Strategies for Psychotherapycited by 7
- 2022Social Construction of XAI: Do We Need One Definition to Rule Them All?cited by 6
- 2023Model Reporting for Certifiable AI: A Proposal from Merging EU Regulation into AI Developmentcited by 6
- 2025Beyond the Single-Best Model: Rashomon Partial Dependence Profile for Trustworthy Explanations in AutoMLcited by 6
- 2025Understanding AI Trustworthiness: A Scoping Review of AIES & FAccT Articlescited by 6
- 2026From Future of Work to Future of Workers: Addressing Asymptomatic AI Harms for Dignified Human-AI Interactioncited by 6
- 2021A User-Centred Framework for Explainable Artificial Intelligence in Human-Robot Interactioncited by 5
50 most cited of 124 All 124 (JSON)
- 2026Who Are You Explaining To? A Multi-Agent System for Audience-Aware XAI Narratives11 Aug 2026
- 2026What We Know about Responsible AI Practices in Industry: A Half Decade of Empirical Research11 Aug 2026
- 2026A Framework for Using and Evaluating LLMs as Surrogate Experts in Security Surveys: Reliability, Bias, and Implications6 Jul 2026
- 2026Mod-Guide: An LLM-based Content Moderation Feedback System to Address Insensitive Speech toward Indigenous Ethnic and Religious Minority Communities11 Jun 2026
- 2026LLM-FACETS: A Privacy-Preserving Framework for Evaluating LLM Transparency and Accountability29 May 2026
- 2026AI, Take the Wheel: What Drives Delegation and Trust in Human-Computer Cooperative Question Answering?27 May 2026
- 2026From Tool to Agent: How Worker Needs Reorganize Across the Agentic Roles of Workplace AI4 May 2026
- 2026Human-AI Coordination Zones: A Framework for Designing Human-in-the-Loop Experiences with Agentic AI1 May 2026
- 2026Personalized Benchmarking: Evaluating LLMs by Individual Preferences21 Apr 2026
- 2026Explainable Model Routing for Agentic Workflows4 Apr 2026
- 2026Using Learning Theories to Evolve Human-Centered XAI: Future Perspectives and Challenges1 Apr 2026
- 2026Trust and Reliance on AI in Education: AI Literacy and Need for Cognition as Moderators1 Apr 2026
38 more
- 2026Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Making12 Feb 2026
- 2026Designing Multi-Robot Ground Video Sensemaking with Public Safety Professionals9 Feb 2026
- 2026Beyond Abstract Compliance: Operationalising trust in AI as a moral relationship30 Jan 2026
- 2026From Future of Work to Future of Workers: Addressing Asymptomatic AI Harms for Dignified Human-AI Interaction29 Jan 2026
- 2026Emergent, not Immanent: A Baradian Reading of Explainable AI21 Jan 2026
- 2026A Scoping Review of the Ethical Perspectives on Anthropomorphising Large Language Model-Based Conversational Agents14 Jan 2026
- 2025Understanding AI Trustworthiness: A Scoping Review of AIES & FAccT Articles24 Oct 2025
- 2025Towards Meaningful Transparency in Civic AI Systems9 Oct 2025
- 2025Beyond Technocratic XAI: The Who, What & How in Explanation Design12 Aug 2025
- 2025Your Model Is Unfair, Are You Even Aware? Inverse Relationship Between Comprehension and Trust in Explainability Visualizations of Biased ML Models31 Jul 2025
- 2025Beyond the Single-Best Model: Rashomon Partial Dependence Profile for Trustworthy Explanations in AutoML19 Jul 2025
- 2025Computational Studies in Influencer Marketing: A Systematic Literature Review17 Jun 2025
- 2025Students' Reliance on AI in Higher Education: Identifying Contributing Factors16 Jun 2025
- 2025Human-Centered AI Communication in Co-Creativity: An Initial Framework and Insights23 May 2025
- 2025Direct Preference Optimization for Adaptive Concept-based Explanations21 May 2025
- 2025What Do People Want to Know About Artificial Intelligence (AI)? The Importance of Answering End-User Questions to Explain Autonomous Vehicle (AV) Decisions9 May 2025
- 2025Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspective15 Apr 2025
- 2025The challenge of uncertainty quantification of large language models in medicine7 Apr 2025
- 2025Perils of Label Indeterminacy: A Case Study on Prediction of Neurological Recovery After Cardiac Arrest5 Apr 2025
- 2025Improving User Experience with FAICO: Towards a Framework for AI Communication in Human-AI Co-Creativity3 Apr 2025
- 2025AI Rivalry as a Craft: How Resisting and Embracing Generative AI Reshape Writing Professions12 Mar 2025
- 2025"Impressively Scary:" Exploring User Perceptions and Reactions to Unraveling Machine Learning Models in Social Media Applications5 Mar 2025
- 2025Can AI Model the Complexities of Human Moral Decision-Making? A Qualitative Study of Kidney Allocation Decisions2 Mar 2025
- 2025Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming Support25 Feb 2025
- 2025As Confidence Aligns: Exploring the Effect of AI Confidence on Human Self-confidence in Human-AI Decision Making22 Jan 2025
- 2025Fine-Grained Appropriate Reliance: Human-AI Collaboration with a Multi-Step Transparent Decision Workflow for Complex Task Decomposition19 Jan 2025
- 2025Revisiting Rogers' Paradox in the Context of Human-AI Interaction16 Jan 2025
- 2024Script-Strategy Aligned Generation: Aligning LLMs with Expert-Crafted Dialogue Scripts and Therapeutic Strategies for Psychotherapy11 Nov 2024
- 2024Thoughtful Adoption of NLP for Civic Participation: Understanding Differences Among Policymakers30 Oct 2024
- 2024AI-Driven Human-Autonomy Teaming in Tactical Operations: Proposed Framework, Challenges, and Future Directions28 Oct 2024
- 2024Human-Centric eXplainable AI in Education18 Oct 2024
- 2024Bridging Today and the Future of Humanity: AI Safety in 2024 and Beyond9 Oct 2024
- 2024Responsible AI in Open Ecosystems: Reconciling Innovation with Risk Assessment and Disclosure27 Sep 2024
- 2024Towards User-Focused Research in Training Data Attribution for Human-Centered Explainable AI25 Sep 2024
- 2024'Since Lawyers are Males..': Examining Implicit Gender Bias in Hindi Language Generation by LLMs20 Sep 2024
- 2024Don't be Fooled: The Misinformation Effect of Explanations in Human-AI Collaboration19 Sep 2024
- 2024Deep Knowledge-Infusion For Explainable Depression Detection1 Sep 2024
- 2024Trustworthy and Responsible AI for Human-Centric Autonomous Decision-Making Systems28 Aug 2024
50 newest of 124 All 124 (JSON)
- 2026Explainable Model Routing for Agentic Workflowscited by 3
- 2026A Scoping Review of the Ethical Perspectives on Anthropomorphising Large Language Model-Based Conversational Agentscited by 2
- 2025Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspectivecited by 1
- 2026Human-AI Coordination Zones: A Framework for Designing Human-in-the-Loop Experiences with Agentic AIcited by 0
- 2026Who Are You Explaining To? A Multi-Agent System for Audience-Aware XAI Narrativescited by 0
- 2026Who Are You Explaining To? A Multi-Agent System for Audience-Aware XAI Narratives11 Aug 2026
- 2026Human-AI Coordination Zones: A Framework for Designing Human-in-the-Loop Experiences with Agentic AI1 May 2026
- 2026Explainable Model Routing for Agentic Workflows4 Apr 2026
- 2026A Scoping Review of the Ethical Perspectives on Anthropomorphising Large Language Model-Based Conversational Agents14 Jan 2026
- 2025Adaptive Human-Agent Teaming: A Review of Empirical Studies from the Process Dynamics Perspective15 Apr 2025
- 2022Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AIcited by 169
- 2023Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Modelscited by 144
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2022Explanations Can Reduce Overreliance on AI Systems During Decision-Makingcited by 111
- 2024Relying on the Unreliable: The Impact of Language Models' Reluctance to Express Uncertaintycited by 106
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 84
- 2022"Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interactioncited by 63
- 2024Design Principles for Generative AI Applicationscited by 57
- 2022Designing for Responsible Trust in AI Systems: A Communication Perspectivecited by 48
- 2022Investigating Explainability of Generative AI for Code through Scenario-based Designcited by 47
- 2023Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systemscited by 40
12 most cited of 116 All 116 (JSON)
- 2026What We Know about Responsible AI Practices in Industry: A Half Decade of Empirical Research11 Aug 2026
- 2026A Framework for Using and Evaluating LLMs as Surrogate Experts in Security Surveys: Reliability, Bias, and Implications6 Jul 2026
- 2026Mod-Guide: An LLM-based Content Moderation Feedback System to Address Insensitive Speech toward Indigenous Ethnic and Religious Minority Communities11 Jun 2026
- 2026LLM-FACETS: A Privacy-Preserving Framework for Evaluating LLM Transparency and Accountability29 May 2026
- 2026AI, Take the Wheel: What Drives Delegation and Trust in Human-Computer Cooperative Question Answering?27 May 2026
- 2026From Tool to Agent: How Worker Needs Reorganize Across the Agentic Roles of Workplace AI4 May 2026
- 2026Using Learning Theories to Evolve Human-Centered XAI: Future Perspectives and Challenges1 Apr 2026
- 2026Trust and Reliance on AI in Education: AI Literacy and Need for Cognition as Moderators1 Apr 2026
- 2026Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Making12 Feb 2026
- 2026Designing Multi-Robot Ground Video Sensemaking with Public Safety Professionals9 Feb 2026
- 2026Beyond Abstract Compliance: Operationalising trust in AI as a moral relationship30 Jan 2026
- 2026From Future of Work to Future of Workers: Addressing Asymptomatic AI Harms for Dignified Human-AI Interaction29 Jan 2026
12 newest of 116 All 116 (JSON)