Mind the Gap! Bridging Explainable Artificial Intelligence and Human Understanding with Luhmann's Functional Theory of Communication
Not on the map. Why?
Abstract (arXiv)
Over the past decade explainable artificial intelligence has evolved from a predominantly technical discipline into a field that is deeply intertwined with social sciences. Insights such as human preference for contrastive -- more precisely, counterfactual -- explanations have played a major role in this transition, inspiring and guiding the research in computer science. Other observations, while equally important, have nevertheless received much less consideration. The desire of human explainees to communicate with artificial intelligence explainers through a dialogue-like interaction has been mostly neglected by the community. This poses many challenges for the effectiveness and widespread adoption of such technologies as delivering a single explanation optimised according to some predefined objectives may fail to engender understanding in its recipients and satisfy their unique needs given the diversity of human knowledge and intention. Using insights elaborated by Niklas Luhmann and, more recently, Elena Esposito we apply social systems theory to highlight challenges in explainable artificial intelligence and offer a path forward, striving to reinvigorate the technical research in the direction of interactive and iterative explainers. Specifically, this paper demonstrates the potential of systems theoretical approaches to communication in elucidating and addressing the problems and limitations of human-centred explainable artificial intelligence.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 25 of its 101 references that are in the map. First posted on arXiv 7 Feb 2023.
Builds on
25 of 101 references.
References · 25
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
- 2019FACE: Feasible and Actionable Counterfactual Explanationscited by 232
- 2019Explainable Machine Learning in Deploymentcited by 210
- 2019Explainability Fact Sheets: A Framework for Systematic Assessment of Explainable Approachescited by 101
- 2017Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciencescited by 84
- 2020One Explanation Does Not Fit All: The Promise of Interactive Explanations for Machine Learning Transparencycited by 64
- 2019Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications, and Bibliography for Explainable AIcited by 63
- 2022Post-Hoc Explanations Fail to Achieve their Purpose in Adversarial Contextscited by 53
13 more
- 2021The Flaws of Policies Requiring Human Oversight of Government Algorithmscited by 44
- 2023Ignore, Trust, or Negotiate: Understanding Clinician Acceptance of AI-Based Treatment Recommendations in Health Carecited by 37
- 2023Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAIcited by 33
- 2021Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systemscited by 30
- 2019A Grounded Interaction Protocol for Explainable Artificial Intelligencecited by 22
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2022"There Is Not Enough Information": On the Effects of Explanations on Perceptions of Informational Fairness and Trustworthiness in Automated Decision-Makingcited by 19
- 2021Explainability Is in the Mind of the Beholder: Establishing the Foundations of Explainable Artificial Intelligencecited by 13
- 2020What Would You Ask the Machine Learning Model? Identification of User Needs for Model Explanations Based on Human-Model Conversationscited by 11
- 2020Interpretable Representations in Explainable AI: From Theory to Practicecited by 6
- 2021Explanation as a process: user-centric construction of multi-level and multi-modal explanationscited by 4
- 2018The Role of Normware in Trustworthy and Explainable AIcited by 3
- 2022What and How of Machine Learning Transparency: Building Bespoke Explainability Tools with Interoperable Algorithmic Componentscited by 3
Built on by
Citing papers per year: 2023: 3; 2024: 1; 2025: 2; 2026: 1.
7 papers.
- 2025Artificial Intelligence Should Genuinely Support Clinical Reasoning and Decision Making To Bridge the Translational Gapcited by 13
- 2023(Un)reasonable Allure of Ante-hoc Interpretability for High-stakes Domains: Transparency Is Necessary but Insufficient for Comprehensibilitycited by 6
- 2024What Does Evaluation of Explainable Artificial Intelligence Actually Tell Us? A Case for Compositional and Contextual Validation of XAI Building Blockscited by 6
- 2023Navigating Explanatory Multiverse Through Counterfactual Path Geometrycited by 5
- 2023Helpful, Misleading or Confusing: How Humans Perceive Fundamental Building Blocks of Artificial Intelligence Explanationscited by 3
- 2025Suboptimal Shapley Value Explanationscited by 0
- 2026Asymmetric Communication: Large Language Models and Language Gamescited by 0
- 2026Asymmetric Communication: Large Language Models and Language Games30 Jul 2026
- 2025Artificial Intelligence Should Genuinely Support Clinical Reasoning and Decision Making To Bridge the Translational Gap5 Jun 2025
- 2025Suboptimal Shapley Value Explanations17 Feb 2025
- 2024What Does Evaluation of Explainable Artificial Intelligence Actually Tell Us? A Case for Compositional and Contextual Validation of XAI Building Blocks19 Mar 2024
- 2023Navigating Explanatory Multiverse Through Counterfactual Path Geometry5 Jun 2023
- 2023(Un)reasonable Allure of Ante-hoc Interpretability for High-stakes Domains: Transparency Is Necessary but Insufficient for Comprehensibility4 Jun 2023
- 2023Helpful, Misleading or Confusing: How Humans Perceive Fundamental Building Blocks of Artificial Intelligence Explanations2 Mar 2023