Who Are You Explaining To? A Multi-Agent System for Audience-Aware XAI Narratives
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Feature-attribution methods such as SHAP provide useful evidence about individual model predictions, but their numerical outputs are rarely sufficient for audiences with different expertise, goals, and risks of misinterpretation. In medical AI, the same local explanation must reach patients, clinicians, and data scientists through markedly different forms of communication, and naive verbalization through large language models (LLMs) is prone to weak grounding, conflation of attribution with causal language, and outputs that are persuasive without being faithful to the underlying model evidence. We introduce XstrAI, an audience-aware multi-agent framework that treats local explanations as fixed evidence and structures how it is communicated to each target reader. Each prediction case is encoded as an immutable structured representation, shared identically across audiences so the underlying evidence remains fixed. Generation is factored into three specialized LLM agents responsible for audience-aware planning, linguistic realization, and validation for grounding, attribution consistency, communicative risk, and audience appropriateness, with a bounded revision loop triggered on detected inconsistencies. We evaluate XstrAI on diabetes and stroke risk prediction against 11 baselines, ranging from direct verbalization to a re-implementation of a state-of-the-art narrator. The evaluation combines an intra-narrative regime measuring fidelity to SHAP evidence with an extra-narrative regime assessing audience appropriateness through reference corpora, multi-family LLM judges, and a survey with target readers. In both evaluations, XstrAI's narratives are consistently assigned to their intended audience by independent judges, and preferred over all baselines on Clinician and Patient audiences, with competitive performance on Data Scientist, where audience-conditioned single-prompt baselines lead.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 24 of its 49 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
24 of 49 references.
References · 24
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
12 more
- 2023Causal Parrots: Large Language Models May Talk Causality But Are Not Causalcited by 146
- 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 123
- 2020A Theoretical Analysis of the Repetition Problem in Text Generationcited by 83
- 2018Stakeholders in Explainable AIcited by 48
- 2025LLMs for Explainable AI: A Comprehensive Surveycited by 42
- 2023Tell Me a Story! Narrative-Driven XAI with Large Language Modelscited by 20
- 2022Comparing Explanation Methods for Traditional Machine Learning Models Part 1: An Overview of Current Methods and Quantifying Their Disagreementcited by 14
- 2024Explainable Artificial Intelligence for Medical Applications: A Reviewcited by 12
- 2025ContextualSHAP : Enhancing SHAP Explanations Through Contextual Language Generationcited by 3
- 2026An Agentic Approach to Generating XAI-Narrativescited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Evidence, Logic, and Compliance: Multi-Agent Structured Graph Reasoning with Expert Arbitration for Medical Referral
- 2025Ask WhAI:Probing Belief Formation in Role-Primed LLM Agents
- 2025Show Me How: Benefits and Challenges of Agent-Augmented Counterfactual Explanations for Non-Expert Users
- 2024Critique of Impure Reason: Unveiling the reasoning behaviour of medical Large Language Models
- 2025Explainable AI for Clinical Outcome Prediction: A Survey of Clinician Perceptions and Preferences
- 2026Rethinking Health Agents: From Siloed AI to Collaborative Decision Mediators
- 2026Contextualized Dynamic Explanations: A Vision ↗
- 2025One Patient, Many Contexts: Scaling Medical AI with Contextual Intelligence