From Explainability to Action: A Generative Operational Framework for Integrating XAI in Clinical Mental Health Screening
Not on the map. Why?
Abstract (arXiv)
Explainable Artificial Intelligence (XAI) has been presented as the critical component for unlocking the potential of machine learning in mental health screening (MHS). However, a persistent lab-to-clinic gap remains. Current XAI techniques, such as SHAP and LIME, excel at producing technically faithful outputs such as feature importance scores, but fail to deliver clinically relevant, actionable insights that can be used by clinicians or understood by patients. This disconnect between technical transparency and human utility is the primary barrier to real-world adoption. This paper argues that this gap is a translation problem and proposes the Generative Operational Framework, a novel system architecture that leverages Large Language Models (LLMs) as a central translation engine. This framework is designed to ingest the raw, technical outputs from diverse XAI tools and synthesize them with clinical guidelines (via RAG) to automatically generate human-readable, evidence-backed clinical narratives. To justify our solution, we provide a systematic analysis of the components it integrates, tracing the evolution from intrinsic models to generative XAI. We demonstrate how this framework directly addresses key operational barriers, including workflow integration, bias mitigation, and stakeholder-specific communication. This paper also provides a strategic roadmap for moving the field beyond the generation of isolated data points toward the delivery of integrated, actionable, and trustworthy AI in clinical practice.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 74 references that are in the map. First posted on arXiv 10 Oct 2025.
Builds on
25 of 74 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 599
- 2023Explainability for Large Language Models: A Surveycited by 333
- 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 161
- 2019What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Usecited by 135
13 more
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2018Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontierscited by 117
- 2025MedRAG: Enhancing Retrieval-augmented Generation with Knowledge Graph-Elicited Reasoning for Healthcare Copilotcited by 83
- 2023Towards Interpretable Mental Health Analysis with Large Language Modelscited by 53
- 2025LLMs for Explainable AI: A Comprehensive Surveycited by 45
- 2025Neuro-Symbolic AI in 2024: A Systematic Reviewcited by 38
- 2022Trust in AI and Its Role in the Acceptance of AI Technologiescited by 29
- 2024From Insights to Actions: The Impact of Interpretability and Analysis Research on NLPcited by 20
- 2025Enhancing Depression Detection with Chain-of-Thought Prompting: From Emotion to Reasoning Using Large Language Modelscited by 8
- 2024Explainable AI for Mental Disorder Detection via Social Media: A survey and outlookcited by 6
- 2024A Domain-Agnostic Neurosymbolic Approach for Big Social Data Analysis: Evaluating Mental Health Sentiment on Social Media during COVID-19cited by 5
- 2024They Look Like Each Other: Case-based Reasoning for Explainable Depression Detection on Twitter using Large Language Modelscited by 1
- 2025Explainable AI for Mental Health Emergency Returns: Integrating LLMs with Predictive Modelingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Rethinking Large Language Models in Mental Health Applications
- 2026Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming
- 2025Explainable AI for Clinical Outcome Prediction: A Survey of Clinician Perceptions and Preferences
- 2026A Multi-Agent Audit Framework for High-Stakes Reasoning: Evaluation and Interpretability in Clinical Mental Health Screening
- 2025A Survey on Human-Centered Evaluation of Explainable AI Methods in Clinical Decision Support Systems
- 2025Explainable artificial intelligence (XAI): from inherent explainability to large language models
- 2026Self-Evolving Human-Centered Framework for Explainable Depression Symptom Annotation
- 2024Critique of Impure Reason: Unveiling the reasoning behaviour of medical Large Language Models