A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depression
Not on the map. Why?
Abstract (arXiv)
The lack of explainability using relevant clinical knowledge hinders the adoption of Artificial Intelligence-powered analysis of unstructured clinical dialogue. A wealth of relevant, untapped Mental Health (MH) data is available in online communities, providing the opportunity to address the explainability problem with substantial potential impact as a screening tool for both online and offline applications. We develop a method to enhance attention in popular transformer models and generate clinician-understandable explanations for classification by incorporating external clinical knowledge. Inspired by how clinicians rely on their expertise when interacting with patients, we leverage relevant clinical knowledge to model patient inputs, providing meaningful explanations for classification. This will save manual review time and engender trust. We develop such a system in the context of MH using clinical practice guidelines (CPG) for diagnosing depression, a mental health disorder of global concern. We propose an application-specific language model called ProcesS knowledge-infused cross ATtention (PSAT), which incorporates CPGs when computing attention. Through rigorous evaluation on three expert-curated datasets related to depression, we demonstrate application-relevant explainability of PSAT. PSAT also surpasses the performance of nine baseline models and can provide explanations where other baselines fall short. We transform a CPG resource focused on depression, such as the Patient Health Questionnaire (e.g. PHQ-9) and related questions, into a machine-readable ontology using SNOMED-CT. With this resource, PSAT enhances the ability of models like GPT-3.5 to generate application-relevant explanations.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 40 of its 88 references that are in the map. First posted on arXiv 23 Nov 2023.
Builds on
40 of 88 references.
References · 40
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2019Attention is not Explanationcited by 916
- 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
- 2019Attention is not not Explanationcited by 629
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
28 more
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
- 2019Knowledge Enhanced Contextual Word Representationscited by 294
- 2019ERNIE 2.0: A Continual Pre-training Framework for Language Understandingcited by 230
- 2021Understanding the Capabilities, Limitations, and Societal Impact of Large Language Modelscited by 159
- 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 159
- 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
- 2019Towards Explainable Artificial Intelligencecited by 106
- 2021On Guaranteed Optimal Robust Explanations for NLP Modelscited by 54
- 2022Post-Hoc Explanations Fail to Achieve their Purpose in Adversarial Contextscited by 53
- 2021Learning Rich Representation of Keyphrases from Textcited by 36
- 2022CAMS: An Annotated Corpus for Causal Analysis of Mental Health Issues in Social Media Postscited by 34
- 2020Semantics of the Black-Box: Can knowledge graphs help make deep learning systems more interpretable and explainable?cited by 31
- 2022Global Counterfactual Explainer for Graph Neural Networkscited by 30
- 2022Improving the Generalizability of Depression Detection by Leveraging Clinical Questionnairescited by 26
- 2017Semi-Supervised Approach to Monitoring Clinical Depressive Symptoms in Social Mediacited by 24
- 2022Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit Postscited by 23
- 2021ISEEQ: Information Seeking Question Generation using Dynamic Meta-Information Retrieval and Knowledge Graphscited by 22
- 2022KALA: Knowledge-Augmented Language Model Adaptationcited by 21
- 2022PatternRank: Leveraging Pretrained Language Models and Part of Speech for Unsupervised Keyphrase Extractioncited by 19
- 2021UCPhrase: Unsupervised Context-aware Quality Phrase Taggingcited by 14
- 2021KI-BERT: Infusing Knowledge Context for Better Language and Domain Understandingcited by 11
- 2023ProKnow: Process Knowledge for Safety Constrained and Explainable Question Generation for Mental Health Diagnostic Assistancecited by 10
- 2022Process Knowledge-infused Learning for Suicidality Assessment on Social Mediacited by 8
- 2022Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Fillingcited by 5
- 2022Security and Privacy-Preservation of IoT Data in Cloud-Fog Computing Environmentcited by 3
- 2023A Biomedical Knowledge Graph for Biomarker Discovery in Cancercited by 3
- 2023Towards Improving the Explainability of Text-based Information Retrieval with Knowledge Graphscited by 2
- 2023Towards Explainable and Safe Conversational Agents for Mental Health: A Surveycited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 3; 2026: 2.
8 papers.
- 2023Building Trustworthy NeuroSymbolic AI Systems: Consistency, Reliability, Explainability, and Safetycited by 14
- 2025Enhanced Large Language Models for Effective Screening of Depression and Anxietycited by 9
- 2024Deep Knowledge-Infusion For Explainable Depression Detectioncited by 2
- 2025Efficient or Powerful? Trade-offs Between Machine Learning and Deep Learning for Mental Illness Detection on Social Mediacited by 2
- 2026Neurosymbolic Retrievers for Retrieval-augmented Generationcited by 1
- 2024IoT-Based Preventive Mental Health Using Knowledge Graphs and Standards for Better Well-Beingcited by 0
- 2025AttentionDep: Domain-Aware Attention for Explainable Depression Severity Assessmentcited by 0
- 2026Bag of Tricks or Bag of Myths? Reducing Modeling Complexity with Task Knowledge in Explainable Suicide Risk Assessmentcited by 0
- 2026Bag of Tricks or Bag of Myths? Reducing Modeling Complexity with Task Knowledge in Explainable Suicide Risk Assessment7 Sep 2026
- 2026Neurosymbolic Retrievers for Retrieval-augmented Generation8 Jan 2026
- 2025AttentionDep: Domain-Aware Attention for Explainable Depression Severity Assessment1 Oct 2025
- 2025Efficient or Powerful? Trade-offs Between Machine Learning and Deep Learning for Mental Illness Detection on Social Media3 Mar 2025
- 2025Enhanced Large Language Models for Effective Screening of Depression and Anxiety15 Jan 2025
- 2024Deep Knowledge-Infusion For Explainable Depression Detection1 Sep 2024
- 2024IoT-Based Preventive Mental Health Using Knowledge Graphs and Standards for Better Well-Being19 Jun 2024
- 2023Building Trustworthy NeuroSymbolic AI Systems: Consistency, Reliability, Explainability, and Safety5 Dec 2023