mlsanityData to 7 Oct 2026

A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depression

arXiv 2311.13852 ↗First posted 23 Nov 2023cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

The lack of explainability using relevant clinical knowledge hinders the adoption of Artificial Intelligence-powered analysis of unstructured clinical dialogue. A wealth of relevant, untapped Mental Health (MH) data is available in online communities, providing the opportunity to address the explainability problem with substantial potential impact as a screening tool for both online and offline applications. We develop a method to enhance attention in popular transformer models and generate clinician-understandable explanations for classification by incorporating external clinical knowledge. Inspired by how clinicians rely on their expertise when interacting with patients, we leverage relevant clinical knowledge to model patient inputs, providing meaningful explanations for classification. This will save manual review time and engender trust. We develop such a system in the context of MH using clinical practice guidelines (CPG) for diagnosing depression, a mental health disorder of global concern. We propose an application-specific language model called ProcesS knowledge-infused cross ATtention (PSAT), which incorporates CPGs when computing attention. Through rigorous evaluation on three expert-curated datasets related to depression, we demonstrate application-relevant explainability of PSAT. PSAT also surpasses the performance of nine baseline models and can provide explanations where other baselines fall short. We transform a CPG resource focused on depression, such as the Patient Health Questionnaire (e.g. PHQ-9) and related questions, into a machine-readable ontology using SNOMED-CT. With this resource, PSAT enhances the ability of models like GPT-3.5 to generate application-relevant explanations.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 40 of its 88 references that are in the map. First posted on arXiv 23 Nov 2023.

Builds on

40 of 88 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  7. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  8. 2020Longformer: The Long-Document Transformercited by 3,362
  9. 2019Attention is not Explanationcited by 916
  10. 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
  11. 2019Attention is not not Explanationcited by 629
  12. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
28 more
  1. 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
  2. 2019Knowledge Enhanced Contextual Word Representationscited by 294
  3. 2019ERNIE 2.0: A Continual Pre-training Framework for Language Understandingcited by 230
  4. 2021Understanding the Capabilities, Limitations, and Societal Impact of Large Language Modelscited by 159
  5. 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 159
  6. 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
  7. 2019Towards Explainable Artificial Intelligencecited by 106
  8. 2021On Guaranteed Optimal Robust Explanations for NLP Modelscited by 54
  9. 2022Post-Hoc Explanations Fail to Achieve their Purpose in Adversarial Contextscited by 53
  10. 2021Learning Rich Representation of Keyphrases from Textcited by 36
  11. 2022CAMS: An Annotated Corpus for Causal Analysis of Mental Health Issues in Social Media Postscited by 34
  12. 2020Semantics of the Black-Box: Can knowledge graphs help make deep learning systems more interpretable and explainable?cited by 31
  13. 2022Global Counterfactual Explainer for Graph Neural Networkscited by 30
  14. 2022Improving the Generalizability of Depression Detection by Leveraging Clinical Questionnairescited by 26
  15. 2017Semi-Supervised Approach to Monitoring Clinical Depressive Symptoms in Social Mediacited by 24
  16. 2022Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit Postscited by 23
  17. 2021ISEEQ: Information Seeking Question Generation using Dynamic Meta-Information Retrieval and Knowledge Graphscited by 22
  18. 2022KALA: Knowledge-Augmented Language Model Adaptationcited by 21
  19. 2022PatternRank: Leveraging Pretrained Language Models and Part of Speech for Unsupervised Keyphrase Extractioncited by 19
  20. 2021UCPhrase: Unsupervised Context-aware Quality Phrase Taggingcited by 14
  21. 2021KI-BERT: Infusing Knowledge Context for Better Language and Domain Understandingcited by 11
  22. 2023ProKnow: Process Knowledge for Safety Constrained and Explainable Question Generation for Mental Health Diagnostic Assistancecited by 10
  23. 2022Process Knowledge-infused Learning for Suicidality Assessment on Social Mediacited by 8
  24. 2022Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Fillingcited by 5
  25. 2022Security and Privacy-Preservation of IoT Data in Cloud-Fog Computing Environmentcited by 3
  26. 2023A Biomedical Knowledge Graph for Biomarker Discovery in Cancercited by 3
  27. 2023Towards Improving the Explainability of Text-based Information Retrieval with Knowledge Graphscited by 2
  28. 2023Towards Explainable and Safe Conversational Agents for Mental Health: A Surveycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 3; 2026: 2.

8 papers.