mlsanityData to 7 Oct 2026

Explainable Depression Symptom Detection in Social Media

arXiv 2310.13664 ↗First posted 20 Oct 2023cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Users of social platforms often perceive these sites as supportive spaces to post about their mental health issues. Those conversations contain important traces about individuals' health risks. Recently, researchers have exploited this online information to construct mental health detection models, which aim to identify users at risk on platforms like Twitter, Reddit or Facebook. Most of these models are centred on achieving good classification results, ignoring the explainability and interpretability of the decisions. Recent research has pointed out the importance of using clinical markers, such as the use of symptoms, to improve trust in the computational models by health professionals. In this paper, we propose using transformer-based architectures to detect and explain the appearance of depressive symptom markers in the users' writings. We present two approaches: i) train a model to classify, and another one to explain the classifier's decision separately and ii) unify the two tasks simultaneously using a single model. Additionally, for this latter manner, we also investigated the performance of recent conversational LLMs when using in-context learning. Our natural language explanations enable clinicians to interpret the models' decisions based on validated symptoms, enhancing trust in the automated process. We evaluate our approach using recent symptom-based datasets, employing both offline and expert-in-the-loop metrics to assess the quality of the explanations generated by our models. The experimental results show that it is possible to achieve good classification results while generating interpretable symptom-based explanations.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 40 of its 103 references that are in the map. First posted on arXiv 20 Oct 2023.

Builds on

40 of 103 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  8. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  9. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  10. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  11. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  12. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
28 more
  1. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  2. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  3. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  4. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
  5. 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
  6. 2019Attention is not Explanationcited by 916
  7. 2019Attention is not not Explanationcited by 629
  8. 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 523
  9. 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
  10. 2018e-SNLI: Natural Language Inference with Natural Language Explanationscited by 468
  11. 2019Is Attention Interpretable?cited by 387
  12. 2018Explainable Prediction of Medical Codes from Clinical Textcited by 231
  13. 2016Model-Agnostic Interpretability of Machine Learningcited by 219
  14. 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 177
  15. 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 159
  16. 2020WT5?! Training Text-to-Text Models to Explain their Predictionscited by 148
  17. 2020The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategiescited by 91
  18. 2017Depression and Self-Harm Risk Assessment in Online Forumscited by 81
  19. 2015Supersparse Linear Integer Models for Optimized Medical Scoring Systemscited by 76
  20. 2023Towards Interpretable Mental Health Analysis with Large Language Modelscited by 53
  21. 2022Improving the Generalizability of Depression Detection by Leveraging Clinical Questionnairescited by 26
  22. 2022Symptom Identification for Interpretable Detection of Multiple Mental Disorderscited by 20
  23. 2023It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformerscited by 18
  24. 2022Psychiatric Scale Guided Risky Post Screening for Early Detection of Depressioncited by 10
  25. 2018RSDD-Time: Temporal Annotation of Self-Reported Mental Health Diagnosescited by 9
  26. 2022Semantic Similarity Models for Depression Severity Estimationcited by 5
  27. 2023DepreSym: A Depression Symptom Annotated Corpus and the Role of LLMs as Assessors of Psychological Markerscited by 5
  28. 2020Lightme: Analysing Language in Internet Support Groups for Mental Healthcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 2.

9 papers.