Improving the Generalizability of Depression Detection by Leveraging Clinical Questionnaires
Not on the map. Why?
Abstract (arXiv)
Automated methods have been widely used to identify and analyze mental health conditions (e.g., depression) from various sources of information, including social media. Yet, deployment of such models in real-world healthcare applications faces challenges including poor out-of-domain generalization and lack of trust in black box models. In this work, we propose approaches for depression detection that are constrained to different degrees by the presence of symptoms described in PHQ9, a questionnaire used by clinicians in the depression screening process. In dataset-transfer experiments on three social media datasets, we find that grounding the model in PHQ9's symptoms substantially improves its ability to generalize to out-of-distribution data compared to a standard BERT-based approach. Furthermore, this approach can still perform competitively on in-domain data. These results and our qualitative analyses suggest that grounding model predictions in clinically-relevant symptoms can improve generalizability while producing a model that is easier to inspect.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 14 of its 43 references that are in the map. First posted on arXiv 21 Apr 2022.
Builds on
14 of 43 references.
References · 14
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 496
- 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
- 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 299
- 2018Explainable Prediction of Medical Codes from Clinical Textcited by 234
- 2017Depression and Self-Harm Risk Assessment in Online Forumscited by 84
- 2018SMHD: A Large-Scale Resource for Exploring Online Language Usage for Multiple Mental Health Conditionscited by 73
- 2019Adapt or Get Left Behind: Domain Adaptation through BERT Language Model Finetuning for Aspect-Target Sentiment Classificationcited by 63
- 2020On the State of Social Media Data for Mental Health Researchcited by 32
Built on by
Citing papers per year: 2022: 4; 2023: 9; 2024: 7; 2025: 3; 2026: 4.
27 papers.
Sort:
By area:
- 2023Can Large Language Models Transform Computational Social Science?cited by 250
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 98
- 2023Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Datacited by 66
- 2023MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Modelscited by 63
- 2023Towards Interpretable Mental Health Analysis with Large Language Modelscited by 53
- 2022Symptom Identification for Interpretable Detection of Multiple Mental Disorderscited by 20
- 2024Depression Detection on Social Media with Large Language Modelscited by 20
- 2024Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosiscited by 12
- 2024From Explainable to Interpretable Deep Learning for Natural Language Processing in Healthcare: How Far from Reality?cited by 11
- 2023Explainable Depression Symptom Detection in Social Mediacited by 9
- 2023A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depressioncited by 8
- 2024A Novel Nuanced Conversation Evaluation Framework for Large Language Models in Mental Healthcited by 7
15 more
- 2022Semantic Similarity Models for Depression Severity Estimationcited by 6
- 2023Exploring Social Media for Early Detection of Depression in COVID-19 Patientscited by 6
- 2024Can Large Language Models be Used to Provide Psychological Counselling? An Analysis of GPT-4-Generated Responses Using Role-play Dialoguescited by 6
- 2024On the State of NLP Approaches to Modeling Depression in Social Media: A Post-COVID-19 Outlookcited by 6
- 2023Utilizing ChatGPT Generated Data to Retrieve Depression Symptoms from Social Mediacited by 5
- 2025Datasets for Depression Modeling in Social Media: An Overviewcited by 5
- 2023A Simple and Flexible Modeling for Mental Disorder Detection by Learning from Clinical Questionnairescited by 4
- 2026Responsible Evaluation of AI for Mental Healthcited by 2
- 2024They Look Like Each Other: Case-based Reasoning for Explainable Depression Detection on Twitter using Large Language Modelscited by 1
- 2025Explainable Multimodal Depression Recognition in Clinical Interviews via PHQ-Aligned Symptom Summarizationcited by 1
- 2022Deep Temporal Modelling of Clinical Depression through Social Media Textcited by 0
- 2025AI Models for Depressive Disorder Detection and Diagnosis: A Reviewcited by 0
- 2026WPG-MoE: Weak-Prior-Guided Dense Mixture-of-Experts for User-Level Social Media Depression Detectioncited by 0
- 2026Beyond Reflection: Affirmation as a Promising Behavioral Marker Associated with Quality in Text-Based Counselingcited by 0
- 2026PAT: A Personality-Driven Augmentation and Transfer Learning Framework for Depression Detection on Social Mediacited by 0
- 2026PAT: A Personality-Driven Augmentation and Transfer Learning Framework for Depression Detection on Social Media10 Oct 2026
- 2026Beyond Reflection: Affirmation as a Promising Behavioral Marker Associated with Quality in Text-Based Counseling27 Aug 2026
- 2026WPG-MoE: Weak-Prior-Guided Dense Mixture-of-Experts for User-Level Social Media Depression Detection5 Jul 2026
- 2026Responsible Evaluation of AI for Mental Health20 Jan 2026
- 2025AI Models for Depressive Disorder Detection and Diagnosis: A Review16 Aug 2025
- 2025Datasets for Depression Modeling in Social Media: An Overview27 Mar 2025
- 2025Explainable Multimodal Depression Recognition in Clinical Interviews via PHQ-Aligned Symptom Summarization27 Jan 2025
- 2024On the State of NLP Approaches to Modeling Depression in Social Media: A Post-COVID-19 Outlook11 Oct 2024
- 2024Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosis4 Oct 2024
- 2024They Look Like Each Other: Case-based Reasoning for Explainable Depression Detection on Twitter using Large Language Models21 Jul 2024
- 2024From Explainable to Interpretable Deep Learning for Natural Language Processing in Healthcare: How Far from Reality?18 Mar 2024
- 2024Depression Detection on Social Media with Large Language Models16 Mar 2024
15 more
- 2024A Novel Nuanced Conversation Evaluation Framework for Large Language Models in Mental Health8 Mar 2024
- 2024Can Large Language Models be Used to Provide Psychological Counselling? An Analysis of GPT-4-Generated Responses Using Role-play Dialogues20 Feb 2024
- 2023A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depression23 Nov 2023
- 2023Explainable Depression Symptom Detection in Social Media20 Oct 2023
- 2023MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Models24 Sep 2023
- 2023Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data26 Jul 2023
- 2023Utilizing ChatGPT Generated Data to Retrieve Depression Symptoms from Social Media5 Jul 2023
- 2023A Simple and Flexible Modeling for Mental Disorder Detection by Learning from Clinical Questionnaires5 Jun 2023
- 2023Can Large Language Models Transform Computational Social Science?12 Apr 2023
- 2023Towards Interpretable Mental Health Analysis with Large Language Models6 Apr 2023
- 2023Exploring Social Media for Early Detection of Depression in COVID-19 Patients23 Feb 2023
- 2022Semantic Similarity Models for Depression Severity Estimation14 Nov 2022
- 2022Deep Temporal Modelling of Clinical Depression through Social Media Text28 Oct 2022
- 2022State-of-the-art generalisation research in NLP: A taxonomy and review6 Oct 2022
- 2022Symptom Identification for Interpretable Detection of Multiple Mental Disorders23 May 2022
- 2023Can Large Language Models Transform Computational Social Science?cited by 250
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 98
- 2023Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Datacited by 66
- 2023MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Modelscited by 63
- 2023Towards Interpretable Mental Health Analysis with Large Language Modelscited by 53
- 2022Symptom Identification for Interpretable Detection of Multiple Mental Disorderscited by 20
- 2024Depression Detection on Social Media with Large Language Modelscited by 20
- 2024Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosiscited by 12
- 2024From Explainable to Interpretable Deep Learning for Natural Language Processing in Healthcare: How Far from Reality?cited by 11
- 2023Explainable Depression Symptom Detection in Social Mediacited by 9
- 2023A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depressioncited by 8
- 2024A Novel Nuanced Conversation Evaluation Framework for Large Language Models in Mental Healthcited by 7
12 most cited of 26 All 26 (JSON)
- 2026PAT: A Personality-Driven Augmentation and Transfer Learning Framework for Depression Detection on Social Media10 Oct 2026
- 2026Beyond Reflection: Affirmation as a Promising Behavioral Marker Associated with Quality in Text-Based Counseling27 Aug 2026
- 2026Responsible Evaluation of AI for Mental Health20 Jan 2026
- 2025AI Models for Depressive Disorder Detection and Diagnosis: A Review16 Aug 2025
- 2025Datasets for Depression Modeling in Social Media: An Overview27 Mar 2025
- 2025Explainable Multimodal Depression Recognition in Clinical Interviews via PHQ-Aligned Symptom Summarization27 Jan 2025
- 2024On the State of NLP Approaches to Modeling Depression in Social Media: A Post-COVID-19 Outlook11 Oct 2024
- 2024Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosis4 Oct 2024
- 2024They Look Like Each Other: Case-based Reasoning for Explainable Depression Detection on Twitter using Large Language Models21 Jul 2024
- 2024From Explainable to Interpretable Deep Learning for Natural Language Processing in Healthcare: How Far from Reality?18 Mar 2024
- 2024Depression Detection on Social Media with Large Language Models16 Mar 2024
- 2024A Novel Nuanced Conversation Evaluation Framework for Large Language Models in Mental Health8 Mar 2024
12 newest of 26 All 26 (JSON)