Multi-Task Learning for Mental Health using Social Media Text
Not on the map. Why?
Abstract (arXiv)
We introduce initial groundwork for estimating suicide risk and mental health in a deep learning framework. By modeling multiple conditions, the system learns to make predictions about suicide risk and mental health at a low false positive rate. Conditions are modeled as tasks in a multi-task learning (MTL) framework, with gender prediction as an additional auxiliary task. We demonstrate the effectiveness of multi-task learning by comparison to a well-tuned single-task baseline with the same number of parameters. Our best MTL model predicts potential suicide attempt, as well as the presence of atypical mental health, with AUC > 0.8. We also find additional large improvements using multi-task learning on mental health tasks with limited training data.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 6; 2023: 2; 2024: 5; 2025: 5; 2026: 1.
25 papers.
Sort:
- 2021Anticipating Safety Issues in E2E Conversational AI: Framework and Toolingcited by 77
- 2023Reducing Privacy Risks in Online Self-Disclosures with Language Modelscited by 47
- 2021Disembodied Machine Learning: On the Illusion of Objectivity in NLPcited by 37
- 2022Identifying Moments of Change from Longitudinal User Textcited by 17
- 2021Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Healthcited by 13
- 2024Diverse Perspectives, Divergent Models: Cross-Cultural Evaluation of Depression Detection on Twittercited by 12
- 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cuescited by 11
- 2021Language Modelling as a Multi-Task Problemcited by 10
- 2022SocioProbe: What, When, and Where Language Models Learn about Sociodemographicscited by 7
- 2024Combining Hierachical VAEs with LLMs for clinically meaningful timeline summarisation in social mediacited by 7
- 2024On the State of NLP Approaches to Modeling Depression in Social Media: A Post-COVID-19 Outlookcited by 6
- 2025Datasets for Depression Modeling in Social Media: An Overviewcited by 5
13 more
- 2021Learning More for Free - A Multi Task Learning Approach for Improved Pathology Classification in Capsule Endoscopycited by 4
- 2022Then and Now: Quantifying the Longitudinal Validity of Self-Disclosed Depression Diagnosescited by 4
- 2022The Problem of Semantic Shift in Longitudinal Monitoring of Social Media: A Case Study on Mental Health During the COVID-19 Pandemiccited by 3
- 2024Leveraging LLMs for Translating and Classifying Mental Health Datacited by 2
- 2025Speech as a Multimodal Digital Phenotype for Multi-Task LLM-based Mental Health Predictioncited by 2
- 2021User Factor Adaptation for User Embedding via Multitask Learningcited by 1
- 2022Multi-Task Learning for Depression Detection in Dialogscited by 1
- 2023Improving Text-based Early Prediction by Distillation from Privileged Time-Series Textcited by 1
- 2025MAMA-Memeia! Multi-Aspect Multi-Agent Collaboration for Depressive Symptoms Identification in Memescited by 1
- 2022We Are in This Together: Quantifying Community Subjective Wellbeing and Resiliencecited by 0
- 2025Learning to Route: Per-Sample Adaptive Routing for Multimodal Multitask Predictioncited by 0
- 2025A Review: PTSD in Pre-Existing Medical Condition on Social Mediacited by 0
- 2026FedMental: Evaluating Federated Learning for Mental Health Detection from Social Media Datacited by 0
- 2026FedMental: Evaluating Federated Learning for Mental Health Detection from Social Media Data18 May 2026
- 2025MAMA-Memeia! Multi-Aspect Multi-Agent Collaboration for Depressive Symptoms Identification in Memes31 Dec 2025
- 2025A Review: PTSD in Pre-Existing Medical Condition on Social Media15 Dec 2025
- 2025Learning to Route: Per-Sample Adaptive Routing for Multimodal Multitask Prediction6 Sep 2025
- 2025Speech as a Multimodal Digital Phenotype for Multi-Task LLM-based Mental Health Prediction28 May 2025
- 2025Datasets for Depression Modeling in Social Media: An Overview27 Mar 2025
- 2024Leveraging LLMs for Translating and Classifying Mental Health Data16 Oct 2024
- 2024On the State of NLP Approaches to Modeling Depression in Social Media: A Post-COVID-19 Outlook11 Oct 2024
- 2024Diverse Perspectives, Divergent Models: Cross-Cultural Evaluation of Depression Detection on Twitter1 Apr 2024
- 2024Combining Hierachical VAEs with LLMs for clinically meaningful timeline summarisation in social media29 Jan 2024
- 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cues5 Jan 2024
- 2023Reducing Privacy Risks in Online Self-Disclosures with Language Models16 Nov 2023
13 more
- 2023Improving Text-based Early Prediction by Distillation from Privileged Time-Series Text26 Jan 2023
- 2022SocioProbe: What, When, and Where Language Models Learn about Sociodemographics8 Nov 2022
- 2022We Are in This Together: Quantifying Community Subjective Wellbeing and Resilience23 Aug 2022
- 2022Multi-Task Learning for Depression Detection in Dialogs21 Jul 2022
- 2022The Problem of Semantic Shift in Longitudinal Monitoring of Social Media: A Case Study on Mental Health During the COVID-19 Pandemic22 Jun 2022
- 2022Then and Now: Quantifying the Longitudinal Validity of Self-Disclosed Depression Diagnoses22 Jun 2022
- 2022Identifying Moments of Change from Longitudinal User Text11 May 2022
- 2021Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Health28 Sep 2021
- 2021Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling7 Jul 2021
- 2021Learning More for Free - A Multi Task Learning Approach for Improved Pathology Classification in Capsule Endoscopy30 Jun 2021
- 2021User Factor Adaptation for User Embedding via Multitask Learning22 Feb 2021
- 2021Disembodied Machine Learning: On the Illusion of Objectivity in NLP28 Jan 2021
- 2021Language Modelling as a Multi-Task Problem27 Jan 2021
- 2021Anticipating Safety Issues in E2E Conversational AI: Framework and Toolingcited by 77
- 2023Reducing Privacy Risks in Online Self-Disclosures with Language Modelscited by 47
- 2021Disembodied Machine Learning: On the Illusion of Objectivity in NLPcited by 37
- 2022Identifying Moments of Change from Longitudinal User Textcited by 17
- 2021Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Healthcited by 13
- 2024Diverse Perspectives, Divergent Models: Cross-Cultural Evaluation of Depression Detection on Twittercited by 12
- 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cuescited by 11
- 2021Language Modelling as a Multi-Task Problemcited by 10
- 2022SocioProbe: What, When, and Where Language Models Learn about Sociodemographicscited by 7
- 2024Combining Hierachical VAEs with LLMs for clinically meaningful timeline summarisation in social mediacited by 7
- 2024On the State of NLP Approaches to Modeling Depression in Social Media: A Post-COVID-19 Outlookcited by 6
- 2025Datasets for Depression Modeling in Social Media: An Overviewcited by 5
12 most cited of 25 All 25 (JSON)
- 2026FedMental: Evaluating Federated Learning for Mental Health Detection from Social Media Data18 May 2026
- 2025MAMA-Memeia! Multi-Aspect Multi-Agent Collaboration for Depressive Symptoms Identification in Memes31 Dec 2025
- 2025A Review: PTSD in Pre-Existing Medical Condition on Social Media15 Dec 2025
- 2025Learning to Route: Per-Sample Adaptive Routing for Multimodal Multitask Prediction6 Sep 2025
- 2025Speech as a Multimodal Digital Phenotype for Multi-Task LLM-based Mental Health Prediction28 May 2025
- 2025Datasets for Depression Modeling in Social Media: An Overview27 Mar 2025
- 2024Leveraging LLMs for Translating and Classifying Mental Health Data16 Oct 2024
- 2024On the State of NLP Approaches to Modeling Depression in Social Media: A Post-COVID-19 Outlook11 Oct 2024
- 2024Diverse Perspectives, Divergent Models: Cross-Cultural Evaluation of Depression Detection on Twitter1 Apr 2024
- 2024Combining Hierachical VAEs with LLMs for clinically meaningful timeline summarisation in social media29 Jan 2024
- 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cues5 Jan 2024
- 2023Reducing Privacy Risks in Online Self-Disclosures with Language Models16 Nov 2023
12 newest of 25 All 25 (JSON)