Detecting Reddit Users with Depression Using a Hybrid Neural Network SBERT-CNN
Not on the map. Why?
Abstract (arXiv)
Depression is a widespread mental health issue, affecting an estimated 3.8% of the global population. It is also one of the main contributors to disability worldwide. Recently it is becoming popular for individuals to use social media platforms (e.g., Reddit) to express their difficulties and health issues (e.g., depression) and seek support from other users in online communities. It opens great opportunities to automatically identify social media users with depression by parsing millions of posts for potential interventions. Deep learning methods have begun to dominate in the field of machine learning and natural language processing (NLP) because of their ease of use, efficient processing, and state-of-the-art results on many NLP tasks. In this work, we propose a hybrid deep learning model which combines a pretrained sentence BERT (SBERT) and convolutional neural network (CNN) to detect individuals with depression with their Reddit posts. The sentence BERT is used to learn the meaningful representation of semantic information in each post. CNN enables the further transformation of those embeddings and the temporal identification of behavioral patterns of users. We trained and evaluated the model performance to identify Reddit users with depression by utilizing the Self-reported Mental Health Diagnoses (SMHD) data. The hybrid deep learning model achieved an accuracy of 0.86 and an F1 score of 0.86 and outperformed the state-of-the-art documented result (F1 score of 0.79) by other machine learning models in the literature. The results show the feasibility of the hybrid model to identify individuals with depression. Although the hybrid model is validated to detect depression with Reddit posts, it can be easily tuned and applied to other text classification tasks and different clinical applications.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 11 of its 50 references that are in the map. First posted on arXiv 3 Feb 2023.
Builds on
11 of 50 references.
References · 11
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
- 2016FastText.zip: Compressing text classification modelscited by 331
- 2017Depression and Self-Harm Risk Assessment in Online Forumscited by 81
- 2018SMHD: A Large-Scale Resource for Exploring Online Language Usage for Multiple Mental Health Conditionscited by 73
- 2021Early Stopping for Deep Image Priorcited by 44
- 2020Adapting Deep Learning Methods for Mental Health Prediction on Social Mediacited by 10
- 2022Governing for Free: Rule Process Effects on Reddit Moderator Motivationscited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 1.
5 papers.
- 2024DepressionEmo: A novel dataset for multilabel classification of depression emotionscited by 10
- 2023Interpretable Deep Learning Methods for Multiview Learningcited by 5
- 2024Narrative Feature or Structured Feature? A Study of Large Language Models to Identify Cancer Patients at Risk of Heart Failurecited by 3
- 2024Depression detection in social media posts using transformer-based models and auxiliary featurescited by 2
- 2025Assess and Prompt: A Generative RL Framework for Improving Engagement in Online Mental Health Communitiescited by 1
- 2025Assess and Prompt: A Generative RL Framework for Improving Engagement in Online Mental Health Communities22 Aug 2025
- 2024Depression detection in social media posts using transformer-based models and auxiliary features30 Sep 2024
- 2024Narrative Feature or Structured Feature? A Study of Large Language Models to Identify Cancer Patients at Risk of Heart Failure18 Mar 2024
- 2024DepressionEmo: A novel dataset for multilabel classification of depression emotions9 Jan 2024
- 2023Interpretable Deep Learning Methods for Multiview Learning15 Feb 2023