Enhanced Labeling Technique for Reddit Text and Fine-Tuned Longformer Models for Classifying Depression Severity in English and Luganda
Not on the map. Why?
Abstract (arXiv)
Depression is a global burden and one of the most challenging mental health conditions to control. Experts can detect its severity early using the Beck Depression Inventory (BDI) questionnaire, administer appropriate medication to patients, and impede its progression. Due to the fear of potential stigmatization, many patients turn to social media platforms like Reddit for advice and assistance at various stages of their journey. This research extracts text from Reddit to facilitate the diagnostic process. It employs a proposed labeling approach to categorize the text and subsequently fine-tunes the Longformer model. The model's performance is compared against baseline models, including Naive Bayes, Random Forest, Support Vector Machines, and Gradient Boosting. Our findings reveal that the Longformer model outperforms the baseline models in both English (48%) and Luganda (45%) languages on a custom-made dataset.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 8 of its 31 references that are in the map. First posted on arXiv 25 Jan 2024.
Builds on
8 of 31 references.
References · 8
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2020HateBERT: Retraining BERT for Abusive Language Detection in Englishcited by 206
- 2023A Comparative Study of Pretrained Language Models for Long Clinical Textcited by 35
- 2021NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformercited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.