Conceptualizing Suicidal Behavior: Utilizing Explanations of Predicted Outcomes to Analyze Longitudinal Social Media Data
Not on the map. Why?
Abstract (arXiv)
The COVID-19 pandemic has escalated mental health crises worldwide, with social isolation and economic instability contributing to a rise in suicidal behavior. Suicide can result from social factors such as shame, abuse, abandonment, and mental health conditions like depression, Post-Traumatic Stress Disorder (PTSD), Attention-Deficit/Hyperactivity Disorder (ADHD), anxiety disorders, and bipolar disorders. As these conditions develop, signs of suicidal ideation may manifest in social media interactions. Analyzing social media data using artificial intelligence (AI) techniques can help identify patterns of suicidal behavior, providing invaluable insights for suicide prevention agencies, professionals, and broader community awareness initiatives. Machine learning algorithms for this purpose require large volumes of accurately labeled data. Previous research has not fully explored the potential of incorporating explanations in analyzing and labeling longitudinal social media data. In this study, we employed a model explanation method, Layer Integrated Gradients, on top of a fine-tuned state-of-the-art language model, to assign each token from Reddit users' posts an attribution score for predicting suicidal ideation. By extracting and analyzing attributions of tokens from the data, we propose a methodology for preliminary screening of social media posts for suicidal ideation without using large language models during inference.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 35 references that are in the map. First posted on arXiv 13 Dec 2023.
Builds on
19 of 35 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2021MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcarecited by 159
- 2020Self-Attention Attribution: Interpreting Information Interactions Inside Transformercited by 124
- 2019Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answeringcited by 96
7 more
- 2023Evaluation of ChatGPT for NLP-based Mental Health Applicationscited by 53
- 2023Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Healthcited by 25
- 2020Bidirectional Encoder Representations from Transformers (BERT): A sentiment analysis odysseycited by 21
- 2021Fine-Grained Neural Network Explanation by Identifying Input Features with Predictive Informationcited by 17
- 2021Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Healthcited by 13
- 2022Explainable Causal Analysis of Mental Health on Social Media Datacited by 6
- 2023Depression Detection Using Digital Traces on Social Media: A Knowledge-aware Deep Learning Approachcited by 3
Built on by
Citing papers per year: 2024: 1.
1 paper.