mlsanityData to 14 Oct 2026

Advancing Minority Stress Detection with Transformers: Insights from the Social Media Datasets

arXiv 2509.02908 ↗First posted 3 Sep 2025cs.CL cs.SIcited by 2

Not on the map. Why?

Abstract (arXiv)

Individuals from sexual and gender minority groups experience disproportionately high rates of poor health outcomes and mental disorders compared to their heterosexual and cisgender counterparts, largely as a consequence of minority stress as described by Meyer's (2003) model. This study presents the first comprehensive evaluation of transformer-based architectures for detecting minority stress in online discourse. We benchmark multiple transformer models including ELECTRA, BERT, RoBERTa, and BART against traditional machine learning baselines and graph-augmented variants. We further assess zero-shot and few-shot learning paradigms to assess their applicability on underrepresented datasets. Experiments are conducted on the two largest publicly available Reddit corpora for minority stress detection, comprising 12,645 and 5,789 posts, and are repeated over five random seeds to ensure robustness. Our results demonstrate that integrating graph structure consistently improves detection performance across transformer-only models and that supervised fine-tuning with relational context outperforms zero and few-shot approaches. Theoretical analysis reveals that modeling social connectivity and conversational context via graph augmentation sharpens the models' ability to identify key linguistic markers such as identity concealment, internalized stigma, and calls for support, suggesting that graph-enhanced transformers offer the most reliable foundation for digital health interventions and public health policy.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 14 of its 81 references that are in the map. First posted on arXiv 3 Sep 2025.

Builds on

14 of 81 references.

References · 14

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2020Longformer: The Long-Document Transformercited by 3,413
  6. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  7. 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 538
  8. 2018Graph Convolutional Networks for Text Classificationcited by 345
  9. 2021BertGCN: Transductive Text Classification by Combining GCN and BERTcited by 74
  10. 2022Detecting Harmful Online Conversational Content towards LGBTQIA+ Individualscited by 8
  11. 2025Pruning Strategies for Backdoor Defense in LLMscited by 5
  12. 2025Advancing Hate Speech Detection with Transformers: Insights from the MetaHatecited by 4
2 more
  1. 2024Predictive Insights into LGBTQ+ Minority Stress: A Transductive Exploration of Social Media Discoursecited by 3
  2. 2024Detecting LGBTQ+ Instances of Cyberbullyingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.