WPG-MoE: Weak-Prior-Guided Dense Mixture-of-Experts for User-Level Social Media Depression Detection
On the map: Mixture-of-experts → Multimodal MoE models
Abstract (arXiv)
Online social media posts provide scalable signals for early depression screening, and recent studies mainly improve pre-classification evidence through risk-post selection, symptom grounding, and clinically informed feature construction. However, these screening-stage designs often leave final decisions to a single detector, overlooking how users heterogeneously express depressive risk after screening. A monolithic classifier must average across heterogeneous users, which may dilute localized evidence and cause misclassification, especially for non-self-disclosing users. To address this issue, we propose WPG-MoE, a weak-prior-guided dense mixture-of-experts framework built on a shared large language model (LLM) backbone. WPG-MoE derives user-level weak semantic priors to softly route users to experts matched to different evidence layouts. We formulate this process as learning using privileged information (LUPI): rich LLM-extracted structured evidence guides training-time routing, while inference retains only Patient Health Questionnaire-9 (PHQ-9) template screening and the deployable backbone. Experiments on Chinese and English datasets show that WPG-MoE outperforms strong baselines with interpretable routing behavior.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal MoE models, one of 12 directions in Mixture-of-experts. Builds on 25 of its 67 references that are in the map. First posted on arXiv 5 Jul 2026.
Builds on
25 of 67 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2015Unifying distillation and privileged informationcited by 218
- 2017Depression and Self-Harm Risk Assessment in Online Forumscited by 81
- 2023ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferencescited by 43
- 2018Utilizing Neural Networks and Linguistic Metadata for Early Detection of Depression Indications in Text Sequencescited by 36
- 2022Improving the Generalizability of Depression Detection by Leveraging Clinical Questionnairescited by 26
- 2018Topic Memory Networks for Short Text Classificationcited by 25
- 2020Identifying Depressive Symptoms from Tweets: Figurative Language Enabled Multitask Learning Frameworkcited by 25
- 2020Named Entity Recognition for Social Media Texts with Semantic Augmentationcited by 23
13 more
- 2024medIKAL: Integrating Knowledge Graphs as Assistants of LLMs for Enhanced Clinical Diagnosis on EMRscited by 16
- 2013Learning Using Privileged Information: SVM+ and Weighted SVMcited by 13
- 2021DepressionNet: A Novel Summarization Boosted Deep Framework for Depression Detection on Social Mediacited by 10
- 2022Psychiatric Scale Guided Risky Post Screening for Early Detection of Depressioncited by 10
- 2025Are LLMs effective psychological assessors? Leveraging adaptive RAG for interpretable mental health screening through psychometric practicecited by 10
- 2018RSDD-Time: Temporal Annotation of Self-Reported Mental Health Diagnosescited by 9
- 2025Interpretable Depression Detection from Social Media Text Using LLM-Derived Embeddingscited by 6
- 2025Datasets for Depression Modeling in Social Media: An Overviewcited by 5
- 2022Then and Now: Quantifying the Longitudinal Validity of Self-Disclosed Depression Diagnosescited by 4
- 2025A Gold Standard Dataset and Evaluation Framework for Depression Detection and Explanation in Social Media using LLMscited by 4
- 2023Hashtag-Guided Low-Resource Tweet Classificationcited by 3
- 2025ReDepress: A Cognitive Framework for Detecting Depression Relapse from Social Mediacited by 2
- 2025CNSocialDepress: A Chinese Social Media Dataset for Depression Risk Detection and Structured Analysiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024They Look Like Each Other: Case-based Reasoning for Explainable Depression Detection on Twitter using Large Language Models
- 2025Explainable Depression Detection in Clinical Interviews with Personalized Retrieval-Augmented Generation
- 2025Enhancing Depression Detection with Chain-of-Thought Prompting: From Emotion to Reasoning Using Large Language Models
- 2026Dep-LLM: Training-Free Depression Diagnosis via Evidence-Guided Structured Multi-factor with Reliable LLM Reasoning
- 2025Mixture of Experts for Recognizing Depression from Interview and Reading Tasks
- 2026DepressionAgent: Reading, Listening, Seeing, and Deliberating Multimodal Evidence for Depression Risk Assessment
- 2026K-SENSE: A Knowledge-Guided Self-Augmented Encoder for Neuro-Semantic Evaluation of Mental Health Conditions on Social Media
- 2026Snugi-AI-v2 @ eRisk 2026 Task 2: Early Depression Detection via a Learned Stopping Policy with Sustained Confidence Gate