mlsanityData to 7 Oct 2026

WPG-MoE: Weak-Prior-Guided Dense Mixture-of-Experts for User-Level Social Media Depression Detection

arXiv 2607.04350 ↗First posted 5 Jul 2026cs.CLcited by 0

On the map: Mixture-of-experts → Multimodal MoE models

Abstract (arXiv)

Online social media posts provide scalable signals for early depression screening, and recent studies mainly improve pre-classification evidence through risk-post selection, symptom grounding, and clinically informed feature construction. However, these screening-stage designs often leave final decisions to a single detector, overlooking how users heterogeneously express depressive risk after screening. A monolithic classifier must average across heterogeneous users, which may dilute localized evidence and cause misclassification, especially for non-self-disclosing users. To address this issue, we propose WPG-MoE, a weak-prior-guided dense mixture-of-experts framework built on a shared large language model (LLM) backbone. WPG-MoE derives user-level weak semantic priors to softly route users to experts matched to different evidence layouts. We formulate this process as learning using privileged information (LUPI): rich LLM-extracted structured evidence guides training-time routing, while inference retains only Patient Health Questionnaire-9 (PHQ-9) template screening and the deployable backbone. Experiments on Chinese and English datasets show that WPG-MoE outperforms strong baselines with interpretable routing behavior.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal MoE models, one of 12 directions in Mixture-of-experts. Builds on 25 of its 67 references that are in the map. First posted on arXiv 5 Jul 2026.

Builds on

25 of 67 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  3. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  4. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  5. 2015Unifying distillation and privileged informationcited by 218
  6. 2017Depression and Self-Harm Risk Assessment in Online Forumscited by 81
  7. 2023ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferencescited by 43
  8. 2018Utilizing Neural Networks and Linguistic Metadata for Early Detection of Depression Indications in Text Sequencescited by 36
  9. 2022Improving the Generalizability of Depression Detection by Leveraging Clinical Questionnairescited by 26
  10. 2018Topic Memory Networks for Short Text Classificationcited by 25
  11. 2020Identifying Depressive Symptoms from Tweets: Figurative Language Enabled Multitask Learning Frameworkcited by 25
  12. 2020Named Entity Recognition for Social Media Texts with Semantic Augmentationcited by 23
13 more
  1. 2024medIKAL: Integrating Knowledge Graphs as Assistants of LLMs for Enhanced Clinical Diagnosis on EMRscited by 16
  2. 2013Learning Using Privileged Information: SVM+ and Weighted SVMcited by 13
  3. 2021DepressionNet: A Novel Summarization Boosted Deep Framework for Depression Detection on Social Mediacited by 10
  4. 2022Psychiatric Scale Guided Risky Post Screening for Early Detection of Depressioncited by 10
  5. 2025Are LLMs effective psychological assessors? Leveraging adaptive RAG for interpretable mental health screening through psychometric practicecited by 10
  6. 2018RSDD-Time: Temporal Annotation of Self-Reported Mental Health Diagnosescited by 9
  7. 2025Interpretable Depression Detection from Social Media Text Using LLM-Derived Embeddingscited by 6
  8. 2025Datasets for Depression Modeling in Social Media: An Overviewcited by 5
  9. 2022Then and Now: Quantifying the Longitudinal Validity of Self-Disclosed Depression Diagnosescited by 4
  10. 2025A Gold Standard Dataset and Evaluation Framework for Depression Detection and Explanation in Social Media using LLMscited by 4
  11. 2023Hashtag-Guided Low-Resource Tweet Classificationcited by 3
  12. 2025ReDepress: A Cognitive Framework for Detecting Depression Relapse from Social Mediacited by 2
  13. 2025CNSocialDepress: A Chinese Social Media Dataset for Depression Risk Detection and Structured Analysiscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024They Look Like Each Other: Case-based Reasoning for Explainable Depression Detection on Twitter using Large Language Models
  2. 2025Explainable Depression Detection in Clinical Interviews with Personalized Retrieval-Augmented Generation
  3. 2025Enhancing Depression Detection with Chain-of-Thought Prompting: From Emotion to Reasoning Using Large Language Models
  4. 2026Dep-LLM: Training-Free Depression Diagnosis via Evidence-Guided Structured Multi-factor with Reliable LLM Reasoning
  5. 2025Mixture of Experts for Recognizing Depression from Interview and Reading Tasks
  6. 2026DepressionAgent: Reading, Listening, Seeing, and Deliberating Multimodal Evidence for Depression Risk Assessment
  7. 2026K-SENSE: A Knowledge-Guided Self-Augmented Encoder for Neuro-Semantic Evaluation of Mental Health Conditions on Social Media
  8. 2026Snugi-AI-v2 @ eRisk 2026 Task 2: Early Depression Detection via a Learned Stopping Policy with Sustained Confidence Gate