mlsanityData to 14 Oct 2026

DreamerNLplus: Interpretable Modeling of Mental Health Dynamics from Social Media Timelines using Hybrid Rule-Based and RAG Methods

arXiv 2605.23052 ↗First posted 21 May 2026cs.CL cs.AIcited by 0

On the map: Retrieval-augmented generation → Medical and biomedical RAG

Abstract (arXiv)

We present DreamerNLplus, a hybrid framework for modeling mental health dynamics from social media timelines in the CLPsych 2026 shared task. Our system addresses three tasks: psychological state modeling, temporal change detection, and sequence-level summarization. For Task 1, we combine LLM-based data augmentation, DeBERTa classification, and Random Forest regression for structured state prediction. For Task 2, we use few-shot prompting with a locally deployed Llama 3.1 model to detect Switch and Escalation events using short-term temporal context. For Task 3.1, we explore both a deterministic rule-based summarization pipeline and a few-shot LLM-based approach, ranking 2nd officially. Our RAG-based method achieves strong performance in Task 3.2, ranking 1st for Improvement and 3rd for Deterioration, demonstrating its ability to capture recurrent psychological change patterns across timelines. Our analysis reveals key challenges, including the mismatch between classification and regression performance, the difficulty of modeling temporal transitions, and the disagreement between semantic and similarity-based evaluation metrics. These findings highlight the complexity of modeling mental health dynamics and motivate future work on unified evaluation frameworks. We share our code and prompts at https://github.com/4dpicture/CLPsych2026

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and biomedical RAG, one of 15 directions in Retrieval-augmented generation. Builds on 3 of its 16 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

3 of 16 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025A Systematic Evaluation of LLM Strategies for Mental Health Text Analysis: Fine-tuning vs. Prompt Engineering vs. RAG31 Mar

Other references · 2

  1. 2025MaLei at MultiClinSUM: Summarisation of Clinical Documents using Perspective-Aware Iterative Self-Prompting with LLMscited by 6
  2. 2025Dutch Metaphor Extraction from Cancer Patients' Interviews and Forum Data using LLMs and Human in the Loopcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Survey and Experiments on Mental Disorder Detection via Social Media: From Large Language Models and RAG to Agents
  2. 2025A Baseline for Self-state Identification and Classification in Mental Health Data: CLPsych 2025 Task
  3. 2023Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data
  4. 2025Cognitive-Mental-LLM: Evaluating Reasoning in Large Language Models for Mental Health Prediction via Online Text
  5. 2023Towards Interpretable Mental Health Analysis with Large Language Models
  6. 2025Navigating through the hidden embedding space: steering LLMs to improve mental health assessment
  7. 2023MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Models
  8. 2026A Comparative Study of Traditional Machine Learning, Deep Learning, and Large Language Models for Mental Health Forecasting using Smartphone Sensing Data