mlsanityData to 7 Oct 2026

DynaBridge: Dynamic Summary-Guided Cross-Task Multimodal Fusion for DASS-Structured Mental Health Assessment

arXiv 2607.25679 ↗First posted 28 Jul 2026cs.LG cs.AI cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Multimodal behavioral analysis offers a scalable approach to assessing depression, anxiety, and stress, yet generic fusion models often ignore the psychometric structure of questionnaire labels. In DASS-21, risk labels are derived from ordered symptom items through fixed item-to-subscale mappings. We propose DynaBridge, a dynamic summary-guided cross-task multimodal framework for DASS-structured mental health assessment. DynaBridge encodes acoustic, visual, and textual cues across multiple sessions and augments them with frozen-LLM-generated DASS-aware summaries as participant-level semantic evidence. It predicts ordinal item distributions, reconstructs depression, anxiety, and stress risk evidence from item-level soft scores, and fuses this evidence with direct multimodal risk predictions. A confidence-aware refinement strategy further incorporates high-confidence semantic cues conservatively. On the official AdoDAS validation split, DynaBridge outperforms the official baseline and representative multimodal methods, achieving 0.5012 mean F1 for D/A/S risk prediction and 0.3216 mean QWK for DASS-21 item prediction. These results show the value of bridging multimodal cues, semantic summaries, and DASS-21 psychometric structure.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 31 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

13 of 31 references.

References · 13

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  5. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  6. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  7. 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 429
  8. 2018Efficient Low-rank Multimodal Fusion with Modality-Specific Factorscited by 268
  9. 2020MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysiscited by 262
  10. 2019AVEC 2019 Workshop and Challenge: State-of-Mind, Detecting Depression with AI, and Cross-Cultural Affect Recognitioncited by 87
  11. 2022CubeMLP: An MLP-based Model for Multimodal Sentiment Analysis and Depression Estimationcited by 39
  12. 2019The Verbal and Non Verbal Signals of Depression -- Combining Acoustics, Text and Visuals for Estimating Depression Levelcited by 3
1 more
  1. 2026Dynamic Summary Generation for Interpretable Multimodal Depression Detectioncited by 1

Built on by

Not cited yet.