mlsanityData to 14 Oct 2026

IDRL: An Individual-Aware Multimodal Depression-Related Representation Learning Framework for Depression Diagnosis

arXiv 2603.11644 ↗First posted 12 Mar 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Depression is a severe mental disorder, and reliable identification plays a critical role in early intervention and treatment. Multimodal depression detection aims to improve diagnostic performance by jointly modeling complementary information from multiple modalities. Recently, numerous multimodal learning approaches have been proposed for depression analysis; however, these methods suffer from the following limitations: 1) inter-modal inconsistency and depression-unrelated interference, where depression-related cues may conflict across modalities while substantial irrelevant content obscures critical depressive signals, and 2) diverse individual depressive presentations, leading to individual differences in modality and cue importance that hinder reliable fusion. To address these issues, we propose Individual-aware Multimodal Depression-related Representation Learning Framework (IDRL) for robust depression diagnosis. Specifically, IDRL 1) disentangles multimodal representations into a modality-common depression space, a modality-specific depression space, and a depression-unrelated space to enhance modality alignment while suppressing irrelevant information, and 2) introduces an individual-aware modality-fusion module (IAF) that dynamically adjusts the weights of disentangled depression-related features based on their predictive significance, thereby achieving adaptive cross-modal fusion for different individuals. Extensive experiments demonstrate that IDRL achieves superior and robust performance for multimodal depression detection.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 33 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

8 of 33 references.

References · 8

  1. 2020MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysiscited by 265
  2. 2017Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learningcited by 192
  3. 2021EmoBERTa: Speaker-Aware Emotion Recognition in Conversation with RoBERTacited by 60
  4. 2023It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformerscited by 18
  5. 2022Multi-modal Depression Estimation based on Sub-attentional Fusioncited by 15
  6. 2024FacialPulse: An Efficient RNN-based Depression Detection via Temporal Facial Landmarkscited by 9
  7. 2021On the Role of Images for Analyzing Claims in Social Mediacited by 6
  8. 2024Triple Disentangled Representation Learning for Multimodal Affective Analysiscited by 4

Built on by

Not cited yet.