mlsanityData to 14 Oct 2026

HiPAD: A Unified Gait, Audio-Visual, and Personality Fusion Network for Depression Detection, with a Hierarchical Personality Ablation and the Calibration Limits of Domain-Adapted LLMs

arXiv 2610.14961 ↗First posted 10 Oct 2026cs.LG cs.CL cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present HiPAD, a single fusion network submitted to all six sub-tracks of the MPDD-AVG 2026 depression-detection challenge, covering the Elder and Young cohorts and three modality sets (gait, audio-visual, and both), each combined with personality descriptions. The network encodes each available modality with a shared BiLSTM, zero-pads absent modalities, and applies cross-modal attention only when at least two of gait, audio and video are present. Personality, which dominates our results, is kept out of the attention and fused by concatenation. Because the architecture is identical in every sub-track, differences between them reflect the data rather than the model, and we use this to study three questions. Our main finding is that the personality description, roughly 150 tokens about who the subject is, carries more depression signal than audio, video, and gait combined: gait plus personality alone (TLS 0.647) beats every configuration that includes audio and video. First, a four-level ablation of the personality description (L0-L3) quantifies this: removing every personality-derived feature, including the Big Five scores that earlier MPDD ablations keep, lowers the Track-Level Score by 0.499 to 0.507 and leaves the model at chance. Second, domain-adapting the personality encoder with LoRA (7B) or QLoRA (72B) on PHQ-8/9 data raises binary Cohen's kappa by 0.13 but lowers the overall score by distorting the PHQ-9 regression; a frozen RoBERTa-large encoder does better at this sample size. Third, at fixed architecture, handcrafted clinical features (eGeMAPS, OpenFace action units) outperform generic deep features (wav2vec2, DenseNet) on the audio-visual tracks. The unified system reaches a cross-track G-Score of 0.482; with under 100 subjects per cohort, the limiting factors are the size of the representation and the calibration of the outputs, not the choice of architecture.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 38 references that are in the map. First posted on arXiv 10 Oct 2026.

Builds on

10 of 38 references.

References · 10

  1. 2016Densely Connected Convolutional Networkscited by 6,720
  2. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2017Depression and Self-Harm Risk Assessment in Online Forumscited by 84
  5. 2023On the Calibration of Large Language Models and Alignmentcited by 73
  6. 2019Automated speech-based screening of depression using deep convolutional neural networkscited by 8
  7. 2025The First MPDD Challenge: Multimodal Personality-aware Depression Detectioncited by 6
  8. 2025Automatic Depression Assessment using Machine Learning: A Comprehensive Surveycited by 2
  9. 2025Personality-guided Public-Private Domain Disentangled Hypergraph-Former Network for Multimodal Depression Detectioncited by 2
  10. 2025Personality-Enhanced Multimodal Depression Detection in the Elderlycited by 1

Built on by

Not cited yet.