Topic Modeling Based Multi-modal Depression Detection
Not on the map. Why?
Abstract (arXiv)
Major depressive disorder is a common mental disorder that affects almost 7% of the adult U.S. population. The 2017 Audio/Visual Emotion Challenge (AVEC) asks participants to build a model to predict depression levels based on the audio, video, and text of an interview ranging between 7-33 minutes. Since averaging features over the entire interview will lose most temporal information, how to discover, capture, and preserve useful temporal details for such a long interview are significant challenges. Therefore, we propose a novel topic modeling based approach to perform context-aware analysis of the recording. Our experiments show that the proposed approach outperforms context-unaware methods and the challenge baselines for all metrics.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 4; 2024: 9; 2025: 7; 2026: 3.
29 papers.
Sort:
By area:
- 2022Automatic Depression Detection: An Emotional Audio-Textual Corpus and a GRU/BiLSTM-based Modelcited by 37
- 2023Self-supervised representations in speech-based depression detectioncited by 18
- 2024When LLMs Meets Acoustic Landmarks: An Efficient Approach to Integrate Speech into Large Language Models for Depression Detectioncited by 16
- 2022Multi-modal Depression Estimation based on Sub-attentional Fusioncited by 15
- 2024Synthetic Data Generation with LLM for Improved Depression Predictioncited by 13
- 2024HiQuE: Hierarchical Question Embedding Network for Multimodal Depression Detectioncited by 12
- 2025U-Fair: Uncertainty-based Multimodal Multitask Learning for Fairer Depression Detectioncited by 12
- 2021Two-stage Temporal Modelling Framework for Video-based Depression Recognition using Graph Representationcited by 10
- 2023Affect Recognition in Conversations Using Large Language Modelscited by 9
- 2024MoodCapture: Depression Detection Using In-the-Wild Smartphone Imagescited by 8
- 2022Automatic Depression Detection via Learning and Fusing Features from Visual Cuescited by 5
- 2024Context-Aware Deep Learning for Multi Modal Depression Detectioncited by 4
17 more
- 2022Neural Architecture Searching for Facial Attributes-based Depression Recognitioncited by 2
- 2023Discovering Mental Health Research Topics with Topic Modelingcited by 2
- 2024Confidence Estimation for Automatic Detection of Depression and Alzheimer's Disease Based on Clinical Interviewscited by 2
- 2025Predicting Depression in Screening Interviews from Interactive Multi-Theme Collaborationcited by 2
- 2022Integration of Text and Graph-based Features for Detecting Mental Health Disorders from Voicecited by 1
- 2023Cost-effective Models for Detecting Depression from Speechcited by 1
- 2024CANAMRF: An Attention-Based Model for Multimodal Depression Detectioncited by 1
- 2024A BERT-Based Summarization approach for depression detectioncited by 1
- 2024Improving Speech-based Emotion Recognition with Contextual Utterance Analysis and LLMscited by 1
- 2025Explainable Multimodal Depression Recognition in Clinical Interviews via PHQ-Aligned Symptom Summarizationcited by 1
- 2025Uncertainty Modeling in Multimodal Speech Analysis Across the Psychosis Spectrumcited by 1
- 2025Automatic Depression Assessment using Machine Learning: A Comprehensive Surveycited by 1
- 2025Probabilistic Textual Time Series Depression Detectioncited by 1
- 2026Dep-LLM: Training-Free Depression Diagnosis via Evidence-Guided Structured Multi-factor with Reliable LLM Reasoningcited by 1
- 2025Enhancing BERTopic with Intermediate Layer Representationscited by 0
- 2026Can Conversational Temporal Dynamics Improve Depression Detection in Dyads? A Preliminary Investigation in Multi-Modality Perspectivescited by 0
- 2026DiaWhisper-DPO: Role-Attributed Transcription of Clinical Interviews via Failure-Mined Preference Optimizationcited by 0
- 2026DiaWhisper-DPO: Role-Attributed Transcription of Clinical Interviews via Failure-Mined Preference Optimization15 Sep 2026
- 2026Can Conversational Temporal Dynamics Improve Depression Detection in Dyads? A Preliminary Investigation in Multi-Modality Perspectives4 Jul 2026
- 2026Dep-LLM: Training-Free Depression Diagnosis via Evidence-Guided Structured Multi-factor with Reliable LLM Reasoning9 Jun 2026
- 2025Probabilistic Textual Time Series Depression Detection6 Nov 2025
- 2025Automatic Depression Assessment using Machine Learning: A Comprehensive Survey9 Jun 2025
- 2025Enhancing BERTopic with Intermediate Layer Representations10 May 2025
- 2025Uncertainty Modeling in Multimodal Speech Analysis Across the Psychosis Spectrum25 Feb 2025
- 2025Predicting Depression in Screening Interviews from Interactive Multi-Theme Collaboration16 Feb 2025
- 2025Explainable Multimodal Depression Recognition in Clinical Interviews via PHQ-Aligned Symptom Summarization27 Jan 2025
- 2025U-Fair: Uncertainty-based Multimodal Multitask Learning for Fairer Depression Detection16 Jan 2025
- 2024Context-Aware Deep Learning for Multi Modal Depression Detection26 Dec 2024
- 2024Synthetic Data Generation with LLM for Improved Depression Prediction26 Nov 2024
17 more
- 2024Improving Speech-based Emotion Recognition with Contextual Utterance Analysis and LLMs27 Oct 2024
- 2024A BERT-Based Summarization approach for depression detection13 Sep 2024
- 2024HiQuE: Hierarchical Question Embedding Network for Multimodal Depression Detection7 Aug 2024
- 2024Confidence Estimation for Automatic Detection of Depression and Alzheimer's Disease Based on Clinical Interviews29 Jul 2024
- 2024MoodCapture: Depression Detection Using In-the-Wild Smartphone Images25 Feb 2024
- 2024When LLMs Meets Acoustic Landmarks: An Efficient Approach to Integrate Speech into Large Language Models for Depression Detection17 Feb 2024
- 2024CANAMRF: An Attention-Based Model for Multimodal Depression Detection4 Jan 2024
- 2023Affect Recognition in Conversations Using Large Language Models22 Sep 2023
- 2023Discovering Mental Health Research Topics with Topic Modeling25 Aug 2023
- 2023Self-supervised representations in speech-based depression detection20 May 2023
- 2023Cost-effective Models for Detecting Depression from Speech18 Feb 2023
- 2022Multi-modal Depression Estimation based on Sub-attentional Fusion13 Jul 2022
- 2022Integration of Text and Graph-based Features for Detecting Mental Health Disorders from Voice14 May 2022
- 2022Automatic Depression Detection via Learning and Fusing Features from Visual Cues1 Mar 2022
- 2022Automatic Depression Detection: An Emotional Audio-Textual Corpus and a GRU/BiLSTM-based Model15 Feb 2022
- 2022Neural Architecture Searching for Facial Attributes-based Depression Recognition24 Jan 2022
- 2021Two-stage Temporal Modelling Framework for Video-based Depression Recognition using Graph Representation30 Nov 2021
- 2022Automatic Depression Detection: An Emotional Audio-Textual Corpus and a GRU/BiLSTM-based Modelcited by 37
- 2023Self-supervised representations in speech-based depression detectioncited by 18
- 2024When LLMs Meets Acoustic Landmarks: An Efficient Approach to Integrate Speech into Large Language Models for Depression Detectioncited by 16
- 2022Multi-modal Depression Estimation based on Sub-attentional Fusioncited by 15
- 2024HiQuE: Hierarchical Question Embedding Network for Multimodal Depression Detectioncited by 12
- 2025U-Fair: Uncertainty-based Multimodal Multitask Learning for Fairer Depression Detectioncited by 12
- 2021Two-stage Temporal Modelling Framework for Video-based Depression Recognition using Graph Representationcited by 10
- 2023Affect Recognition in Conversations Using Large Language Modelscited by 9
- 2024MoodCapture: Depression Detection Using In-the-Wild Smartphone Imagescited by 8
- 2022Automatic Depression Detection via Learning and Fusing Features from Visual Cuescited by 5
- 2024Context-Aware Deep Learning for Multi Modal Depression Detectioncited by 4
- 2022Neural Architecture Searching for Facial Attributes-based Depression Recognitioncited by 2
12 most cited of 26 All 26 (JSON)
- 2026Can Conversational Temporal Dynamics Improve Depression Detection in Dyads? A Preliminary Investigation in Multi-Modality Perspectives4 Jul 2026
- 2025Probabilistic Textual Time Series Depression Detection6 Nov 2025
- 2025Automatic Depression Assessment using Machine Learning: A Comprehensive Survey9 Jun 2025
- 2025Enhancing BERTopic with Intermediate Layer Representations10 May 2025
- 2025Uncertainty Modeling in Multimodal Speech Analysis Across the Psychosis Spectrum25 Feb 2025
- 2025Predicting Depression in Screening Interviews from Interactive Multi-Theme Collaboration16 Feb 2025
- 2025Explainable Multimodal Depression Recognition in Clinical Interviews via PHQ-Aligned Symptom Summarization27 Jan 2025
- 2025U-Fair: Uncertainty-based Multimodal Multitask Learning for Fairer Depression Detection16 Jan 2025
- 2024Context-Aware Deep Learning for Multi Modal Depression Detection26 Dec 2024
- 2024Improving Speech-based Emotion Recognition with Contextual Utterance Analysis and LLMs27 Oct 2024
- 2024A BERT-Based Summarization approach for depression detection13 Sep 2024
- 2024HiQuE: Hierarchical Question Embedding Network for Multimodal Depression Detection7 Aug 2024
12 newest of 26 All 26 (JSON)