AVEC 2019 Workshop and Challenge: State-of-Mind, Detecting Depression with AI, and Cross-Cultural Affect Recognition
Not on the map. Why?
Abstract (arXiv)
The Audio/Visual Emotion Challenge and Workshop (AVEC 2019) "State-of-Mind, Detecting Depression with AI, and Cross-cultural Affect Recognition" is the ninth competition event aimed at the comparison of multimedia processing and machine learning methods for automatic audiovisual health and emotion analysis, with all participants competing strictly under the same conditions. The goal of the Challenge is to provide a common benchmark test set for multimodal information processing and to bring together the health and emotion recognition communities, as well as the audiovisual processing communities, to compare the relative merits of various approaches to health and emotion recognition from real-life data. This paper presents the major novelties introduced this year, the challenge guidelines, the data used, and the performance of the baseline systems on the three proposed tasks: state-of-mind recognition, depression assessment with AI, and cross-cultural affect sensing, respectively.
Key facts. Cited by 87 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 15; 2023: 6; 2024: 22; 2025: 17; 2026: 17.
87 papers.
Sort:
By area:
- 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
- 2022CubeMLP: An MLP-based Model for Multimodal Sentiment Analysis and Depression Estimationcited by 40
- 2023MER 2023: Multi-label Learning, Modality Robustness, and Semi-Supervised Learningcited by 33
- 2022COLD Fusion: Calibrated and Ordinal Latent Distribution Fusion for Uncertainty-Aware Multimodal Emotion Recognitioncited by 22
- 2022Continuous Emotion Recognition using Visual-audio-linguistic information: A Technical Report for ABAW3cited by 20
- 2021Affective Processes: stochastic modelling of temporal context for emotion and facial expression recognitioncited by 16
- 2021Continuous Emotion Recognition with Audio-visual Leader-follower Attentive Fusioncited by 15
- 2021Graph-based Facial Affect Analysis: A Reviewcited by 14
- 2024DepMamba: Progressive Fusion Mamba for Multimodal Depression Detectioncited by 14
- 2022GRATIS: Deep Learning Graph Representation with Task-specific Topology and Multi-dimensional Edge Featurescited by 12
- 2024HiQuE: Hierarchical Question Embedding Network for Multimodal Depression Detectioncited by 12
- 2024Explainable Artificial Intelligence for Medical Applications: A Reviewcited by 12
38 more
- 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cuescited by 11
- 2024Multi-scale Dynamic and Hierarchical Relationship Modeling for Facial Action Units Recognitioncited by 11
- 2021Two-stage Temporal Modelling Framework for Video-based Depression Recognition using Graph Representationcited by 10
- 2023MASA-TCN: Multi-anchor Space-aware Temporal Convolutional Neural Networks for Continuous and Discrete EEG Emotion Recognitioncited by 9
- 2022Artificial Intelligence for Suicide Assessment using Audiovisual Cues: A Reviewcited by 8
- 2023DEPAC: a Corpus for Depression and Anxiety Detection from Speechcited by 8
- 2025Enhancing Depression Detection with Chain-of-Thought Prompting: From Emotion to Reasoning Using Large Language Modelscited by 8
- 2022Continuous-Time Audiovisual Fusion with Recurrence vs. Attention for In-The-Wild Affect Recognitioncited by 7
- 2022Depression Diagnosis and Analysis via Multimodal Multi-order Factor Fusioncited by 7
- 2024Multimodal Machine Learning in Mental Health: A Survey of Data, Algorithms, and Challengescited by 7
- 2024Multimodal Gender Fairness in Depression Prediction: Insights on Data from the USA & Chinacited by 7
- 2024Underneath the Numbers: Quantitative and Qualitative Gender Fairness in LLMs for Depression Predictioncited by 6
- 2024DiagESC: Dialogue Synthesis for Integrating Depression Diagnosis into Emotional Support Conversationcited by 6
- 2024SynFER: Towards Boosting Facial Expression Recognition with Synthetic Datacited by 6
- 2025The First MPDD Challenge: Multimodal Personality-aware Depression Detectioncited by 6
- 2022Multi-Modal Learning for AU Detection Based on Multi-Head Fused Transformerscited by 5
- 2023Explainable Depression Detection via Head Motion Patternscited by 5
- 2024Depression Detection and Analysis using Large Language Models on Textual and Audio-Visual Modalitiescited by 5
- 2024Advancing Mental Health Pre-Screening: A New Custom GPT for Psychological Distress Assessmentcited by 5
- 2025OpenFace 3.0: A Lightweight Multitask System for Comprehensive Facial Behavior Analysiscited by 5
- 2022Are 3D Face Shapes Expressive Enough for Recognising Continuous Emotions and Action Unit Intensities?cited by 4
- 2024Computational Analysis of Stress, Depression and Engagement in Mental Health: A Surveycited by 4
- 2024Modeling Emotional Trajectories in Written Stories Utilizing Transformers and Weakly-Supervised Learningcited by 4
- 2024Leveraging Audio and Text Modalities in Mental Health: A Study of LLMs Performancecited by 4
- 2022Data Augmentation for Depression Detection Using Skeleton-Based Gait Informationcited by 3
- 2023Multitask learning for recognizing stress and depression in social mediacited by 3
- 2024Does the Definition of Difficulty Matter? Scoring Functions and their Role for Curriculum Learningcited by 3
- 2025Enhancing Depression Detection via Question-wise Modality Fusioncited by 3
- 2025Domain Adversarial Training for Mitigating Gender Bias in Speech-based Mental Health Detectioncited by 3
- 2025Large Language Models for Depression Recognition in Spoken Language Integrating Psychological Knowledgecited by 3
- 2025A Comprehensive Review of Datasets for Clinical Mental Health AI Systemscited by 3
- 2026Complementarity-Supervised Spectral-Band Routing for Multimodal Emotion Recognitioncited by 3
- 2021Predicting Mood Disorder Symptoms with Remotely Collected Videos Using an Interpretable Multimodal Dynamic Attention Fusion Networkcited by 2
- 2022Neural Architecture Searching for Facial Attributes-based Depression Recognitioncited by 2
- 2022Towards Intercultural Affect Recognition: Audio-Visual Affect Recognition in the Wild Across Six Culturescited by 2
- 2024Self-Supervised Embeddings for Detecting Individual Symptoms of Depressioncited by 2
- 2025Speech as a Multimodal Digital Phenotype for Multi-Task LLM-based Mental Health Predictioncited by 2
- 2025Automatic Depression Assessment using Machine Learning: A Comprehensive Surveycited by 2
50 most cited of 87 All 87 (JSON)
- 2026From Pattern Recognizers to Personalized Companions: A Survey of Large Language Models in Mental Health21 Sep 2026
- 2026DiaWhisper-DPO: Role-Attributed Transcription of Clinical Interviews via Failure-Mined Preference Optimization15 Sep 2026
- 2026TAMI: Temporally Aligned, Missingness-Aware, and Interpretable Multimodal Fusion for Mental Health Assessment in Older Adults with Mild Cognitive Impairment31 Aug 2026
- 2026DynaBridge: Dynamic Summary-Guided Cross-Task Multimodal Fusion for DASS-Structured Mental Health Assessment28 Jul 2026
- 2026Mental Health Disorder Detection Beyond Social Media: A Systematic Review of Available Datasets3 Jul 2026
- 2026Expresso-AI: Explainable Video-Based Deep Learning Models for Depression Diagnosis24 Jun 2026
- 2026Fine-tuning LLMs for Passive Depression Severity Estimation from AI Mental Health Dialogue16 Jun 2026
- 2026Dep-LLM: Training-Free Depression Diagnosis via Evidence-Guided Structured Multi-factor with Reliable LLM Reasoning9 Jun 2026
- 2026EmoTrack: Clinical-Semantic Modeling for Text-Based Depression Severity Estimation21 May 2026
- 2026A Multi-Probe Audit of Clinical-Interview Depression Detection Benchmarks13 May 2026
- 2026Entropy-Dominated Temporal Vocal Dynamics as Digital Biomarkers for Depression Detection29 Apr 2026
- 2026FAIR_XAI: Improving Multimodal Foundation Model Fairness via Explainability for Wellbeing Assessment26 Apr 2026
38 more
- 2026MA-DLE: Speech-based Automatic Depression Level Estimation via Memory Augmentation20 Apr 2026
- 2026Dynamic Summary Generation for Interpretable Multimodal Depression Detection13 Apr 2026
- 2026TAAC: A gate into Trustable Audio Affective Computing26 Mar 2026
- 2026Complementarity-Supervised Spectral-Band Routing for Multimodal Emotion Recognition7 Mar 2026
- 2026DepFlow: Disentangled Speech Generation to Mitigate Semantic Bias in Depression Detection1 Jan 2026
- 2025Retrieval-Augmented Multimodal Depression Detection29 Oct 2025
- 2025Tri-Modal Severity Fused Diagnosis across Depression and Post-traumatic Stress Disorders23 Oct 2025
- 2025Beyond Discrete Categories: Multi-Task Valence-Arousal Modeling for Pet Vocalization Analysis9 Oct 2025
- 2025Discrete Facial Encoding: : A Framework for Data-driven Facial Display Discovery2 Oct 2025
- 2025A Comprehensive Review of Datasets for Clinical Mental Health AI Systems13 Aug 2025
- 2025Automatic Depression Assessment using Machine Learning: A Comprehensive Survey9 Jun 2025
- 2025CAtCh: Cognitive Assessment through Cookie Thief7 Jun 2025
- 2025OpenFace 3.0: A Lightweight Multitask System for Comprehensive Facial Behavior Analysis3 Jun 2025
- 2025Speech as a Multimodal Digital Phenotype for Multi-Task LLM-based Mental Health Prediction28 May 2025
- 2025Large Language Models for Depression Recognition in Spoken Language Integrating Psychological Knowledge28 May 2025
- 2025Voice Quality Dimensions as Interpretable Primitives for Speaking Style for Atypical Speech and Affect27 May 2025
- 2025The First MPDD Challenge: Multimodal Personality-aware Depression Detection15 May 2025
- 2025Domain Adversarial Training for Mitigating Gender Bias in Speech-based Mental Health Detection6 May 2025
- 2025Affect Models Have Weak Generalizability to Atypical Speech22 Apr 2025
- 2025Leveraging Embedding Techniques in Multimodal Machine Learning for Mental Illness Assessment2 Apr 2025
- 2025Enhancing Depression Detection via Question-wise Modality Fusion26 Mar 2025
- 2025Enhancing Depression Detection with Chain-of-Thought Prompting: From Emotion to Reasoning Using Large Language Models9 Feb 2025
- 2024Toward Corpus Size Requirements for Training and Evaluating Depression Risk Models Using Spoken Language31 Dec 2024
- 2024Robust Speech and Natural Language Processing Models for Depression Screening26 Dec 2024
- 2024Cross-Demographic Portability of Deep NLP-Based Depression Models26 Dec 2024
- 2024Speech-Based Depression Prediction Using Encoder-Weight-Only Transfer Learning and a Large Corpus22 Dec 2024
- 2024Leveraging Audio and Text Modalities in Mental Health: A Study of LLMs Performance9 Dec 2024
- 2024Explainable Artificial Intelligence for Medical Applications: A Review15 Nov 2024
- 2024Does the Definition of Difficulty Matter? Scoring Functions and their Role for Curriculum Learning1 Nov 2024
- 2024SynFER: Towards Boosting Facial Expression Recognition with Synthetic Data13 Oct 2024
- 2024DepMamba: Progressive Fusion Mamba for Multimodal Depression Detection24 Sep 2024
- 2024DiagESC: Dialogue Synthesis for Integrating Depression Diagnosis into Emotional Support Conversation12 Aug 2024
- 2024Multimodal Gender Fairness in Depression Prediction: Insights on Data from the USA & China7 Aug 2024
- 2024HiQuE: Hierarchical Question Embedding Network for Multimodal Depression Detection7 Aug 2024
- 2024Advancing Mental Health Pre-Screening: A New Custom GPT for Psychological Distress Assessment3 Aug 2024
- 2024Multimodal Machine Learning in Mental Health: A Survey of Data, Algorithms, and Challenges23 Jul 2024
- 2024Depression Detection and Analysis using Large Language Models on Textual and Audio-Visual Modalities8 Jul 2024
- 2024Self-Supervised Embeddings for Detecting Individual Symptoms of Depression25 Jun 2024
50 newest of 87 All 87 (JSON)
- 2025Retrieval-Augmented Multimodal Depression Detectioncited by 0
- 2025Retrieval-Augmented Multimodal Depression Detection29 Oct 2025
- 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
- 2022CubeMLP: An MLP-based Model for Multimodal Sentiment Analysis and Depression Estimationcited by 40
- 2023MER 2023: Multi-label Learning, Modality Robustness, and Semi-Supervised Learningcited by 33
- 2022COLD Fusion: Calibrated and Ordinal Latent Distribution Fusion for Uncertainty-Aware Multimodal Emotion Recognitioncited by 22
- 2022Continuous Emotion Recognition using Visual-audio-linguistic information: A Technical Report for ABAW3cited by 20
- 2021Affective Processes: stochastic modelling of temporal context for emotion and facial expression recognitioncited by 16
- 2021Continuous Emotion Recognition with Audio-visual Leader-follower Attentive Fusioncited by 15
- 2021Graph-based Facial Affect Analysis: A Reviewcited by 14
- 2022GRATIS: Deep Learning Graph Representation with Task-specific Topology and Multi-dimensional Edge Featurescited by 12
- 2024HiQuE: Hierarchical Question Embedding Network for Multimodal Depression Detectioncited by 12
- 2024Explainable Artificial Intelligence for Medical Applications: A Reviewcited by 12
- 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cuescited by 11
12 most cited of 81 All 81 (JSON)
- 2026From Pattern Recognizers to Personalized Companions: A Survey of Large Language Models in Mental Health21 Sep 2026
- 2026TAMI: Temporally Aligned, Missingness-Aware, and Interpretable Multimodal Fusion for Mental Health Assessment in Older Adults with Mild Cognitive Impairment31 Aug 2026
- 2026DynaBridge: Dynamic Summary-Guided Cross-Task Multimodal Fusion for DASS-Structured Mental Health Assessment28 Jul 2026
- 2026Mental Health Disorder Detection Beyond Social Media: A Systematic Review of Available Datasets3 Jul 2026
- 2026Expresso-AI: Explainable Video-Based Deep Learning Models for Depression Diagnosis24 Jun 2026
- 2026Fine-tuning LLMs for Passive Depression Severity Estimation from AI Mental Health Dialogue16 Jun 2026
- 2026EmoTrack: Clinical-Semantic Modeling for Text-Based Depression Severity Estimation21 May 2026
- 2026A Multi-Probe Audit of Clinical-Interview Depression Detection Benchmarks13 May 2026
- 2026Entropy-Dominated Temporal Vocal Dynamics as Digital Biomarkers for Depression Detection29 Apr 2026
- 2026FAIR_XAI: Improving Multimodal Foundation Model Fairness via Explainability for Wellbeing Assessment26 Apr 2026
- 2026MA-DLE: Speech-based Automatic Depression Level Estimation via Memory Augmentation20 Apr 2026
- 2026Dynamic Summary Generation for Interpretable Multimodal Depression Detection13 Apr 2026
12 newest of 81 All 81 (JSON)