mlsanityData to 14 Oct 2026

7th ABAW Competition: Multi-Task Learning and Compound Expression Recognition

arXiv 2407.03835 ↗First posted 4 Jul 2024cs.CVcited by 53

Not on the map. Why?

Abstract (arXiv)

This paper describes the 7th Affective Behavior Analysis in-the-wild (ABAW) Competition, which is part of the respective Workshop held in conjunction with ECCV 2024. The 7th ABAW Competition addresses novel challenges in understanding human expressions and behaviors, crucial for the development of human-centered technologies. The Competition comprises of two sub-challenges: i) Multi-Task Learning (the goal is to learn at the same time, in a multi-task learning setting, to estimate two continuous affect dimensions, valence and arousal, to recognise between the mutually exclusive classes of the 7 basic expressions and 'other'), and to detect 12 Action Units); and ii) Compound Expression Recognition (the target is to recognise between the 7 mutually exclusive compound expression classes). s-Aff-Wild2, which is a static version of the A/V Aff-Wild2 database and contains annotations for valence-arousal, expressions and Action Units, is utilized for the purposes of the Multi-Task Learning Challenge; a part of C-EXPR-DB, which is an A/V in-the-wild database with compound expression annotations, is utilized for the purposes of the Compound Expression Recognition Challenge. In this paper, we introduce the two challenges, detailing their datasets and the protocols followed for each. We also outline the evaluation metrics, and highlight the baseline systems and their results. Additional information about the competition can be found at urlhttps://affective-behavior-analysis-in-the-wild.github.io/7th.

Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 100 of its 128 references that are in the map. First posted on arXiv 4 Jul 2024.

Builds on

100 of 128 references.

References · 100

  1. 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
  2. 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
  3. 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
  4. 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
  5. 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
  6. 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
  7. 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
  8. 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
  9. 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
  10. 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
  11. 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyondcited by 60
  12. 2020Two-Stream Aural-Visual Affect Analysis in the Wildcited by 51
38 more
  1. 2022Transformer-based Multimodal Information Fusion for Facial Expression Analysiscited by 49
  2. 2019Exploiting multi-CNN features in CNN-RNN based Dimensional Emotion Recognition on the OMG in-the-wild Datasetcited by 39
  3. 2020Multitask Emotion Recognition with Incomplete Labelscited by 39
  4. 2023A Deep Neural Architecture for Harmonizing 3-D Input Data Analysis and Decision Making in Medical Imagingcited by 39
  5. 2022A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognitioncited by 34
  6. 2018Photorealistic Facial Synthesis in the Dimensional Affect Spacecited by 33
  7. 2022MixAugment & Mixup: Augmentation Methods for Facial Expression Recognitioncited by 31
  8. 2024Domain adaptation, Explainability & Fairness in AI for Medical Image Analysis: Diagnosis of COVID-19 based on 3-D Chest CT-scanscited by 30
  9. 2021A Multi-modal and Multi-task Learning Method for Action Unit and Expression Recognitioncited by 24
  10. 2024COVID-19 Computer-aided Diagnosis through AI-assisted CT Imaging Analysis: Deploying a Medical AI Systemcited by 23
  11. 2018Training Deep Neural Networks with Different Datasets In-the-wild: The Emotion Recognition Paradigmcited by 20
  12. 2022Continuous Emotion Recognition using Visual-audio-linguistic information: A Technical Report for ABAW3cited by 20
  13. 2023BTDNet: a Multi-Modal Approach for Brain Tumor Radiogenomic Classificationcited by 20
  14. 2021A Multi-task Mean Teacher for Semi-supervised Facial Affective Behavior Analysiscited by 19
  15. 2021Prior Aided Streaming Network for Multi-task Affective Recognitionat the 2nd ABAW2 Competitioncited by 18
  16. 2024Affective Behaviour Analysis via Integrating Multi-Modal Knowledgecited by 18
  17. 2022Coarse-to-Fine Cascaded Networks with Smooth Predicting for Video Facial Expression Recognitioncited by 17
  18. 2017Incremental Boosting Convolutional Neural Network for Facial Action Unit Recognitioncited by 16
  19. 2022Frame-level Prediction of Facial Expressions, Valence, Arousal and Action Units for Mobile Devicescited by 16
  20. 2023MMA-MRNNet: Harnessing Multiple Models of Affect and Dynamic Masked RNN for Precise Facial Expression Intensity Estimationcited by 16
  21. 2024Robust Light-Weight Facial Affective Behavior Recognition with CLIPcited by 16
  22. 2018A Multi-component CNN-RNN Approach for Dimensional Emotion Recognition in-the-wildcited by 15
  23. 2022Multi-modal Emotion Estimation for in-the-wild Videoscited by 15
  24. 2024Recursive Joint Cross-Modal Attention for Multimodal Fusion in Dimensional Emotion Recognitioncited by 15
  25. 2020M3T: Multi-Modal Continuous Valence-Arousal Estimation in the Wildcited by 14
  26. 2023Multimodal Continuous Emotion Recognition: A Technical Report for ABAW5cited by 14
  27. 2024Uncertainty-guided Contrastive Learning for Single Source Domain Generalisationcited by 14
  28. 2020Affect Expression Behaviour Analysis in the Wild using Spatio-Channel Attention and Complementary Context Informationcited by 13
  29. 2021An audiovisual and contextual approach for categorical and continuous emotion recognition in-the-wildcited by 12
  30. 2021Multitask Multi-database Emotion Recognitioncited by 12
  31. 2024Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimationcited by 11
  32. 2022Facial Action Unit Recognition With Multi-models Ensemblingcited by 10
  33. 2022Multi-modal Multi-label Facial Action Unit Detection with Transformercited by 10
  34. 2022Facial Affect Analysis: Learning from Synthetic Data & Multi-Task Learning Challengescited by 10
  35. 2022Affective Behaviour Analysis Using Pretrained Model with Facial Prioricited by 10
  36. 2022Multi-label Transformer for Action Unit Detectioncited by 9
  37. 2022Multiple Emotion Descriptors Estimation at the ABAW3 Challengecited by 9
  38. 2022An Ensemble Approach for Facial Expression Analysis in Videocited by 9

50 most cited of 100 All 100 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 15; 2025: 21; 2026: 17.

53 papers.

Sort:

By area:

  1. 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkitcited by 16
  2. 2025HSEmotion Team at ABAW-8 Competition: Audiovisual Ambivalence/Hesitancy, Emotional Mimicry Intensity and Facial Expression Recognitioncited by 15
  3. 2024SAM2CLIP2SAM: Vision Language Model for Segmentation of 3D CT Scans for Covid-19 Detectioncited by 14
  4. 2025DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarioscited by 13
  5. 2024Textualized and Feature-based Models for Compound Multimodal Emotion Recognition in the Wildcited by 9
  6. 2024Affective Behavior Analysis using Task-adaptive and AU-assisted Graph Networkcited by 8
  7. 2024Enhancing Facial Expression Recognition through Dual-Direction Attention Mixed Feature Networks: Application to 7th ABAW Challengecited by 8
  8. 2025MAVEN: Multi-modal Attention for Valence-Arousal Emotion Networkcited by 8
  9. 2024Affective Behaviour Analysis via Progressive Learningcited by 7
  10. 2024Rethinking Affect Analysis: A Protocol for Ensuring Fairness and Consistencycited by 7
  11. 2024HSEmotion Team at the 7th ABAW Challenge: Multi-Task Learning and Compound Facial Expression Recognitioncited by 6
  12. 2024Ig3D: Integrating 3D Face Representations in Facial Expression Inferencecited by 6
38 more
  1. 2024Using Prompts to Guide Large Language Models in Imitating a Real Person's Language Stylecited by 6
  2. 2025Emotion Recognition with CLIP and Sequential Learningcited by 6
  3. 2025Mamba-VA: A Mamba-based Approach for Continuous Emotion Recognition in Valence-Arousal Spacecited by 6
  4. 2025Semantic Matters: Multimodal Features for Affective Analysiscited by 5
  5. 2024Robust Facial Reactions Generation: An Emotion-Aware Framework with Modality Compensationcited by 4
  6. 2025Compound Expression Recognition via Large Vision-Language Modelscited by 3
  7. 2024Facial Affect Recognition based on Multi Architecture Encoder and Feature Fusion for the ABAW7 Challengecited by 2
  8. 2025Technical Approach for the EMI Challenge in the 8th Affective Behavior Analysis in-the-Wild Competitioncited by 2
  9. 2025FIESTA: Fisher Information-based Efficient Selective Test-time Adaptationcited by 2
  10. 2026Multimodal Emotion Regression with Multi-Objective Optimization and VAD-Aware Audio Modeling for the 10th ABAW EMI Trackcited by 2
  11. 2024Compound Expression Recognition via Multi Model Ensemble for the ABAW7 Challengecited by 1
  12. 2024MRAC Track 1: 2nd Workshop on Multimodal, Generative and Responsible Affective Computingcited by 1
  13. 2025Interactive Multimodal Fusion with Temporal Modelingcited by 1
  14. 2025V-NAW: Video-based Noise-aware Adaptive Weighting for Facial Expression Recognitioncited by 1
  15. 2025Team RAS in 9th ABAW Competition: Multimodal Compound Expression Recognition Approachcited by 1
  16. 2025Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERCcited by 1
  17. 2026Solution to the 10th ABAW Expression Recognition Challenge: A Robust Multimodal Framework with Safe Cross-Attention and Modality Dropoutcited by 1
  18. 2026Hierarchical Granularity Alignment and State Space Modeling for Robust Multimodal AU Detection in the Wildcited by 1
  19. 2026Stage-Adaptive Reliability Modeling for Continuous Valence-Arousal Estimationcited by 1
  20. 2026Multimodal Emotion Recognition via Bi-directional Cross-Attention and Temporal Modelingcited by 1
  21. 2026A Two-Stage Dual-Modality Model for Facial Emotional Expression Recognitioncited by 1
  22. 2026HSEmotion Team at ABAW-10 Competition: Facial Expression Recognition, Valence-Arousal Estimation, Action Unit Detection and Fine-Grained Violence Classificationcited by 1
  23. 2026Team RAS in 10th ABAW Competition: Multimodal Valence and Arousal Estimation Approachcited by 1
  24. 2026Anchoring Emotions in Text: Robust Multimodal Fusion for Mimicry Intensity Estimationcited by 1
  25. 2026The Circumplex Degeneracy Behind the Rare-Class Limit in Affect Recognitioncited by 1
  26. 2026HSEmotion Team at the 11th ABAW Challenge: Multi-Task Learning and Ambivalence/Hesitancy Video Recognitioncited by 1
  27. 2026A Shared Latent for Partially-Labeled Multi-Task Facial Affect Recognitioncited by 1
  28. 2024Emotion Detection through Body Gesture and Facecited by 0
  29. 20257ABAW-Compound Expression Recognition via Curriculum Learningcited by 0
  30. 2025Lightweight Models for Emotional Analysis in Videocited by 0
  31. 2025Solution for 8th Competition on Affective & Behavior Analysis in-the-wildcited by 0
  32. 2025Design of an Expression Recognition Solution Based on the Global Channel-Spatial Attention Mechanism and Proportional Criterion Fusioncited by 0
  33. 2025Enhancing Facial Expression Recognition through Dual-Direction Attention Mixed Feature Networks and CLIP: Application to 8th ABAW Challengecited by 0
  34. 2025United we stand, Divided we fall: Handling Weak Complementary Relationships for Audio-Visual Emotion Recognition in Valence-Arousal Spacecited by 0
  35. 2025Feature-Based Dual Visual Feature Extraction Model for Compound Multimodal Emotion Recognitioncited by 0
  36. 2025Multimodal Alignment with Cross-Attentive GRUs for Fine-Grained Video Understandingcited by 0
  37. 2026Foundation Model Embeddings Meet Blended Emotions: A Multimodal Fusion Approach for the BLEMORE Challengecited by 0
  38. 2026Causal Supervision of Attention for Affective Behaviour Analysiscited by 0

50 most cited of 53 All 53 (JSON)