mlsanityData to 7 Oct 2026

ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challenges

arXiv 2303.01498 ↗First posted 2 Mar 2023cs.CV cs.LGcited by 110

Not on the map. Why?

Abstract (arXiv)

The fifth Affective Behavior Analysis in-the-wild (ABAW) Competition is part of the respective ABAW Workshop which will be held in conjunction with IEEE Computer Vision and Pattern Recognition Conference (CVPR), 2023. The 5th ABAW Competition is a continuation of the Competitions held at ECCV 2022, IEEE CVPR 2022, ICCV 2021, IEEE FG 2020 and CVPR 2017 Conferences, and is dedicated at automatically analyzing affect. For this year's Competition, we feature two corpora: i) an extended version of the Aff-Wild2 database and ii) the Hume-Reaction dataset. The former database is an audiovisual one of around 600 videos of around 3M frames and is annotated with respect to:a) two continuous affect dimensions -valence (how positive/negative a person is) and arousal (how active/passive a person is)-; b) basic expressions (e.g. happiness, sadness, neutral state); and c) atomic facial muscle actions (i.e., action units). The latter dataset is an audiovisual one in which reactions of individuals to emotional stimuli have been annotated with respect to seven emotional expression intensities. Thus the 5th ABAW Competition encompasses four Challenges: i) uni-task Valence-Arousal Estimation, ii) uni-task Expression Classification, iii) uni-task Action Unit Detection, and iv) Emotional Reaction Intensity Estimation. In this paper, we present these Challenges, along with their corpora, we outline the evaluation metrics, we present the baseline systems and illustrate their obtained performance.

Key facts. Cited by 110 papers in the map (data through 7 Oct 2026). Builds on 70 of its 116 references that are in the map. First posted on arXiv 2 Mar 2023.

Builds on

70 of 116 references.

References · 70

  1. 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
  2. 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
  3. 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
  4. 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
  5. 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
  6. 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
  7. 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
  8. 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
  9. 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
  10. 2018Aff-Wild2: Extending the Aff-Wild Database for Affect Recognitioncited by 80
  11. 2020Deep Transparent Prediction through Latent Representation Analysiscited by 72
  12. 2021MIA-COV19D: COVID-19 Detection through 3-D Chest CT Image Analysiscited by 72
38 more
  1. 2020Two-Stream Aural-Visual Affect Analysis in the Wildcited by 51
  2. 2022Transformer-based Multimodal Information Fusion for Facial Expression Analysiscited by 49
  3. 2019Exploiting multi-CNN features in CNN-RNN based Dimensional Emotion Recognition on the OMG in-the-wild Datasetcited by 39
  4. 2020Multitask Emotion Recognition with Incomplete Labelscited by 39
  5. 2018Photorealistic Facial Synthesis in the Dimensional Affect Spacecited by 33
  6. 2022A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognitioncited by 33
  7. 2022MixAugment & Mixup: Augmentation Methods for Facial Expression Recognitioncited by 31
  8. 2018A Multi-Task Learning & Generation Framework: Valence-Arousal, Action Units & Primary Expressionscited by 25
  9. 2021A Multi-modal and Multi-task Learning Method for Action Unit and Expression Recognitioncited by 24
  10. 2022The MuSe 2022 Multimodal Sentiment Analysis Challenge: Humor, Emotional Reactions, and Stresscited by 23
  11. 2018Training Deep Neural Networks with Different Datasets In-the-wild: The Emotion Recognition Paradigmcited by 20
  12. 2022Continuous Emotion Recognition using Visual-audio-linguistic information: A Technical Report for ABAW3cited by 20
  13. 2021A Multi-task Mean Teacher for Semi-supervised Facial Affective Behavior Analysiscited by 19
  14. 2021Prior Aided Streaming Network for Multi-task Affective Recognitionat the 2nd ABAW2 Competitioncited by 18
  15. 2022Coarse-to-Fine Cascaded Networks with Smooth Predicting for Video Facial Expression Recognitioncited by 17
  16. 2017Incremental Boosting Convolutional Neural Network for Facial Action Unit Recognitioncited by 16
  17. 2022Frame-level Prediction of Facial Expressions, Valence, Arousal and Action Units for Mobile Devicescited by 16
  18. 2023MMA-MRNNet: Harnessing Multiple Models of Affect and Dynamic Masked RNN for Precise Facial Expression Intensity Estimationcited by 16
  19. 2018A Multi-component CNN-RNN Approach for Dimensional Emotion Recognition in-the-wildcited by 15
  20. 2022Multi-modal Emotion Estimation for in-the-wild Videoscited by 15
  21. 2020M3T: Multi-Modal Continuous Valence-Arousal Estimation in the Wildcited by 14
  22. 2020Affect Expression Behaviour Analysis in the Wild using Spatio-Channel Attention and Complementary Context Informationcited by 13
  23. 2021An audiovisual and contextual approach for categorical and continuous emotion recognition in-the-wildcited by 12
  24. 2021Multitask Multi-database Emotion Recognitioncited by 12
  25. 2022Hybrid Multimodal Feature Extraction, Mining and Fusion for Sentiment Analysiscited by 12
  26. 2022Facial Action Unit Recognition With Multi-models Ensemblingcited by 10
  27. 2022Multi-modal Multi-label Facial Action Unit Detection with Transformercited by 10
  28. 2022Facial Affect Analysis: Learning from Synthetic Data & Multi-Task Learning Challengescited by 10
  29. 2022Affective Behaviour Analysis Using Pretrained Model with Facial Prioricited by 10
  30. 2022Multi-label Transformer for Action Unit Detectioncited by 9
  31. 2022Multiple Emotion Descriptors Estimation at the ABAW3 Challengecited by 9
  32. 2022An Ensemble Approach for Facial Expression Analysis in Videocited by 9
  33. 2022Facial Expression Recognition with Swin Transformercited by 9
  34. 2020Emotion Recognition for In-the-wild Videoscited by 8
  35. 2020Affective Expression Analysis in-the-wild using Multi-Task Temporal Statistical Deep Learning Modelcited by 8
  36. 2020A Multi-term and Multi-task Analyzing Framework for Affective Analysis in-the-wildcited by 8
  37. 2020An Audio-Video Deep and Transfer Learning Framework for Multimodal Emotion Recognition in the wildcited by 8
  38. 2021Technical Report for Valence-Arousal Estimation on Affwild2 Datasetcited by 8

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 26; 2024: 45; 2025: 22; 2026: 17.

110 papers.

Sort:

By area:

  1. 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
  2. 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyondcited by 60
  3. 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
  4. 2023From Static to Dynamic: Adapting Landmark-Aware Image Models for Facial Expression Recognition in Videoscited by 39
  5. 2024Domain adaptation, Explainability & Fairness in AI for Medical Image Analysis: Diagnosis of COVID-19 based on 3-D Chest CT-scanscited by 30
  6. 2023Multi-modal Facial Affective Analysis based on Masked Autoencodercited by 23
  7. 2024COVID-19 Computer-aided Diagnosis through AI-assisted CT Imaging Analysis: Deploying a Medical AI Systemcited by 23
  8. 2023Leveraging TCN and Transformer for effective visual-audio fusion in continuous emotion recognitioncited by 20
  9. 2023BTDNet: a Multi-Modal Approach for Brain Tumor Radiogenomic Classificationcited by 20
  10. 2024Affective Behaviour Analysis via Integrating Multi-Modal Knowledgecited by 18
  11. 2024Robust Light-Weight Facial Affective Behavior Recognition with CLIPcited by 16
  12. 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkitcited by 16
38 more
  1. 2024Recursive Joint Cross-Modal Attention for Multimodal Fusion in Dimensional Emotion Recognitioncited by 15
  2. 2025HSEmotion Team at ABAW-8 Competition: Audiovisual Ambivalence/Hesitancy, Emotional Mimicry Intensity and Facial Expression Recognitioncited by 15
  3. 2024MMA-DFER: MultiModal Adaptation of unimodal models for Dynamic Facial Expression Recognition in-the-wildcited by 14
  4. 2024SAM2CLIP2SAM: Vision Language Model for Segmentation of 3D CT Scans for Covid-19 Detectioncited by 14
  5. 2024Joint Multimodal Transformer for Emotion Recognition in the Wildcited by 13
  6. 2025DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarioscited by 13
  7. 2023ARBEx: Attentive Feature Extraction with Reliability Balancing for Robust Facial Expression Learningcited by 9
  8. 2024Textualized and Feature-based Models for Compound Multimodal Emotion Recognition in the Wildcited by 9
  9. 2023A transformer-based approach to video frame-level prediction in Affective Behaviour Analysis In-the-wildcited by 8
  10. 2023Multi-modal Facial Action Unit Detection with Large Pre-trained Models for the 5th Competition on Affective Behavior Analysis in-the-wildcited by 8
  11. 2024Exploring Facial Expression Recognition through Semi-Supervised Pretraining and Temporal Modelingcited by 8
  12. 2024Can Machine Learning Assist in Diagnosis of Primary Immune Thrombocytopenia? A feasibility studycited by 8
  13. 2024Affective Behavior Analysis using Task-adaptive and AU-assisted Graph Networkcited by 8
  14. 2024Enhancing Facial Expression Recognition through Dual-Direction Attention Mixed Feature Networks: Application to 7th ABAW Challengecited by 8
  15. 2025MAVEN: Multi-modal Attention for Valence-Arousal Emotion Networkcited by 8
  16. 2023EmotiEffNet Facial Features in Uni-task Emotion Recognition in Video at ABAW-5 competitioncited by 7
  17. 2023Spatio-Temporal AU Relational Graph Representation Learning For Facial Action Units Detectioncited by 7
  18. 2024Affective Behaviour Analysis via Progressive Learningcited by 7
  19. 2024Rethinking Affect Analysis: A Protocol for Ensuring Fairness and Consistencycited by 7
  20. 2023Facial Affective Behavior Analysis Method for 5th ABAW Competitioncited by 6
  21. 2023Facial Affect Recognition based on Transformer Encoder and Audiovisual Fusion for the ABAW5 Challengecited by 6
  22. 2024Boosting Continuous Emotion Recognition with Self-Pretraining using Masked Autoencoders, Temporal Convolutional Networks, and Transformerscited by 6
  23. 2024Efficient Feature Extraction and Late Fusion Strategy for Audiovisual Emotional Mimicry Intensity Estimationcited by 6
  24. 2024Unimodal Multi-Task Fusion for Emotional Mimicry Intensity Predictioncited by 6
  25. 2024CAGE: Circumplex Affect Guided Expression Inferencecited by 6
  26. 2024HSEmotion Team at the 7th ABAW Challenge: Multi-Task Learning and Compound Facial Expression Recognitioncited by 6
  27. 2024Ig3D: Integrating 3D Face Representations in Facial Expression Inferencecited by 6
  28. 2024Using Prompts to Guide Large Language Models in Imitating a Real Person's Language Stylecited by 6
  29. 2025Emotion Recognition with CLIP and Sequential Learningcited by 6
  30. 2025Mamba-VA: A Mamba-based Approach for Continuous Emotion Recognition in Valence-Arousal Spacecited by 6
  31. 2023Local Region Perception and Relationship Learning Combined with Feature Fusion for Facial Action Unit Detectioncited by 5
  32. 2023Multimodal Feature Extraction and Fusion for Emotional Reaction Intensity Estimation and Expression Classification in Videos with Transformerscited by 5
  33. 2023TempT: Temporal consistency for Test-time adaptationcited by 5
  34. 2024Multimodal Fusion Method with Spatiotemporal Sequences and Relationship Learning for Valence-Arousal Estimationcited by 5
  35. 2025Semantic Matters: Multimodal Features for Affective Analysiscited by 5
  36. 2023Exploring Large-scale Unlabeled Faces to Enhance Facial Expression Recognitioncited by 4
  37. 2023Vision Transformer for Action Units Detectioncited by 4
  38. 2024SUN Team's Contribution to ABAW 2024 Competition: Audio-visual Valence-Arousal Estimation and Expression Recognitioncited by 4

50 most cited of 110 All 110 (JSON)