Analysing Affective Behavior in the second ABAW2 Competition
Not on the map. Why?
Abstract (arXiv)
The Affective Behavior Analysis in-the-wild (ABAW2) 2021 Competition is the second -- following the first very successful ABAW Competition held in conjunction with IEEE FG 2020- Competition that aims at automatically analyzing affect. ABAW2 is split into three Challenges, each one addressing one of the three main behavior tasks of valence-arousal estimation, basic expression classification and action unit detection. All three Challenges are based on a common benchmark database, Aff-Wild2, which is a large scale in-the-wild database and the first one to be annotated for all these three tasks. In this paper, we describe this Competition, to be held in conjunction with ICCV 2021. We present the three Challenges, with the utilized Competition corpora. We outline the evaluation metrics and present the baseline system with its results. More information regarding the Competition is provided in the Competition site: https://ibug.doc.ic.ac.uk/resources/iccv-2021-2nd-abaw.
Key facts. Cited by 163 papers in the map (data through 7 Oct 2026). Builds on 34 of its 90 references that are in the map. First posted on arXiv 14 Jun 2021.
Builds on
34 of 90 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015WIDER FACE: A Face Detection Benchmarkcited by 297
- 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
- 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
- 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
- 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
- 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
- 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
- 2019AVEC 2019 Workshop and Challenge: State-of-Mind, Detecting Depression with AI, and Cross-Cultural Affect Recognitioncited by 87
- 2018Aff-Wild2: Extending the Aff-Wild Database for Affect Recognitioncited by 80
- 2020Deep Transparent Prediction through Latent Representation Analysiscited by 72
- 2020Two-Stream Aural-Visual Affect Analysis in the Wildcited by 51
22 more
- 2017SSH: Single Stage Headless Face Detectorcited by 40
- 2019Exploiting multi-CNN features in CNN-RNN based Dimensional Emotion Recognition on the OMG in-the-wild Datasetcited by 39
- 2020Multitask Emotion Recognition with Incomplete Labelscited by 39
- 2018Photorealistic Facial Synthesis in the Dimensional Affect Spacecited by 33
- 2016FaceNet2ExpNet: Regularizing a Deep Face Recognition Net for Expression Recognitioncited by 25
- 2018The OMG-Emotion Behavior Datasetcited by 25
- 2018A Multi-Task Learning & Generation Framework: Valence-Arousal, Action Units & Primary Expressionscited by 25
- 2016Peak-Piloted Deep Network for Facial Expression Recognitioncited by 22
- 2018Training Deep Neural Networks with Different Datasets In-the-wild: The Emotion Recognition Paradigmcited by 20
- 2017Incremental Boosting Convolutional Neural Network for Facial Action Unit Recognitioncited by 16
- 2018A Multi-component CNN-RNN Approach for Dimensional Emotion Recognition in-the-wildcited by 15
- 2020M3T: Multi-Modal Continuous Valence-Arousal Estimation in the Wildcited by 14
- 2020Affect Expression Behaviour Analysis in the Wild using Spatio-Channel Attention and Complementary Context Informationcited by 13
- 2018Efficient Augmentation via Data Subsamplingcited by 8
- 2020Emotion Recognition for In-the-wild Videoscited by 8
- 2020Affective Expression Analysis in-the-wild using Multi-Task Temporal Statistical Deep Learning Modelcited by 8
- 2020A Multi-term and Multi-task Analyzing Framework for Affective Analysis in-the-wildcited by 8
- 2020An Audio-Video Deep and Transfer Learning Framework for Multimodal Emotion Recognition in the wildcited by 8
- 2021Technical Report for Valence-Arousal Estimation on Affwild2 Datasetcited by 8
- 2020Multi-label Relation Modeling in Facial Action Units Detectioncited by 7
- 2020Multi-Label Class Balancing Algorithm for Action Unit Detectioncited by 7
- 2016How Deep Neural Networks Can Improve Emotion Recognition on Video Datacited by 3
Built on by
Citing papers per year: 2021: 21; 2022: 31; 2023: 30; 2024: 42; 2025: 23; 2026: 16.
163 papers.
Sort:
By area:
- 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
- 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
- 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
- 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
- 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyondcited by 60
- 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
- 2022Transformer-based Multimodal Information Fusion for Facial Expression Analysiscited by 49
- 2023A Deep Neural Architecture for Harmonizing 3-D Input Data Analysis and Decision Making in Medical Imagingcited by 39
- 2022Vision Transformer with Attentive Pooling for Robust Facial Expression Recognitioncited by 35
- 2022A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognitioncited by 33
- 2022MixAugment & Mixup: Augmentation Methods for Facial Expression Recognitioncited by 31
- 2024Domain adaptation, Explainability & Fairness in AI for Medical Image Analysis: Diagnosis of COVID-19 based on 3-D Chest CT-scanscited by 30
38 more
- 2021Neural Emotion Director: Speech-preserving semantic control of facial expressions in "in-the-wild" videoscited by 28
- 2021A Multi-modal and Multi-task Learning Method for Action Unit and Expression Recognitioncited by 24
- 2023Multi-modal Facial Affective Analysis based on Masked Autoencodercited by 23
- 2024COVID-19 Computer-aided Diagnosis through AI-assisted CT Imaging Analysis: Deploying a Medical AI Systemcited by 23
- 2022COLD Fusion: Calibrated and Ordinal Latent Distribution Fusion for Uncertainty-Aware Multimodal Emotion Recognitioncited by 22
- 2021Iterative Distillation for Better Uncertainty Estimates in Multitask Emotion Recognitioncited by 20
- 2022Continuous Emotion Recognition using Visual-audio-linguistic information: A Technical Report for ABAW3cited by 20
- 2022AI-MIA: COVID-19 Detection & Severity Analysis through Medical Imagingcited by 20
- 2023Leveraging TCN and Transformer for effective visual-audio fusion in continuous emotion recognitioncited by 20
- 2023BTDNet: a Multi-Modal Approach for Brain Tumor Radiogenomic Classificationcited by 20
- 2021A Multi-task Mean Teacher for Semi-supervised Facial Affective Behavior Analysiscited by 19
- 2021Prior Aided Streaming Network for Multi-task Affective Recognitionat the 2nd ABAW2 Competitioncited by 18
- 2022Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attentioncited by 18
- 2024Affective Behaviour Analysis via Integrating Multi-Modal Knowledgecited by 18
- 2022Coarse-to-Fine Cascaded Networks with Smooth Predicting for Video Facial Expression Recognitioncited by 17
- 2022Frame-level Prediction of Facial Expressions, Valence, Arousal and Action Units for Mobile Devicescited by 16
- 2023MMA-MRNNet: Harnessing Multiple Models of Affect and Dynamic Masked RNN for Precise Facial Expression Intensity Estimationcited by 16
- 2024Robust Light-Weight Facial Affective Behavior Recognition with CLIPcited by 16
- 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkitcited by 16
- 2021Continuous Emotion Recognition with Audio-visual Leader-follower Attentive Fusioncited by 15
- 2022Multi-modal Emotion Estimation for in-the-wild Videoscited by 15
- 2024Recursive Joint Cross-Modal Attention for Multimodal Fusion in Dimensional Emotion Recognitioncited by 15
- 2025HSEmotion Team at ABAW-8 Competition: Audiovisual Ambivalence/Hesitancy, Emotional Mimicry Intensity and Facial Expression Recognitioncited by 15
- 2024SAM2CLIP2SAM: Vision Language Model for Segmentation of 3D CT Scans for Covid-19 Detectioncited by 14
- 2024Joint Multimodal Transformer for Emotion Recognition in the Wildcited by 13
- 2025DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarioscited by 13
- 2021An audiovisual and contextual approach for categorical and continuous emotion recognition in-the-wildcited by 12
- 2021Multitask Multi-database Emotion Recognitioncited by 12
- 2025MOL: Joint Estimation of Micro-Expression, Optical Flow, and Landmark via Transformer-Graph-Style Convolutioncited by 12
- 2021Emotion Recognition with Incomplete Labels Using Modified Multi-task Learning Techniquecited by 10
- 2022Facial Action Unit Recognition With Multi-models Ensemblingcited by 10
- 2022Multi-modal Multi-label Facial Action Unit Detection with Transformercited by 10
- 2022Facial Affect Analysis: Learning from Synthetic Data & Multi-Task Learning Challengescited by 10
- 2022Multi-label Transformer for Action Unit Detectioncited by 9
- 2022Multiple Emotion Descriptors Estimation at the ABAW3 Challengecited by 9
- 2022An Ensemble Approach for Facial Expression Analysis in Videocited by 9
- 2022Facial Expression Recognition with Swin Transformercited by 9
- 2023MASA-TCN: Multi-anchor Space-aware Temporal Convolutional Neural Networks for Continuous and Discrete EEG Emotion Recognitioncited by 9
50 most cited of 163 All 163 (JSON)
- 2026Mind the Student: Behavioral and Contextual Cues for Automated Engagement Prediction in Online Learning25 Aug 2026
- 2026AffectFuse: Cross-Task Feature Fusion with Temporal Modeling for Multi-Task Affective Behavior Analysis17 Jul 2026
- 2026AffectFlow-DINO: Uncertainty-Aware Multi-Task Affect Estimation via Conditional Rectified Flow14 Jul 2026
- 2026Causal Supervision of Attention for Affective Behaviour Analysis13 Jul 2026
- 2026Strength-Parity Ensembling with Parameter-Isolated Experts for Multi-Task Affect Recognition12 Jul 2026
- 2026A Shared Latent for Partially-Labeled Multi-Task Facial Affect Recognition11 Jul 2026
- 2026The Circumplex Degeneracy Behind the Rare-Class Limit in Affect Recognition14 Jun 2026
- 2026Anchoring Emotions in Text: Robust Multimodal Fusion for Mimicry Intensity Estimation16 Mar 2026
- 2026Multimodal Emotion Regression with Multi-Objective Optimization and VAD-Aware Audio Modeling for the 10th ABAW EMI Track14 Mar 2026
- 2026Team RAS in 10th ABAW Competition: Multimodal Valence and Arousal Estimation Approach13 Mar 2026
- 2026HSEmotion Team at ABAW-10 Competition: Facial Expression Recognition, Valence-Arousal Estimation, Action Unit Detection and Fine-Grained Violence Classification13 Mar 2026
- 2026A Two-Stage Dual-Modality Model for Facial Emotional Expression Recognition12 Mar 2026
38 more
- 2026Multimodal Emotion Recognition via Bi-directional Cross-Attention and Temporal Modeling12 Mar 2026
- 2026Stage-Adaptive Reliability Modeling for Continuous Valence-Arousal Estimation12 Mar 2026
- 2026Hierarchical Granularity Alignment and State Space Modeling for Robust Multimodal AU Detection in the Wild11 Mar 2026
- 2026Solution to the 10th ABAW Expression Recognition Challenge: A Robust Multimodal Framework with Safe Cross-Attention and Modality Dropout9 Mar 2026
- 2025Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERC6 Aug 2025
- 2025Multimodal Alignment with Cross-Attentive GRUs for Fine-Grained Video Understanding4 Jul 2025
- 2025Team RAS in 9th ABAW Competition: Multimodal Compound Expression Recognition Approach2 Jul 2025
- 2025MOL: Joint Estimation of Micro-Expression, Optical Flow, and Landmark via Transformer-Graph-Style Convolution17 Jun 2025
- 2025DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarios29 May 2025
- 2025xTrace: A Facial Expressive Behaviour Analysis Tool for Continuous Affect Recognition8 May 2025
- 2025FIESTA: Fisher Information-based Efficient Selective Test-time Adaptation29 Mar 2025
- 2025V-NAW: Video-based Noise-aware Adaptive Weighting for Facial Expression Recognition20 Mar 2025
- 2025Semantic Matters: Multimodal Features for Affective Analysis16 Mar 2025
- 2025MAVEN: Multi-modal Attention for Valence-Arousal Emotion Network16 Mar 2025
- 2025United we stand, Divided we fall: Handling Weak Complementary Relationships for Audio-Visual Emotion Recognition in Valence-Arousal Space15 Mar 2025
- 2025Enhancing Facial Expression Recognition through Dual-Direction Attention Mixed Feature Networks and CLIP: Application to 8th ABAW Challenge15 Mar 2025
- 2025Design of an Expression Recognition Solution Based on the Global Channel-Spatial Attention Mechanism and Proportional Criterion Fusion15 Mar 2025
- 2025Compound Expression Recognition via Large Vision-Language Models14 Mar 2025
- 2025Solution for 8th Competition on Affective & Behavior Analysis in-the-wild14 Mar 2025
- 2025Technical Approach for the EMI Challenge in the 8th Affective Behavior Analysis in-the-Wild Competition13 Mar 2025
- 2025Lightweight Models for Emotional Analysis in Video13 Mar 2025
- 2025Interactive Multimodal Fusion with Temporal Modeling13 Mar 2025
- 2025HSEmotion Team at ABAW-8 Competition: Audiovisual Ambivalence/Hesitancy, Emotional Mimicry Intensity and Facial Expression Recognition13 Mar 2025
- 2025Mamba-VA: A Mamba-based Approach for Continuous Emotion Recognition in Valence-Arousal Space13 Mar 2025
- 2025Emotion Recognition with CLIP and Sequential Learning13 Mar 2025
- 20257ABAW-Compound Expression Recognition via Curriculum Learning11 Mar 2025
- 2025Emotion estimation from video footage with LSTM23 Jan 2025
- 2024Using Prompts to Guide Large Language Models in Imitating a Real Person's Language Style4 Oct 2024
- 2024Facial Action Unit Detection by Adaptively Constraining Self-Attention and Causally Deconfounding Sample2 Oct 2024
- 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkit26 Sep 2024
- 2024Ig3D: Integrating 3D Face Representations in Facial Expression Inference29 Aug 2024
- 2024Rethinking Affect Analysis: A Protocol for Ensuring Fairness and Consistency4 Aug 2024
- 2024Affective Behaviour Analysis via Progressive Learning24 Jul 2024
- 2024Robust Facial Reactions Generation: An Emotion-Aware Framework with Modality Compensation22 Jul 2024
- 2024SAM2CLIP2SAM: Vision Language Model for Segmentation of 3D CT Scans for Covid-19 Detection22 Jul 2024
- 2024HSEmotion Team at the 7th ABAW Challenge: Multi-Task Learning and Compound Facial Expression Recognition18 Jul 2024
- 2024Temporal Label Hierachical Network for Compound Emotion Recognition17 Jul 2024
- 2024Textualized and Feature-based Models for Compound Multimodal Emotion Recognition in the Wild17 Jul 2024
50 newest of 163 All 163 (JSON)
- 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
- 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
- 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
- 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
- 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyondcited by 60
- 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
- 2022Transformer-based Multimodal Information Fusion for Facial Expression Analysiscited by 49
- 2023A Deep Neural Architecture for Harmonizing 3-D Input Data Analysis and Decision Making in Medical Imagingcited by 39
- 2022Vision Transformer with Attentive Pooling for Robust Facial Expression Recognitioncited by 35
- 2022A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognitioncited by 33
- 2022MixAugment & Mixup: Augmentation Methods for Facial Expression Recognitioncited by 31
- 2024Domain adaptation, Explainability & Fairness in AI for Medical Image Analysis: Diagnosis of COVID-19 based on 3-D Chest CT-scanscited by 30
12 most cited of 159 All 159 (JSON)
- 2026Mind the Student: Behavioral and Contextual Cues for Automated Engagement Prediction in Online Learning25 Aug 2026
- 2026AffectFuse: Cross-Task Feature Fusion with Temporal Modeling for Multi-Task Affective Behavior Analysis17 Jul 2026
- 2026Causal Supervision of Attention for Affective Behaviour Analysis13 Jul 2026
- 2026Strength-Parity Ensembling with Parameter-Isolated Experts for Multi-Task Affect Recognition12 Jul 2026
- 2026A Shared Latent for Partially-Labeled Multi-Task Facial Affect Recognition11 Jul 2026
- 2026The Circumplex Degeneracy Behind the Rare-Class Limit in Affect Recognition14 Jun 2026
- 2026Anchoring Emotions in Text: Robust Multimodal Fusion for Mimicry Intensity Estimation16 Mar 2026
- 2026Multimodal Emotion Regression with Multi-Objective Optimization and VAD-Aware Audio Modeling for the 10th ABAW EMI Track14 Mar 2026
- 2026Team RAS in 10th ABAW Competition: Multimodal Valence and Arousal Estimation Approach13 Mar 2026
- 2026HSEmotion Team at ABAW-10 Competition: Facial Expression Recognition, Valence-Arousal Estimation, Action Unit Detection and Fine-Grained Violence Classification13 Mar 2026
- 2026A Two-Stage Dual-Modality Model for Facial Emotional Expression Recognition12 Mar 2026
- 2026Multimodal Emotion Recognition via Bi-directional Cross-Attention and Temporal Modeling12 Mar 2026
12 newest of 159 All 159 (JSON)