EmotiEffNet Facial Features in Uni-task Emotion Recognition in Video at ABAW-5 competition
Not on the map. Why?
Abstract (arXiv)
In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented. The usage of the pre-trained convolutional networks from the EmotiEffNet family for frame-level feature extraction is studied. In particular, we propose an ensemble of a multi-layered perceptron and the LightAutoML-based classifier. The post-processing by smoothing the results for sequential frames is implemented. Experimental results for the large-scale Aff-Wild2 database demonstrate that our model achieves a much greater macro-averaged F1-score for facial expression recognition and action unit detection and concordance correlation coefficients for valence/arousal estimation when compared to baseline.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 15 of its 30 references that are in the map. First posted on arXiv 16 Mar 2023.
Builds on
15 of 30 references.
References · 15
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 490
- 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
- 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
- 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
- 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
- 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
- 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
- 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
- 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
- 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
- 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
- 2021Facial expression and attributes recognition based on multi-task learning of lightweight neural networkscited by 40
3 more
- 2021LightAutoML: AutoML Solution for a Large Financial Services Ecosystemcited by 32
- 2022Continuous Emotion Recognition using Visual-audio-linguistic information: A Technical Report for ABAW3cited by 20
- 2017Organizing Multimedia Data in Video Surveillance Systems Based on Face Verification with Convolutional Neural Networkscited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 4; 2025: 0; 2026: 1.
7 papers.
- 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
- 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
- 2023Multi-modal Facial Affective Analysis based on Masked Autoencodercited by 23
- 2023Spatio-Temporal AU Relational Graph Representation Learning For Facial Action Units Detectioncited by 7
- 2024Emotic Masked Autoencoder with Attention Fusion for Facial Expression Recognitioncited by 3
- 2024AUD-TGN: Advancing Action Unit Detection with Temporal Convolution and GPT-2 in Wild Audiovisual Contextscited by 3
- 2026Task-Specific Feature Fusion Method for Multi-Task Affective Behavior Analysiscited by 0
- 2026Task-Specific Feature Fusion Method for Multi-Task Affective Behavior Analysis15 Jul 2026
- 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognition4 Jul 2024
- 2024AUD-TGN: Advancing Action Unit Detection with Temporal Convolution and GPT-2 in Wild Audiovisual Contexts20 Mar 2024
- 2024Emotic Masked Autoencoder with Attention Fusion for Facial Expression Recognition19 Mar 2024
- 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competition29 Feb 2024
- 2023Multi-modal Facial Affective Analysis based on Masked Autoencoder20 Mar 2023
- 2023Spatio-Temporal AU Relational Graph Representation Learning For Facial Action Units Detection19 Mar 2023