Facial Affect Recognition based on Multi Architecture Encoder and Feature Fusion for the ABAW7 Challenge
Not on the map. Why?
Abstract (arXiv)
In this paper, we present our approach to addressing the challenges of the 7th ABAW competition. The competition comprises three sub-challenges: Valence Arousal (VA) estimation, Expression (Expr) classification, and Action Unit (AU) detection. To tackle these challenges, we employ state-of-the-art models to extract powerful visual features. Subsequently, a Transformer Encoder is utilized to integrate these features for the VA, Expr, and AU sub-challenges. To mitigate the impact of varying feature dimensions, we introduce an affine module to align the features to a common dimension. Overall, our results significantly outperform the baselines.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 17 Jul 2024.
Builds on
28 of 40 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 490
- 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
- 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
- 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
- 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
- 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
- 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
16 more
- 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
- 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
- 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
- 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
- 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
- 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
- 2022Transformer-based Multimodal Information Fusion for Facial Expression Analysiscited by 49
- 2022POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognitioncited by 49
- 2023POSTER++: A simpler and stronger facial expression recognition networkcited by 25
- 2021A Multi-modal and Multi-task Learning Method for Action Unit and Expression Recognitioncited by 24
- 2018Attention Based Fully Convolutional Network for Speech Emotion Recognitioncited by 23
- 2022Continuous Emotion Recognition using Visual-audio-linguistic information: A Technical Report for ABAW3cited by 20
- 2022Multi-modal Emotion Estimation for in-the-wild Videoscited by 15
- 2022Facial Action Unit Recognition With Multi-models Ensemblingcited by 10
- 2022Multi-modal Multi-label Facial Action Unit Detection with Transformercited by 10
- 2022Multi-label Transformer for Action Unit Detectioncited by 9
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 1.
2 papers.