Enhancing Facial Expression Recognition through Dual-Direction Attention Mixed Feature Networks: Application to 7th ABAW Challenge
Not on the map. Why?
Abstract (arXiv)
We present our contribution to the 7th ABAW challenge at ECCV 2024, by utilizing a Dual-Direction Attention Mixed Feature Network (DDAMFN) for multitask facial expression recognition, we achieve results far beyond the proposed baseline for the Multi-Task ABAW challenge. Our proposal uses the well-known DDAMFN architecture as base to effectively predict valence-arousal, emotion recognition, and facial action units. We demonstrate the architecture ability to handle these tasks simultaneously, providing insights into its architecture and the rationale behind its design. Additionally, we compare our results for a multitask solution with independent single-task performance.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 17 of its 35 references that are in the map. First posted on arXiv 17 Jul 2024.
Builds on
17 of 35 references.
References · 17
- 2021Coordinate Attention for Efficient Mobile Network Designcited by 241
- 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
- 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
- 2018MobileFaceNets: Efficient CNNs for Accurate Real-Time Face Verification on Mobile Devicescited by 182
- 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
- 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
- 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
- 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
- 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
- 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
- 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
- 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
5 more
- 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
- 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
- 2022Frame-level Prediction of Facial Expressions, Valence, Arousal and Action Units for Mobile Devicescited by 16
- 2024HSEmotion Team at the 6th ABAW Competition: Facial Expressions, Valence-Arousal and Emotion Intensity Predictioncited by 8
- 2024Affective Behavior Analysis using Task-adaptive and AU-assisted Graph Networkcited by 8
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 5.
8 papers.
- 2024Affective Behaviour Analysis via Progressive Learningcited by 7
- 2026Multimodal Emotion Recognition via Bi-directional Cross-Attention and Temporal Modelingcited by 1
- 2026HSEmotion Team at the 11th ABAW Challenge: Multi-Task Learning and Ambivalence/Hesitancy Video Recognitioncited by 1
- 2025Lightweight Models for Emotional Analysis in Videocited by 0
- 2025United we stand, Divided we fall: Handling Weak Complementary Relationships for Audio-Visual Emotion Recognition in Valence-Arousal Spacecited by 0
- 2026HEDGE: A Calibrated Ensemble for A/H Recognitioncited by 0
- 2026AffectFlow-DINO: Uncertainty-Aware Multi-Task Affect Estimation via Conditional Rectified Flowcited by 0
- 2026A Dual-Transformer for Multi-Camera View Recommendationcited by 0
- 2026A Dual-Transformer for Multi-Camera View Recommendation26 Aug 2026
- 2026AffectFlow-DINO: Uncertainty-Aware Multi-Task Affect Estimation via Conditional Rectified Flow14 Jul 2026
- 2026HSEmotion Team at the 11th ABAW Challenge: Multi-Task Learning and Ambivalence/Hesitancy Video Recognition14 Jul 2026
- 2026HEDGE: A Calibrated Ensemble for A/H Recognition13 Jul 2026
- 2026Multimodal Emotion Recognition via Bi-directional Cross-Attention and Temporal Modeling12 Mar 2026
- 2025United we stand, Divided we fall: Handling Weak Complementary Relationships for Audio-Visual Emotion Recognition in Valence-Arousal Space15 Mar 2025
- 2025Lightweight Models for Emotional Analysis in Video13 Mar 2025
- 2024Affective Behaviour Analysis via Progressive Learning24 Jul 2024