mlsanityData to 14 Oct 2026

An Ensemble Approach for Facial Expression Analysis in Video

arXiv 2203.12891 ↗First posted 24 Mar 2022cs.CV eess.IVcited by 9

Not on the map. Why?

Abstract (arXiv)

Human emotions recognization contributes to the development of human-computer interaction. The machines understanding human emotions in the real world will significantly contribute to life in the future. This paper will introduce the Affective Behavior Analysis in-the-wild (ABAW3) 2022 challenge. The paper focuses on solving the problem of the valence-arousal estimation and action unit detection. For valence-arousal estimation, we conducted two stages: creating new features from multimodel and temporal learning to predict valence-arousal. First, we make new features; the Gated Recurrent Unit (GRU) and Transformer are combined using a Regular Networks (RegNet) feature, which is extracted from the image. The next step is the GRU combined with Local Attention to predict valence-arousal. The Concordance Correlation Coefficient (CCC) was used to evaluate the model.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 19 of its 23 references that are in the map. First posted on arXiv 24 Mar 2022.

Builds on

19 of 23 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  4. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
  5. 2020Designing Network Design Spacescited by 960
  6. 2017Focal Loss for Dense Object Detectioncited by 752
  7. 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
  8. 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
  9. 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
  10. 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
  11. 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
  12. 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
7 more
  1. 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
  2. 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
  3. 2020Two-Stream Aural-Visual Affect Analysis in the Wildcited by 51
  4. 2020Multitask Emotion Recognition with Incomplete Labelscited by 39
  5. 2021Iterative Distillation for Better Uncertainty Estimates in Multitask Emotion Recognitioncited by 21
  6. 2021Prior Aided Streaming Network for Multi-task Affective Recognitionat the 2nd ABAW2 Competitioncited by 18
  7. 2021Multitask Multi-database Emotion Recognitioncited by 12

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 3; 2024: 3.

9 papers.

  1. 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
  2. 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
  3. 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
  4. 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
  5. 2022A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognitioncited by 34
  6. 2024Joint Multimodal Transformer for Emotion Recognition in the Wildcited by 14
  7. 2022Multi-Task Learning Framework for Emotion Recognition in-the-wildcited by 10
  8. 2023Facial Affective Behavior Analysis Method for 5th ABAW Competitioncited by 6
  9. 2023Spatial-temporal Transformer for Affective Behavior Analysiscited by 2