mlsanityData to 7 Oct 2026

A transformer-based approach to video frame-level prediction in Affective Behaviour Analysis In-the-wild

arXiv 2303.09293 ↗First posted 16 Mar 2023cs.CV eess.IVcited by 8

Not on the map. Why?

Abstract (arXiv)

In recent years, transformer architecture has been a dominating paradigm in many applications, including affective computing. In this report, we propose our transformer-based model to handle Emotion Classification Task in the 5th Affective Behavior Analysis In-the-wild Competition. By leveraging the attentive model and the synthetic dataset, we attain a score of 0.4775 on the validation set of Aff-Wild2, the dataset provided by the organizer.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 15 of its 17 references that are in the map. First posted on arXiv 16 Mar 2023.

Builds on

15 of 17 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  3. 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
  4. 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
  5. 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
  6. 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
  7. 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
  8. 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
  9. 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
  10. 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
  11. 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
  12. 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
3 more
  1. 2022Frame-level Prediction of Facial Expressions, Valence, Arousal and Action Units for Mobile Devicescited by 16
  2. 2022Multi-Task Learning Framework for Emotion Recognition in-the-wildcited by 10
  3. 2022Affective Behavior Analysis using Action Unit Relation Graph and Multi-task Cross Attentioncited by 8

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 6; 2025: 1.

8 papers.

  1. 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
  2. 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
  3. 2024Affective Behaviour Analysis via Integrating Multi-Modal Knowledgecited by 18
  4. 2023Spatio-Temporal AU Relational Graph Representation Learning For Facial Action Units Detectioncited by 7
  5. 2024Affective Behaviour Analysis via Progressive Learningcited by 7
  6. 2024Emotion Recognition Using Transformers with Masked Learningcited by 4
  7. 2024AUD-TGN: Advancing Action Unit Detection with Temporal Convolution and GPT-2 in Wild Audiovisual Contextscited by 3
  8. 20257ABAW-Compound Expression Recognition via Curriculum Learningcited by 0