mlsanityData to 7 Oct 2026

Rethinking Affect Analysis: A Protocol for Ensuring Fairness and Consistency

arXiv 2408.02164 ↗First posted 4 Aug 2024cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Evaluating affect analysis methods presents challenges due to inconsistencies in database partitioning and evaluation protocols, leading to unfair and biased results. Previous studies claim continuous performance improvements, but our findings challenge such assertions. Using these insights, we propose a unified protocol for database partitioning that ensures fairness and comparability. We provide detailed demographic annotations (in terms of race, gender and age), evaluation metrics, and a common framework for expression recognition, action unit detection and valence-arousal estimation. We also rerun the methods with the new protocol and introduce a new leaderboards to encourage future research in affect recognition with a fairer comparison. Our annotations, code, and pre-trained models are available on hyperlinkhttps://github.com/dkollias/Fair-Consistent-Affect-AnalysisGithub.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 38 of its 74 references that are in the map. First posted on arXiv 4 Aug 2024.

Builds on

38 of 74 references.

References · 38

  1. 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 490
  2. 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
  3. 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
  4. 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
  5. 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
  6. 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
  7. 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
  8. 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
  9. 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
  10. 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
  11. 2022Learning Multi-dimensional Edge Feature-based AU Relation Graph for Facial Action Unit Recognitioncited by 81
  12. 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
26 more
  1. 2020Deep Transparent Prediction through Latent Representation Analysiscited by 72
  2. 2022Learn From All: Erasing Attention Consistency for Noisy Label Facial Expression Recognitioncited by 67
  3. 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyondcited by 60
  4. 2021Distract Your Attention: Multi-head Cross Attention Network for Facial Expression Recognitioncited by 55
  5. 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
  6. 2022POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognitioncited by 49
  7. 2019Factorized Higher-Order CNNs with an Application to Spatio-Temporal Emotion Estimationcited by 40
  8. 2019Exploiting multi-CNN features in CNN-RNN based Dimensional Emotion Recognition on the OMG in-the-wild Datasetcited by 39
  9. 2023A Deep Neural Architecture for Harmonizing 3-D Input Data Analysis and Decision Making in Medical Imagingcited by 39
  10. 2022MixAugment & Mixup: Augmentation Methods for Facial Expression Recognitioncited by 31
  11. 2023POSTER++: A simpler and stronger facial expression recognition networkcited by 25
  12. 2023Multi-modal Facial Affective Analysis based on Masked Autoencodercited by 23
  13. 2024COVID-19 Computer-aided Diagnosis through AI-assisted CT Imaging Analysis: Deploying a Medical AI Systemcited by 23
  14. 2023Leveraging TCN and Transformer for effective visual-audio fusion in continuous emotion recognitioncited by 20
  15. 2023BTDNet: a Multi-Modal Approach for Brain Tumor Radiogenomic Classificationcited by 20
  16. 2022Pose-disentangled Contrastive Learning for Self-supervised Facial Representationcited by 16
  17. 2024Uncertainty-guided Contrastive Learning for Single Source Domain Generalisationcited by 14
  18. 2021Exploiting Emotional Dependencies with Graph Convolutional Networks for Facial Expression Recognitioncited by 12
  19. 2020RAF-AU Database: In-the-Wild Facial Expressions with Subjective Emotion Judgement and Objective AU Annotationscited by 11
  20. 2022Multimodal Channel-Mixing: Channel and Spatial Masked AutoEncoder on Facial Action Unit Detectioncited by 11
  21. 2024Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimationcited by 11
  22. 2024Can Machine Learning Assist in Diagnosis of Primary Immune Thrombocytopenia? A feasibility studycited by 8
  23. 2017Multi-View Dynamic Facial Action Unit Detectioncited by 7
  24. 2021Critically examining the Domain Generalizability of Facial Expression Recognition modelscited by 4
  25. 2020TAL EmotioNet Challenge 2020 Rethinking the Model Chosen Problem in Multi-Task Learningcited by 2
  26. 2023Efficient Labelling of Affective Video Datasets via Few-Shot & Multi-Task Contrastive Learningcited by 2

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 5.

7 papers.

  1. 2024Behaviour4All: in-the-wild Facial Behaviour Analysis Toolkitcited by 16
  2. 2025DVD: A Comprehensive Dataset for Advancing Violence Detection in Real-World Scenarioscited by 13
  3. 2024Using Prompts to Guide Large Language Models in Imitating a Real Person's Language Stylecited by 6
  4. 2025Shopformer: Transformer-Based Framework for Detecting Shoplifting via Human Posecited by 6
  5. 2025Fair Domain Generalization: An Information-Theoretic Viewcited by 1
  6. 2025Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERCcited by 1
  7. 2025A Feature-level Bias Evaluation Framework for Facial Expression Recognition Modelscited by 0