mlsanityData to 7 Oct 2026

A Multi-task Mean Teacher for Semi-supervised Facial Affective Behavior Analysis

arXiv 2107.04225 ↗First posted 9 Jul 2021cs.CV cs.HCcited by 19

Not on the map. Why?

Abstract (arXiv)

Affective Behavior Analysis is an important part in human-computer interaction. Existing multi-task affective behavior recognition methods suffer from the problem of incomplete labeled datasets. To tackle this problem, this paper presents a semi-supervised model with a mean teacher framework to leverage additional unlabeled data. To be specific, a multi-task model is proposed to learn three different kinds of facial affective representations simultaneously. After that, the proposed model is assigned to be student and teacher networks. When training with unlabeled data, the teacher network is employed to predict pseudo labels for student network training, which allows it to learn from unlabeled data. Experimental results showed that our proposed method achieved much better performance than baseline model and ranked 4th in both competition track 1 and track 2, and 6th in track 3, which verifies that the proposed network can effectively learn from incomplete datasets.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 9 Jul 2021.

Builds on

17 of 26 references.

References · 17

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
  4. 2019HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimationcited by 247
  5. 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
  6. 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
  7. 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
  8. 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
  9. 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
  10. 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
  11. 2020Suppressing Uncertainties for Large-Scale Facial Expression Recognitioncited by 157
  12. 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
5 more
  1. 2020Two-Stream Aural-Visual Affect Analysis in the Wildcited by 51
  2. 2020Multitask Emotion Recognition with Incomplete Labelscited by 39
  3. 2021Prior Aided Streaming Network for Multi-task Affective Recognitionat the 2nd ABAW2 Competitioncited by 18
  4. 2019MIMAMO Net: Integrating Micro- and Macro-motion for Video Emotion Recognitioncited by 17
  5. 2021Technical Report for Valence-Arousal Estimation on Affwild2 Datasetcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 8; 2023: 4; 2024: 4; 2025: 0; 2026: 2.

19 papers.

Sort:

  1. 2022ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Multi-Task Learning Challengescited by 156
  2. 2022ABAW: Learning from Synthetic Data & Multi-Task Learning Challengescited by 110
  3. 2023ABAW: Valence-Arousal Estimation, Expression Recognition, Action Unit Detection & Emotional Reaction Intensity Estimation Challengescited by 110
  4. 2024The 6th Affective Behavior Analysis in-the-wild (ABAW) Competitioncited by 78
  5. 20247th ABAW Competition: Multi-Task Learning and Compound Expression Recognitioncited by 53
  6. 2022Transformer-based Multimodal Information Fusion for Facial Expression Analysiscited by 49
  7. 2022Vision Transformer with Attentive Pooling for Robust Facial Expression Recognitioncited by 35
  8. 2022A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognitioncited by 33
  9. 2023Multi-modal Facial Affective Analysis based on Masked Autoencodercited by 23
  10. 2022Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attentioncited by 18
  11. 2024Recursive Joint Cross-Modal Attention for Multimodal Fusion in Dimensional Emotion Recognitioncited by 15
  12. 2022Facial Expression Classification using Fusion of Deep Neural Network in Video for the 3rd ABAW3 Competitioncited by 5
7 more
  1. 2024Multimodal Fusion Method with Spatiotemporal Sequences and Relationship Learning for Valence-Arousal Estimationcited by 5
  2. 2022Analysis of Semi-Supervised Methods for Facial Expression Recognitioncited by 4
  3. 2023A Survey of Historical Learning: Learning Models with Learning Historycited by 3
  4. 2023Contrastive Learning of View-Invariant Representations for Facial Expressions Recognitioncited by 2
  5. 2026A Shared Latent for Partially-Labeled Multi-Task Facial Affect Recognitioncited by 1
  6. 2021Consensual Collaborative Training And Knowledge Distillation Based Facial Expression Recognition Under Noisy Annotationscited by 0
  7. 2026Strength-Parity Ensembling with Parameter-Isolated Experts for Multi-Task Affect Recognitioncited by 0