mlsanityData to 14 Oct 2026

Feature Pyramid Network for Multi-task Affective Analysis

arXiv 2107.03670 ↗First posted 8 Jul 2021cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Affective Analysis is not a single task, and the valence-arousal value, expression class, and action unit can be predicted at the same time. Previous researches did not pay enough attention to the entanglement and hierarchical relation of these three facial attributes. We propose a novel model named feature pyramid networks for multi-task affect analysis. The hierarchical features are extracted to predict three labels and we apply a teacher-student training strategy to learn from pretrained single-task models. Extensive experiment results demonstrate the proposed model outperforms other models. This is a submission to The 2nd Workshop and Competition on Affective Behavior Analysis in the wild (ABAW). The code and model are available for research purposes at https://github.com/ryanhe312/ABAW2-FPNMAA.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 48 references that are in the map. First posted on arXiv 8 Jul 2021.

Builds on

25 of 48 references.

References · 25

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  4. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  5. 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
  6. 2016Cross-stitch Networks for Multi-task Learningcited by 467
  7. 2019Expression, Affect, Action Unit Recognition: Aff-Wild2, Multi-Task Learning and ArcFacecited by 222
  8. 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
  9. 2020Analysing Affective Behavior in the First ABAW 2020 Competitioncited by 178
  10. 2021Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Frameworkcited by 174
  11. 2021Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Studycited by 168
  12. 2021Analysing Affective Behavior in the second ABAW2 Competitioncited by 163
13 more
  1. 2020Suppressing Uncertainties for Large-Scale Facial Expression Recognitioncited by 157
  2. 2019Face Behavior a la carte: Expressions, Affect and Action Units in a Single Networkcited by 155
  3. 2016Fully-adaptive Feature Sharing in Multi-Task Networks with Applications in Person Attribute Classificationcited by 93
  4. 2014Designing Deep Networks for Surface Normal Estimationcited by 59
  5. 2018Deep Adaptive Attention for Joint Facial Action Unit Detection and Face Alignmentcited by 55
  6. 2016From Facial Expression Recognition to Interpersonal Relation Predictioncited by 53
  7. 2019Stochastic Filter Groups for Multi-Task CNNs: Learning Specialist and Generalist Convolution Kernelscited by 42
  8. 2017Beyond Shared Hierarchies: Deep Multitask Learning through Soft Layer Orderingcited by 28
  9. 2017EAC-Net: A Region-based Deep Enhancing and Cropping Approach for Facial Action Unit Detectioncited by 26
  10. 2020Facial Action Unit Intensity Estimation via Semantic Correspondence Learning with Dynamic Graph Convolutioncited by 22
  11. 2017Generic 3D Representation via Pose Estimation and Matchingcited by 17
  12. 2015Learning Multiple Tasks with Multilinear Relationship Networkscited by 11
  13. 2020Semi-supervised Learning with a Teacher-student Network for Generalized Attribute Predictioncited by 5

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 0; 2023: 0; 2024: 2.

3 papers.

  1. 2024Distilling Privileged Multimodal Information for Expression Recognition using Optimal Transportcited by 15
  2. 2024Multi Teacher Privileged Knowledge Distillation for Multimodal Expression Recognitioncited by 3
  3. 2021Consensual Collaborative Training And Knowledge Distillation Based Facial Expression Recognition Under Noisy Annotationscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026AffectFuse: Cross-Task Feature Fusion with Temporal Modeling for Multi-Task Affective Behavior Analysis
  2. 2022Multitask Emotion Recognition Model with Knowledge Distillation and Task Discriminator
  3. 2024Facial Affective Behavior Analysis with Instruction Tuning
  4. 2026AffectFlow-DINO: Uncertainty-Aware Multi-Task Affect Estimation via Conditional Rectified Flow
  5. 2026Visual Affect Analysis: Predicting Emotions of Image Viewers with Vision-Language Models
  6. 2025Reading Smiles: Proxy Bias in Foundation Models for Facial Emotion Recognition
  7. 2024ExpLLM: Towards Chain of Thought for Facial Expression Recognition
  8. 2025Facial-R1: Aligning Reasoning and Recognition for Facial Emotion Analysis