mlsanityData to 14 Oct 2026

Training Deep Networks for Facial Expression Recognition with Crowd-Sourced Label Distribution

arXiv 1608.01041 ↗First posted 3 Aug 2016cs.CVcited by 158

Not on the map. Why?

Abstract (arXiv)

Crowd sourcing has become a widely adopted scheme to collect ground truth labels. However, it is a well-known problem that these labels can be very noisy. In this paper, we demonstrate how to learn a deep convolutional neural network (DCNN) from noisy labels, using facial expression recognition as an example. More specifically, we have 10 taggers to label each input image, and compare four different approaches to utilizing the multiple labels: majority voting, multi-label learning, probabilistic label drawing, and cross-entropy loss. We show that the traditional majority voting scheme does not perform as well as the last two approaches that fully leverage the label distribution. An enhanced FER+ data set with multiple labels for each face image will also be shared with the research community.

Key facts. Cited by 158 papers in the map (data through 14 Oct 2026). First posted on arXiv 3 Aug 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 24; 2022: 31; 2023: 27; 2024: 39; 2025: 21; 2026: 16.

158 papers.

Sort:

By area:

  1. 2021MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversationcited by 99
  2. 2021Dive into Ambiguity: Latent Distribution Mining and Pairwise Uncertainty Estimation for Facial Expression Recognitioncited by 89
  3. 2021TransFER: Learning Relation-aware Facial Expression Representations with Transformerscited by 85
  4. 2022Learn From All: Erasing Attention Consistency for Noisy Label Facial Expression Recognitioncited by 67
  5. 2024EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatarscited by 66
  6. 2022M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Databasecited by 50
  7. 2021Facial Expression Recognition with Visual Transformers and Attentional Selective Fusioncited by 49
  8. 2022POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognitioncited by 49
  9. 2023From Static to Dynamic: Adapting Landmark-Aware Image Models for Facial Expression Recognition in Videoscited by 39
  10. 2023GPT-4V with Emotion: A Zero-shot Benchmark for Generalized Emotion Recognitioncited by 38
  11. 2022Vision Transformer with Attentive Pooling for Robust Facial Expression Recognitioncited by 35
  12. 2022Towards Semi-Supervised Deep Facial Expression Recognition with An Adaptive Confidence Margincited by 32
38 more
  1. 2024EMO-LLaMA: Enhancing Facial Emotion Understanding with Instruction Tuningcited by 28
  2. 2021MVT: Mask Vision Transformer for Facial Expression Recognition in the wildcited by 27
  3. 2023Multi-modal Facial Affective Analysis based on Masked Autoencodercited by 23
  4. 2021Responsible AI: Gender bias assessment in emotion recognitioncited by 22
  5. 2023Model Extraction Attacks Revisitedcited by 21
  6. 2022Continuous Emotion Recognition using Visual-audio-linguistic information: A Technical Report for ABAW3cited by 20
  7. 2022CNN Filter DB: An Empirical Investigation of Trained Convolutional Filterscited by 20
  8. 2021Learning Vision Transformer with Squeeze and Excitation for Facial Expression Recognitioncited by 18
  9. 2024Enhancing Zero-Shot Facial Expression Recognition by LLM Knowledge Transfercited by 18
  10. 2023LA-Net: Landmark-Aware Learning for Reliable Facial Expression Recognition under Label Noisecited by 17
  11. 2023Leave No Stone Unturned: Mine Extra Knowledge for Imbalanced Facial Expression Recognitioncited by 17
  12. 2024Self-Supervised Facial Representation Learning with Facial Region Awarenesscited by 17
  13. 2021I Find Your Lack of Uncertainty in Computer Vision Disturbingcited by 16
  14. 2022MovieCLIP: Visual Scene Recognition in Moviescited by 16
  15. 2023Weakly-Supervised Text-driven Contrastive Learning for Facial Behavior Understandingcited by 16
  16. 2021Continuous Emotion Recognition with Audio-visual Leader-follower Attentive Fusioncited by 15
  17. 2022Multi-modal Emotion Estimation for in-the-wild Videoscited by 15
  18. 2024Recursive Joint Cross-Modal Attention for Multimodal Fusion in Dimensional Emotion Recognitioncited by 15
  19. 2023ReSup: Reliable Label Noise Suppression for Facial Expression Recognitioncited by 14
  20. 2023CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognitioncited by 14
  21. 2023Metrics for Dataset Demographic Bias: A Case Study on Facial Expression Recognitioncited by 13
  22. 2023Latent-OFER: Detect, Mask, and Reconstruct with Latent Vectors for Occluded Facial Expression Recognitioncited by 13
  23. 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognitioncited by 13
  24. 2024Faceptor: A Generalist Model for Face Perceptioncited by 13
  25. 2022Boosting Facial Expression Recognition by A Semi-Supervised Progressive Teachercited by 12
  26. 2025Face-Human-Bench: A Comprehensive Benchmark of Face and Human Understanding for Multi-modal Assistantscited by 12
  27. 2022Disentangling Identity and Pose for Facial Expression Recognitioncited by 11
  28. 2022Multi-Task Learning Framework for Emotion Recognition in-the-wildcited by 10
  29. 2022HashVFL: Defending Against Data Reconstruction Attacks in Vertical Federated Learningcited by 10
  30. 2022Uncertain Facial Expression Recognition via Multi-task Assisted Correctioncited by 10
  31. 2023Ecosystem-level Analysis of Deployed Machine Learning Reveals Homogeneous Outcomescited by 10
  32. 2021Speech2Video: Cross-Modal Distillation for Speech to Video Generationcited by 9
  33. 2021Teacher-Student Training and Triplet Loss to Reduce the Effect of Drastic Face Occlusioncited by 9
  34. 2022Assessing Demographic Bias Transfer from Dataset to Model: A Case Study in Facial Expression Recognitioncited by 9
  35. 2022Emotion Separation and Recognition from a Facial Expression by Generating the Poker Face with Vision Transformerscited by 9
  36. 2023ARBEx: Attentive Feature Extraction with Reliability Balancing for Robust Facial Expression Learningcited by 9
  37. 2024Textualized and Feature-based Models for Compound Multimodal Emotion Recognition in the Wildcited by 9
  38. 2024AffectNet+: A Database for Enhancing Facial Expression Recognition with Soft-Labelscited by 9

50 most cited of 158 All 158 (JSON)