mlsanityData to 7 Oct 2026

Context-Aware Emotion Recognition Networks

arXiv 1908.05913 ↗First posted 16 Aug 2019cs.CV cs.HC cs.MMcited by 99

Not on the map. Why?

Abstract (arXiv)

Traditional techniques for emotion recognition have focused on the facial expression analysis only, thus providing limited ability to encode context that comprehensively represents the emotional responses. We present deep networks for context-aware emotion recognition, called CAER-Net, that exploit not only human facial expression but also context information in a joint and boosting manner. The key idea is to hide human faces in a visual scene and seek other contexts based on an attention mechanism. Our networks consist of two sub-networks, including two-stream encoding networks to seperately extract the features of face and context regions, and adaptive fusion networks to fuse such features in an adaptive fashion. We also introduce a novel benchmark for context-aware emotion recognition, called CAER, that is more appropriate than existing benchmarks both qualitatively and quantitatively. On several benchmarks, CAER-Net proves the effect of context for emotion recognition. Our dataset is available at http://caer-dataset.github.io.

Key facts. Cited by 99 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Aug 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 10; 2022: 15; 2023: 23; 2024: 21; 2025: 18; 2026: 12.

99 papers.

Sort:

By area:

  1. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
  2. 2022FERV39k: A Large-Scale Multi-Scene Dataset for Facial Expression Recognition in Videoscited by 69
  3. 2022MAFW: A Large-scale, Multi-modal, Compound Affective Database for Dynamic Facial Expression Recognition in the Wildcited by 65
  4. 2025HumanOmni: A Large Vision-Speech Language Model for Human-Centric Video Understandingcited by 58
  5. 2024Benchmarking Micro-action Recognition: Dataset, Methods, and Applicationscited by 48
  6. 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
  7. 2023Prompting Visual-Language Models for Dynamic Facial Expression Recognitioncited by 43
  8. 2022Intensity-Aware Loss for Dynamic Facial Expression Recognition in the Wildcited by 41
  9. 2023Context De-confounded Emotion Recognitioncited by 34
  10. 2021Expression Snippet Transformer for Robust Video-based Facial Expression Recognitioncited by 33
  11. 2023Learning Emotion Representations from Verbal and Nonverbal Communicationcited by 31
  12. 2022Uncertainty-aware Label Distribution Learning for Facial Expression Recognitioncited by 30
38 more
  1. 2024FineCLIPER: Multi-modal Fine-grained CLIP for Dynamic Facial Expression Recognition with AdaptERscited by 30
  2. 2022Spatio-Temporal Transformer for Dynamic Facial Expression Recognition in the Wildcited by 29
  3. 2022NR-DFERNet: Noise-Robust Network for Dynamic Facial Expression Recognitioncited by 26
  4. 2023POSTER++: A simpler and stronger facial expression recognition networkcited by 25
  5. 2024Robust Emotion Recognition in Context Debiasingcited by 24
  6. 2021Global-Local Attention for Emotion Recognitioncited by 20
  7. 2024FindingEmo: An Image Dataset for Emotion Recognition in the Wildcited by 20
  8. 2025Evaluating Vision-Language Models for Emotion Recognitioncited by 19
  9. 2025HumanDreamer: Generating Controllable Human-Motion Videos via Decoupled Generationcited by 19
  10. 2024Enhancing Zero-Shot Facial Expression Recognition by LLM Knowledge Transfercited by 18
  11. 2025MME-Emotion: A Holistic Evaluation Benchmark for Emotional Intelligence in Multimodal Large Language Modelscited by 17
  12. 2022Multi-modal Emotion Estimation for in-the-wild Videoscited by 15
  13. 2024VLLMs Provide Better Context for Emotion Understanding Through Common Sense Reasoningcited by 15
  14. 2021Graph-based Facial Affect Analysis: A Reviewcited by 14
  15. 2021Leveraging Semantic Scene Characteristics and Multi-Stream Convolutional Architectures in a Contextual Approach for Video-Based Visual Emotion Recognition in the Wildcited by 12
  16. 2023Metrics for Dataset Demographic Bias: A Case Study on Facial Expression Recognitioncited by 12
  17. 2023Unlocking the Emotional World of Visual Media: An Overview of the Science, Research, and Impact of Understanding Emotioncited by 12
  18. 2023VEATIC: Video-based Emotion and Affect Tracking in Context Datasetcited by 12
  19. 2023Adversarial Representation with Intra-Modal and Inter-Modal Graph Contrastive Learning for Multimodal Emotion Recognitioncited by 12
  20. 2024Large Vision-Language Models as Emotion Recognizers in Context Awarenesscited by 12
  21. 2021Towards Unbiased Visual Emotion Recognition via Causal Interventioncited by 11
  22. 2024Towards Context-Aware Emotion Recognition Debiasing from a Causal Demystification Perspective via De-confounded Trainingcited by 11
  23. 2024Holistic-Motion2D: Scalable Whole-body Human Motion Generation in 2D Spacecited by 10
  24. 2024Contextual Emotion Recognition using Large Vision Language Modelscited by 8
  25. 2024StimuVAR: Spatiotemporal Stimuli-aware Video Affective Reasoning with Multimodal Large Language Modelscited by 8
  26. 2023High-Level Context Representation for Emotion Recognition in Imagescited by 7
  27. 2022Predicting emotion from music videos: exploring the relative contribution of visual and auditory information to affective responsescited by 6
  28. 2023How you feelin'? Learning Emotions and Mental States in Movie Scenescited by 6
  29. 2024SynFER: Towards Boosting Facial Expression Recognition with Synthetic Datacited by 6
  30. 2022Most Important Person-guided Dual-branch Cross-Patch Attention for Group Affect Recognitioncited by 5
  31. 2023Mitigating Group Bias in Federated Learning for Heterogeneous Devicescited by 5
  32. 2023DSAP: Analyzing Bias Through Demographic Comparison of Datasetscited by 5
  33. 2024Two in One Go: Single-stage Emotion Recognition with Decoupled Subject-context Transformercited by 5
  34. 2024Facial Expression Analysis and Its Potentials in IoT Systems: A Contemporary Surveycited by 5
  35. 2026Emotion-LLaMAv2 and MMEVerse: A New Framework and Benchmark for Multimodal Emotion Understandingcited by 5
  36. 2021Pairwise Emotional Relationship Recognition in Drama Videos: Dataset and Benchmarkcited by 4
  37. 2022Estimating Structural Disparities for Face Modelscited by 4
  38. 2023In the Blink of an Eye: Event-based Emotion Recognitioncited by 4

50 most cited of 99 All 99 (JSON)