mlsanityData to 7 Oct 2026

EmoCaps: Emotion Capsule based Model for Conversational Emotion Recognition

arXiv 2203.13504 ↗First posted 25 Mar 2022cs.CL cs.SD eess.AScited by 48

Not on the map. Why?

Abstract (arXiv)

Emotion recognition in conversation (ERC) aims to analyze the speaker's state and identify their emotion in the conversation. Recent works in ERC focus on context modeling but ignore the representation of contextual emotional tendency. In order to extract multi-modal information and the emotional tendency of the utterance effectively, we propose a new structure named Emoformer to extract multi-modal emotion vectors from different modalities and fuse them with sentence vector to be an emotion capsule. Furthermore, we design an end-to-end ERC model called EmoCaps, which extracts emotion vectors through the Emoformer structure and obtain the emotion classification results from a context analysis model. Through the experiments with two benchmark datasets, our model shows better performance than the existing state-of-the-art models.

Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 16 of its 28 references that are in the map. First posted on arXiv 25 Mar 2022.

Builds on

16 of 28 references.

References · 16

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  4. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  5. 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 429
  6. 2021A Survey of Transformerscited by 399
  7. 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 216
  8. 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 184
  9. 2020COSMIC: COmmonSense knowledge for eMotion Identification in Conversationscited by 135
  10. 2021MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversationcited by 99
  11. 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
  12. 2018Multi-attention Recurrent Network for Human Communication Comprehensioncited by 89
4 more
  1. 2020DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognitioncited by 78
  2. 2021DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversationscited by 71
  3. 2020DialogueTRM: Exploring the Intra- and Inter-Modal Emotional Behaviors in the Conversationcited by 12
  4. 2021SEOVER: Sentence-level Emotion Orientation Vector based Conversation Emotion Recognition Modelcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 10; 2024: 20; 2025: 7; 2026: 8.

48 papers.

Sort:

By area:

  1. 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 83
  2. 2023Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversationscited by 47
  3. 2024Revisiting Multi-modal Emotion Learning with Broad State Space Models and Probability-guidance Fusioncited by 33
  4. 2024Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrumcited by 33
  5. 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
  6. 2023A Low-rank Matching Attention based Cross-modal Feature Fusion Method for Conversational Emotion Recognitioncited by 29
  7. 2022DiaASQ : A Benchmark of Conversational Aspect-based Sentiment Quadruple Analysiscited by 27
  8. 2023UniSA: Unified Generative Framework for Sentiment Analysiscited by 17
  9. 2023DICNet: Deep Instance-Level Contrastive Network for Double Incomplete Multi-View Multi-Label Classificationcited by 13
  10. 2022Deep Emotion Recognition in Textual Conversations: A Surveycited by 12
  11. 2024A Two-Stage Multimodal Emotion Recognition Model Based on Graph Contrastive Learningcited by 12
  12. 2024TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversationcited by 12
36 more
  1. 2024Recent Advances in Multimodal Affective Computing: An NLP Perspectivecited by 12
  2. 2023HCAM -- Hierarchical Cross Attention Model for Multi-modal Emotion Recognitioncited by 11
  3. 2025Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospectscited by 10
  4. 2024MIPS at SemEval-2024 Task 3: Multimodal Emotion-Cause Pair Extraction in Conversations with Multimodal Language Modelscited by 9
  5. 2024HCQA @ Ego4D EgoSchema Challenge 2024cited by 9
  6. 2025MSE-Adapter: A Lightweight Plugin Endowing LLMs with the Capability to Perform Multimodal Sentiment Analysis and Emotion Recognitioncited by 9
  7. 2024UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion Causecited by 8
  8. 2024Tracing Intricate Cues in Dialogue: Joint Graph Structure and Sentiment Dynamics for Multimodal Emotion Recognitioncited by 8
  9. 2023EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversationcited by 7
  10. 2023Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in Conversationcited by 6
  11. 2023Efficient Cross-Task Prompt Tuning for Few-Shot Conversational Emotion Recognitioncited by 5
  12. 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Modelcited by 5
  13. 2025Unimodal-driven Distillation in Multimodal Emotion Recognition with Dynamic Fusioncited by 4
  14. 2022Whose Emotion Matters? Speaking Activity Localisation without Prior Knowledgecited by 3
  15. 2024Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversationcited by 3
  16. 2024Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversationcited by 3
  17. 2024EmoVerse: Exploring Multimodal Large Language Models for Sentiment and Emotion Understandingcited by 3
  18. 2026Navigating the Emotion Tree: Hierarchical Hyperbolic RAG for Multimodal Emotion Recognitioncited by 3
  19. 2025Decoding the Flow: CauseMotion for Emotional Causality Analysis in Long-form Conversationscited by 2
  20. 2024AMuSE: Adaptive Multimodal Analysis for Speaker Emotion Recognition in Group Conversationscited by 1
  21. 2025Bias Beneath the Tone: Empirical Characterisation of Tone Bias in LLM-Driven UX Systemscited by 1
  22. 2023Multiscale Contextual Learning for Speech Emotion Recognition in Emergency Call Center Conversationscited by 0
  23. 2024AM^2-EmoJE: Adaptive Missing-Modality Emotion Recognition in Conversation via Joint Embedding Learningcited by 0
  24. 2024ECRC: Emotion-Causality Recognition in Korean Conversation for GCNcited by 0
  25. 2024Context-Aware Siamese Networks for Efficient Emotion Recognition in Conversationcited by 0
  26. 2024AIMDiT: Modality Augmentation and Interaction via Multimodal Dimension Transformation for Emotion Recognition in Conversationscited by 0
  27. 2024Knowledge-Aware Conversation Derailment Forecasting Using Graph Convolutional Networkscited by 0
  28. 2024"My life is miserable, have to sign 500 autographs everyday": Exposing Humblebragging, the Brags in Disguisecited by 0
  29. 2025Heterogeneous bimodal attention fusion for speech emotion recognitioncited by 0
  30. 2025ADMC: Attention-based Diffusion Model for Missing Modalities Feature Completioncited by 0
  31. 2026Causal Emotion Recognition in Conversation: Context Saturation and Discourse-Marker Evidencecited by 0
  32. 2026Expert-Guided Multimodal Fusion for Unified Emotion and Sentiment Analysiscited by 0
  33. 2026Relational graph-driven differential denoising and diffusion attention fusion for multimodal conversation emotion recognitioncited by 0
  34. 2026To Fuse or to Drop? Dual-Path Learning for Resolving Modality Conflicts in Multimodal Emotion Recognitioncited by 0
  35. 2026MVFA: A Multi-View Text-Guided Multimodal Fusion LLM Adapter for Sentiment Analysis and Emotion Recognitioncited by 0
  36. 2026Cross-Modal Emotion Understanding: A Transformer-GAT Approach for Dialogue Emotion Recognitioncited by 0