CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation
Not on the map. Why?
Abstract (arXiv)
As the use of interactive machines grow, the task of Emotion Recognition in Conversation (ERC) became more important. If the machine-generated sentences reflect emotion, more human-like sympathetic conversations are possible. Since emotion recognition in conversation is inaccurate if the previous utterances are not taken into account, many studies reflect the dialogue context to improve the performances. Many recent approaches show performance improvement by combining knowledge into modules learned from external structured data. However, structured data is difficult to access in non-English languages, making it difficult to extend to other languages. Therefore, we extract the pre-trained memory using the pre-trained language model as an extractor of external knowledge. We introduce CoMPM, which combines the speaker's pre-trained memory with the context model, and find that the pre-trained memory significantly improves the performance of the context model. CoMPM achieves the first or second performance on all data and is state-of-the-art among systems that do not leverage structured data. In addition, our method shows that it can be extended to other languages because structured knowledge is not required, unlike previous methods. Our code is available on github (https://github.com/rungjoo/CoMPM).
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 24 of its 47 references that are in the map. First posted on arXiv 26 Aug 2021.
Builds on
24 of 47 references.
References · 24
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 429
- 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 216
- 2016A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialoguescited by 174
- 2020COSMIC: COmmonSense knowledge for eMotion Identification in Conversationscited by 135
12 more
- 2019Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advancescited by 118
- 2020Towards Conversational Recommendation over Multi-Type Dialogscited by 107
- 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
- 2019Knowledge-Enriched Transformer for Emotion Detection in Textual Conversationscited by 92
- 2021DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversationscited by 71
- 2018Modeling Multi-turn Conversation with Deep Utterance Aggregationcited by 65
- 2021Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detectioncited by 56
- 2019Real-Time Emotion Recognition via Attention Gated Hierarchical Memory Networkcited by 38
- 2020DCR-Net: A Deep Co-Interactive Relation Network for Joint Dialog Act Recognition and Sentiment Classificationcited by 28
- 2020EmpTransfo: A Multi-head Transformer Architecture for Creating Empathetic Dialog Systemscited by 19
- 2019EDA: Enriching Emotional Dialogue Acts using an Ensemble of Neural Annotatorscited by 5
- 2019TripleNet: Triple Attention Network for Multi-Turn Response Selection in Retrieval-based Chatbotscited by 4
Built on by
Citing papers per year: 2022: 5; 2023: 13; 2024: 11; 2025: 2; 2026: 4.
35 papers.
Sort:
By area:
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognitioncited by 61
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
- 2024Revisiting Multi-modal Emotion Learning with Broad State Space Models and Probability-guidance Fusioncited by 33
- 2024Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrumcited by 33
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
- 2024Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directionscited by 26
- 2023DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognitioncited by 23
- 2024Efficient Long-distance Latent Relation-aware Graph Neural Network for Multi-modal Emotion Recognition in Conversationscited by 23
- 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversationscited by 19
- 2023UniSA: Unified Generative Framework for Sentiment Analysiscited by 17
- 2023Refashioning Emotion Recognition Modelling: The Advent of Generalised Large Modelscited by 16
- 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognitioncited by 13
23 more
- 2024TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversationcited by 12
- 2024BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Taskscited by 11
- 2024LARA: Linguistic-Adaptive Retrieval-Augmentation for Multi-Turn Intent Classificationcited by 10
- 2023BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversationcited by 9
- 2024UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion Causecited by 8
- 2023Disentangled Variational Autoencoder for Emotion Recognition in Conversationscited by 5
- 2023A Change of Heart: Improving Speech Emotion Recognition through Speech-to-Text Modality Conversioncited by 5
- 2022The Emotion is Not One-hot Encoding: Learning with Grayscale Label for Emotion Recognition in Conversationcited by 4
- 2022Whose Emotion Matters? Speaking Activity Localisation without Prior Knowledgecited by 3
- 2024Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversationcited by 3
- 2023EmoTwiCS: A Corpus for Modelling Emotion Trajectories in Dutch Customer Service Dialogues on Twittercited by 2
- 2023From Multilingual Complexity to Emotional Clarity: Leveraging Commonsense to Unveil Emotions in Code-Mixed Dialoguescited by 2
- 2024ESIHGNN: Event-State Interactions Infused Heterogeneous Graph Neural Network for Conversational Emotion Recognitioncited by 2
- 2025Can Large Language Models Generate Effective Datasets for Emotion Recognition in Conversations?cited by 2
- 2026SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversationscited by 2
- 2023HIINT: Historical, Intra- and Inter- personal Dynamics Modeling with Cross-person Memory Transformercited by 1
- 2022M-MELD: A Multilingual Multi-Party Dataset for Emotion Recognition in Conversationscited by 0
- 2023SSLCL: An Efficient Model-Agnostic Supervised Contrastive Learning Framework for Emotion Recognition in Conversationscited by 0
- 2024Retrieving Implicit and Explicit Emotional Events Using Large Language Modelscited by 0
- 2025DRKF: Decoupled Representations with Knowledge Fusion for Multimodal Emotion Recognitioncited by 0
- 2026Dynamic Fusion-Aware Graph Convolutional Neural Network for Multimodal Emotion Recognition in Conversationscited by 0
- 2026Relational graph-driven differential denoising and diffusion attention fusion for multimodal conversation emotion recognitioncited by 0
- 2026VISAFF: Speaker-Centered Visual Affective Feature Learning for Emotion Recognition in Conversationcited by 0
- 2026VISAFF: Speaker-Centered Visual Affective Feature Learning for Emotion Recognition in Conversation18 May 2026
- 2026SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations13 May 2026
- 2026Relational graph-driven differential denoising and diffusion attention fusion for multimodal conversation emotion recognition22 Mar 2026
- 2026Dynamic Fusion-Aware Graph Convolutional Neural Network for Multimodal Emotion Recognition in Conversations22 Mar 2026
- 2025Can Large Language Models Generate Effective Datasets for Emotion Recognition in Conversations?7 Aug 2025
- 2025DRKF: Decoupled Representations with Knowledge Fusion for Multimodal Emotion Recognition3 Aug 2025
- 2024Retrieving Implicit and Explicit Emotional Events Using Large Language Models24 Oct 2024
- 2024BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks5 Jul 2024
- 2024Efficient Long-distance Latent Relation-aware Graph Neural Network for Multi-modal Emotion Recognition in Conversations27 Jun 2024
- 2024ESIHGNN: Event-State Interactions Infused Heterogeneous Graph Neural Network for Conversational Emotion Recognition7 May 2024
- 2024Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrum27 Apr 2024
- 2024Revisiting Multi-modal Emotion Learning with Broad State Space Models and Probability-guidance Fusion27 Apr 2024
23 more
- 2024UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion Cause30 Mar 2024
- 2024Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversation29 Mar 2024
- 2024LARA: Linguistic-Adaptive Retrieval-Augmentation for Multi-Turn Intent Classification25 Mar 2024
- 2024Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions2 Mar 2024
- 2024TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversation16 Jan 2024
- 2023DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognition17 Dec 2023
- 2023SSLCL: An Efficient Model-Agnostic Supervised Contrastive Learning Framework for Emotion Recognition in Conversations25 Oct 2023
- 2023From Multilingual Complexity to Emotional Clarity: Leveraging Commonsense to Unveil Emotions in Code-Mixed Dialogues19 Oct 2023
- 2023EmoTwiCS: A Corpus for Modelling Emotion Trajectories in Dutch Customer Service Dialogues on Twitter10 Oct 2023
- 2023UniSA: Unified Generative Framework for Sentiment Analysis4 Sep 2023
- 2023Refashioning Emotion Recognition Modelling: The Advent of Generalised Large Models21 Aug 2023
- 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition8 Aug 2023
- 2023A Change of Heart: Improving Speech Emotion Recognition through Speech-to-Text Modality Conversion21 Jul 2023
- 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversations2 Jun 2023
- 2023Disentangled Variational Autoencoder for Emotion Recognition in Conversations23 May 2023
- 2023HIINT: Historical, Intra- and Inter- personal Dynamics Modeling with Cross-person Memory Transformer21 May 2023
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?19 Apr 2023
- 2023BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation17 Jan 2023
- 2022Whose Emotion Matters? Speaking Activity Localisation without Prior Knowledge23 Nov 2022
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition21 Nov 2022
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversation17 Oct 2022
- 2022The Emotion is Not One-hot Encoding: Learning with Grayscale Label for Emotion Recognition in Conversation15 Jun 2022
- 2022M-MELD: A Multilingual Multi-Party Dataset for Emotion Recognition in Conversations31 Mar 2022
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognitioncited by 61
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
- 2024Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrumcited by 33
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
- 2024Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directionscited by 26
- 2023DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognitioncited by 23
- 2024Efficient Long-distance Latent Relation-aware Graph Neural Network for Multi-modal Emotion Recognition in Conversationscited by 23
- 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversationscited by 19
- 2023UniSA: Unified Generative Framework for Sentiment Analysiscited by 17
- 2023Refashioning Emotion Recognition Modelling: The Advent of Generalised Large Modelscited by 16
- 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognitioncited by 13
- 2024TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversationcited by 12
12 most cited of 34 All 34 (JSON)
- 2026VISAFF: Speaker-Centered Visual Affective Feature Learning for Emotion Recognition in Conversation18 May 2026
- 2026SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations13 May 2026
- 2026Relational graph-driven differential denoising and diffusion attention fusion for multimodal conversation emotion recognition22 Mar 2026
- 2026Dynamic Fusion-Aware Graph Convolutional Neural Network for Multimodal Emotion Recognition in Conversations22 Mar 2026
- 2025Can Large Language Models Generate Effective Datasets for Emotion Recognition in Conversations?7 Aug 2025
- 2025DRKF: Decoupled Representations with Knowledge Fusion for Multimodal Emotion Recognition3 Aug 2025
- 2024Retrieving Implicit and Explicit Emotional Events Using Large Language Models24 Oct 2024
- 2024BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks5 Jul 2024
- 2024Efficient Long-distance Latent Relation-aware Graph Neural Network for Multi-modal Emotion Recognition in Conversations27 Jun 2024
- 2024ESIHGNN: Event-State Interactions Infused Heterogeneous Graph Neural Network for Conversational Emotion Recognition7 May 2024
- 2024Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrum27 Apr 2024
- 2024UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion Cause30 Mar 2024
12 newest of 34 All 34 (JSON)