Contrast and Generation Make BART a Good Dialogue Emotion Recognizer
Not on the map. Why?
Abstract (arXiv)
In dialogue systems, utterances with similar semantics may have distinctive emotions under different contexts. Therefore, modeling long-range contextual emotional relationships with speaker dependency plays a crucial part in dialogue emotion recognition. Meanwhile, distinguishing the different emotion categories is non-trivial since they usually have semantically similar sentiments. To this end, we adopt supervised contrastive learning to make different emotions mutually exclusive to identify similar emotions better. Meanwhile, we utilize an auxiliary response generation task to enhance the model's ability of handling context information, thereby forcing the model to recognize emotions with similar semantics in diverse contexts. To achieve these objectives, we use the pre-trained encoder-decoder model BART as our backbone model since it is very suitable for both understanding and generation tasks. The experiments on four datasets demonstrate that our proposed model obtains significantly more favorable results than the state-of-the-art model in dialogue emotion recognition. The ablation study further demonstrates the effectiveness of supervised contrastive loss and generative loss.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 27 of its 35 references that are in the map. First posted on arXiv 21 Dec 2021.
Builds on
27 of 35 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2020Supervised Contrastive Learningcited by 2,803
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 544
15 more
- 2020Pre-trained Models for Natural Language Processing: A Surveycited by 504
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2021A Survey of Transformerscited by 399
- 2020Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningcited by 275
- 2021ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfercited by 231
- 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 184
- 2020COSMIC: COmmonSense knowledge for eMotion Identification in Conversationscited by 135
- 2021Self-Guided Contrastive Learning for BERT Sentence Representationscited by 103
- 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2019Knowledge-Enriched Transformer for Emotion Detection in Textual Conversationscited by 92
- 2020DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognitioncited by 78
- 2021DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversationscited by 71
- 2021Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detectioncited by 56
- 2021Multi-Task Learning of Generation and Classification for Emotion-Aware Dialogue Response Generationcited by 15
Built on by
Citing papers per year: 2022: 6; 2023: 18; 2024: 7; 2025: 2; 2026: 2.
35 papers.
Sort:
By area:
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognitioncited by 61
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
- 2023A Low-rank Matching Attention based Cross-modal Feature Fusion Method for Conversational Emotion Recognitioncited by 29
- 2023DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversationscited by 29
- 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversationscited by 19
- 2023UniSA: Unified Generative Framework for Sentiment Analysiscited by 17
- 2024Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked Autoencodercited by 15
- 2023Cluster-Level Contrastive Learning for Emotion Recognition in Conversationscited by 14
- 2023CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognitioncited by 14
- 2023Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognitioncited by 14
- 2022Deep Emotion Recognition in Textual Conversations: A Surveycited by 12
- 2022Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Modelcited by 11
23 more
- 2022Revisiting Self-Supervised Contrastive Learning for Facial Expression Recognitioncited by 9
- 2024Tracing Intricate Cues in Dialogue: Joint Graph Structure and Sentiment Dynamics for Multimodal Emotion Recognitioncited by 8
- 2023EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversationcited by 7
- 2024Sentiment-oriented Transformer-based Variational Autoencoder Network for Live Video Commentingcited by 7
- 2023Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in Conversationcited by 6
- 2025Multi-Party Conversational Agents: A Surveycited by 6
- 2023Disentangled Variational Autoencoder for Emotion Recognition in Conversationscited by 5
- 2022The Emotion is Not One-hot Encoding: Learning with Grayscale Label for Emotion Recognition in Conversationcited by 4
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmarkcited by 4
- 2023Mimicking the Thinking Process for Emotion Recognition in Conversation with Prompts and Paraphrasingcited by 4
- 2024Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversationcited by 3
- 2024Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversationcited by 3
- 2024ESIHGNN: Event-State Interactions Infused Heterogeneous Graph Neural Network for Conversational Emotion Recognitioncited by 2
- 2023A Dual-Stream Recurrence-Attention Network With Global-Local Awareness for Emotion Recognition in Textual Dialogcited by 1
- 2023FATRER: Full-Attention Topic Regularizer for Accurate and Robust Conversational Emotion Recognitioncited by 1
- 2023ERNetCL: A novel emotion recognition network in textual conversation based on curriculum learning strategycited by 1
- 2023Watch the Speakers: A Hybrid Continuous Attribution Network for Emotion Recognition in Conversation With Emotion Disentanglementcited by 1
- 2024Rule-driven News Captioningcited by 1
- 2026A Mixture-of-Experts Model for Multimodal Emotion Recognition in Conversationscited by 1
- 2023Exploiting Pseudo Future Contexts for Emotion Recognition in Conversationscited by 0
- 2023SSLCL: An Efficient Model-Agnostic Supervised Contrastive Learning Framework for Emotion Recognition in Conversationscited by 0
- 2025Dual Knowledge-Enhanced Two-Stage Reasoner for Multimodal Dialog Systemscited by 0
- 2026Causal Emotion Recognition in Conversation: Context Saturation and Discourse-Marker Evidencecited by 0
- 2026A Mixture-of-Experts Model for Multimodal Emotion Recognition in Conversations26 Feb 2026
- 2026Causal Emotion Recognition in Conversation: Context Saturation and Discourse-Marker Evidence1 Jan 2026
- 2025Dual Knowledge-Enhanced Two-Stage Reasoner for Multimodal Dialog Systems9 Sep 2025
- 2025Multi-Party Conversational Agents: A Survey24 May 2025
- 2024Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversation4 Dec 2024
- 2024Tracing Intricate Cues in Dialogue: Joint Graph Structure and Sentiment Dynamics for Multimodal Emotion Recognition31 Jul 2024
- 2024ESIHGNN: Event-State Interactions Infused Heterogeneous Graph Neural Network for Conversational Emotion Recognition7 May 2024
- 2024Sentiment-oriented Transformer-based Variational Autoencoder Network for Live Video Commenting19 Apr 2024
- 2024Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversation29 Mar 2024
- 2024Rule-driven News Captioning8 Mar 2024
- 2024Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked Autoencoder27 Feb 2024
- 2023Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition18 Nov 2023
23 more
- 2023SSLCL: An Efficient Model-Agnostic Supervised Contrastive Learning Framework for Emotion Recognition in Conversations25 Oct 2023
- 2023DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversations17 Oct 2023
- 2023Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in Conversation4 Oct 2023
- 2023Watch the Speakers: A Hybrid Continuous Attribution Network for Emotion Recognition in Conversation With Emotion Disentanglement18 Sep 2023
- 2023UniSA: Unified Generative Framework for Sentiment Analysis4 Sep 2023
- 2023ERNetCL: A novel emotion recognition network in textual conversation based on curriculum learning strategy12 Aug 2023
- 2023CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognition28 Jul 2023
- 2023FATRER: Full-Attention Topic Regularizer for Accurate and Robust Conversational Emotion Recognition23 Jul 2023
- 2023A Dual-Stream Recurrence-Attention Network With Global-Local Awareness for Emotion Recognition in Textual Dialog2 Jul 2023
- 2023Exploiting Pseudo Future Contexts for Emotion Recognition in Conversations27 Jun 2023
- 2023A Low-rank Matching Attention based Cross-modal Feature Fusion Method for Conversational Emotion Recognition16 Jun 2023
- 2023Mimicking the Thinking Process for Emotion Recognition in Conversation with Prompts and Paraphrasing11 Jun 2023
- 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversations2 Jun 2023
- 2023Disentangled Variational Autoencoder for Emotion Recognition in Conversations23 May 2023
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmark2 May 2023
- 2023EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversation20 Mar 2023
- 2023Cluster-Level Contrastive Learning for Emotion Recognition in Conversations7 Feb 2023
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition21 Nov 2022
- 2022Deep Emotion Recognition in Textual Conversations: A Survey16 Nov 2022
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversation17 Oct 2022
- 2022Revisiting Self-Supervised Contrastive Learning for Facial Expression Recognition8 Oct 2022
- 2022Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model16 Jul 2022
- 2022The Emotion is Not One-hot Encoding: Learning with Grayscale Label for Emotion Recognition in Conversation15 Jun 2022
- 2025Multi-Party Conversational Agents: A Surveycited by 6
- 2025Multi-Party Conversational Agents: A Survey24 May 2025
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognitioncited by 61
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
- 2023A Low-rank Matching Attention based Cross-modal Feature Fusion Method for Conversational Emotion Recognitioncited by 29
- 2023DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversationscited by 29
- 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversationscited by 19
- 2023UniSA: Unified Generative Framework for Sentiment Analysiscited by 17
- 2024Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked Autoencodercited by 15
- 2023Cluster-Level Contrastive Learning for Emotion Recognition in Conversationscited by 14
- 2023CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognitioncited by 14
- 2023Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognitioncited by 14
- 2022Deep Emotion Recognition in Textual Conversations: A Surveycited by 12
- 2022Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Modelcited by 11
12 most cited of 32 All 32 (JSON)
- 2026Causal Emotion Recognition in Conversation: Context Saturation and Discourse-Marker Evidence1 Jan 2026
- 2024Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversation4 Dec 2024
- 2024Tracing Intricate Cues in Dialogue: Joint Graph Structure and Sentiment Dynamics for Multimodal Emotion Recognition31 Jul 2024
- 2024ESIHGNN: Event-State Interactions Infused Heterogeneous Graph Neural Network for Conversational Emotion Recognition7 May 2024
- 2024Sentiment-oriented Transformer-based Variational Autoencoder Network for Live Video Commenting19 Apr 2024
- 2024Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversation29 Mar 2024
- 2024Rule-driven News Captioning8 Mar 2024
- 2024Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked Autoencoder27 Feb 2024
- 2023Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition18 Nov 2023
- 2023SSLCL: An Efficient Model-Agnostic Supervised Contrastive Learning Framework for Emotion Recognition in Conversations25 Oct 2023
- 2023DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversations17 Oct 2023
- 2023Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in Conversation4 Oct 2023
12 newest of 32 All 32 (JSON)