Deep Emotion Recognition in Textual Conversations: A Survey
Not on the map. Why?
Abstract (arXiv)
Emotion Recognition in Conversations (ERC) is a key step towards successful human-machine interaction. While the field has seen tremendous advancement in the last few years, new applications and implementation scenarios present novel challenges and opportunities. These range from leveraging the conversational context, speaker, and emotion dynamics modelling, to interpreting common sense expressions, informal language, and sarcasm, addressing challenges of real-time ERC, recognizing emotion causes, different taxonomies across datasets, multilingual ERC, and interpretability. This survey starts by introducing ERC, elaborating on the challenges and opportunities of this task. It proceeds with a description of the emotion taxonomies and a variety of ERC benchmark datasets employing such taxonomies. This is followed by descriptions comparing the most prominent works in ERC with explanations of the neural architectures employed. Then, it provides advisable ERC practices towards better frameworks, elaborating on methods to deal with subjectivity in annotations and modelling and methods to deal with the typically unbalanced ERC datasets. Finally, it presents systematic review tables comparing several works regarding the methods used and their performance. Benchmarking these works highlights resorting to pre-trained Transformer Language Models to extract utterance representations, using Gated and Graph Neural Networks to model the interactions between these utterances, and leveraging Generative Large Language Models to tackle ERC within a generative framework. This survey emphasizes the advantage of leveraging techniques to address unbalanced data, the exploration of mixed emotions, and the benefits of incorporating annotation subjectivity in the learning phase.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 60 of its 177 references that are in the map. First posted on arXiv 16 Nov 2022.
Builds on
60 of 177 references.
References · 60
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2018Deep contextualized word representationscited by 2,290
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
38 more
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2019Attention is not Explanationcited by 929
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
- 2019Attention is not not Explanationcited by 636
- 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 486
- 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 463
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 218
- 2017Advances in Pre-Training Distributed Word Representationscited by 207
- 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 186
- 2020COSMIC: COmmonSense knowledge for eMotion Identification in Conversationscited by 136
- 2019Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advancescited by 119
- 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
- 2021MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversationcited by 99
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2019Knowledge-Enriched Transformer for Emotion Detection in Textual Conversationscited by 92
- 2018EmotionLines: An Emotion Corpus of Multi-Party Conversationscited by 80
- 2020DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognitioncited by 79
- 2021DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversationscited by 71
- 2021Directed Acyclic Graph Neural Networkscited by 70
- 2020Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Researchcited by 67
- 2020Recognizing Emotion Cause in Conversationscited by 66
- 2021Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detectioncited by 56
- 2022MM-DFN: Multimodal Dynamic Fusion Network for Emotion Recognition in Conversationscited by 52
- 2022EmoCaps: Emotion Capsule based Model for Conversational Emotion Recognitioncited by 48
- 2019Real-Time Emotion Recognition via Attention Gated Hierarchical Memory Networkcited by 38
- 2020Hierarchical Pre-training for Sequence Labelling in Spoken Dialogcited by 36
- 2021Contrast and Generation Make BART a Good Dialogue Emotion Recognizercited by 35
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
- 2020BiERU: Bidirectional Emotional Recurrent Unit for Conversational Sentiment Analysiscited by 28
- 2021Graph Based Network with Contextualized Representations of Turns in Dialoguecited by 26
- 2021Hybrid Curriculum Learning for Emotion Recognition in Conversationcited by 25
- 2021Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysiscited by 22
- 2022GA2MIF: Graph and Attention Based Two-Stage Multi-Source Information Fusion for Conversational Emotion Detectioncited by 20
- 2019EmotionX-IDEA: Emotion BERT -- an Affectional Model for Conversationcited by 13
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2023: 5; 2024: 2; 2025: 3; 2026: 3.
13 papers.
Sort:
By area:
- 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognitioncited by 13
- 2023Context-Dependent Embedding Utterance Representations for Emotion Recognition in Conversationscited by 3
- 2023How to Enhance Causal Discrimination of Utterances: A Case on Affective Reasoningcited by 3
- 2024ConText at WASSA 2024 Empathy and Personality Shared Task: History-Dependent Embedding Utterance Representations for Empathy and Emotion Prediction in Conversationscited by 3
- 2024JMI at SemEval 2024 Task 3: Two-step approach for multimodal ECAC using in-context learning with GPT and instruction-tuned Llama modelscited by 2
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systemscited by 1
- 2023Fuzzy Fingerprinting Transformer Language-Models for Emotion Recognition in Conversationscited by 1
- 2025Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERCcited by 1
- 2026Caring Without Feeling: Affective Dynamics as the Control Layer of Human-AI Agent Collaborationcited by 1
- 2025Emotion Recognition in Multi-Speaker Conversations through Speaker Identification, Knowledge Distillation, and Hierarchical Fusioncited by 0
- 2025A Customer Journey in the Land of Oz: Leveraging the Wizard of Oz Technique to Model Emotions in Customer Service Interactionscited by 0
- 2026Fuzzy Fingerprinting Encoder Pre-trained Language Models for Emotion Recognition in Conversations: Human Assessment and Validity Studycited by 0
1 more
- 2026Emotion Recognition in Sign Language Conversationcited by 0
- 2026Emotion Recognition in Sign Language Conversation22 May 2026
- 2026Caring Without Feeling: Affective Dynamics as the Control Layer of Human-AI Agent Collaboration8 May 2026
- 2026Fuzzy Fingerprinting Encoder Pre-trained Language Models for Emotion Recognition in Conversations: Human Assessment and Validity Study4 May 2026
- 2025A Customer Journey in the Land of Oz: Leveraging the Wizard of Oz Technique to Model Emotions in Customer Service Interactions26 Nov 2025
- 2025Emotion Recognition in Multi-Speaker Conversations through Speaker Identification, Knowledge Distillation, and Hierarchical Fusion5 Nov 2025
- 2025Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERC6 Aug 2025
- 2024ConText at WASSA 2024 Empathy and Personality Shared Task: History-Dependent Embedding Utterance Representations for Empathy and Emotion Prediction in Conversations4 Jul 2024
- 2024JMI at SemEval 2024 Task 3: Two-step approach for multimodal ECAC using in-context learning with GPT and instruction-tuned Llama models5 Mar 2024
- 2023Fuzzy Fingerprinting Transformer Language-Models for Emotion Recognition in Conversations8 Sep 2023
- 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition8 Aug 2023
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems14 Jul 2023
- 2023How to Enhance Causal Discrimination of Utterances: A Case on Affective Reasoning4 May 2023
- 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognitioncited by 13
- 2023Context-Dependent Embedding Utterance Representations for Emotion Recognition in Conversationscited by 3
- 2024ConText at WASSA 2024 Empathy and Personality Shared Task: History-Dependent Embedding Utterance Representations for Empathy and Emotion Prediction in Conversationscited by 3
- 2024JMI at SemEval 2024 Task 3: Two-step approach for multimodal ECAC using in-context learning with GPT and instruction-tuned Llama modelscited by 2
- 2023Fuzzy Fingerprinting Transformer Language-Models for Emotion Recognition in Conversationscited by 1
- 2025Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERCcited by 1
- 2025A Customer Journey in the Land of Oz: Leveraging the Wizard of Oz Technique to Model Emotions in Customer Service Interactionscited by 0
- 2026Fuzzy Fingerprinting Encoder Pre-trained Language Models for Emotion Recognition in Conversations: Human Assessment and Validity Studycited by 0
- 2026Emotion Recognition in Sign Language Conversationcited by 0
- 2026Emotion Recognition in Sign Language Conversation22 May 2026
- 2026Fuzzy Fingerprinting Encoder Pre-trained Language Models for Emotion Recognition in Conversations: Human Assessment and Validity Study4 May 2026
- 2025A Customer Journey in the Land of Oz: Leveraging the Wizard of Oz Technique to Model Emotions in Customer Service Interactions26 Nov 2025
- 2025Grounding Emotion Recognition with Visual Prototypes: VEGA -- Revisiting CLIP in MERC6 Aug 2025
- 2024ConText at WASSA 2024 Empathy and Personality Shared Task: History-Dependent Embedding Utterance Representations for Empathy and Emotion Prediction in Conversations4 Jul 2024
- 2024JMI at SemEval 2024 Task 3: Two-step approach for multimodal ECAC using in-context learning with GPT and instruction-tuned Llama models5 Mar 2024
- 2023Fuzzy Fingerprinting Transformer Language-Models for Emotion Recognition in Conversations8 Sep 2023
- 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition8 Aug 2023
- 2023Context-Dependent Embedding Utterance Representations for Emotion Recognition in Conversations17 Apr 2023