Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
While there have been significant advances in detecting emotions from speech and image recognition, emotion detection on text is still under-explored and remained as an active research field. This paper introduces a corpus for text-based emotion detection on multiparty dialogue as well as deep neural models that outperform the existing approaches for document classification. We first present a new corpus that provides annotation of seven emotions on consecutive utterances in dialogues extracted from the show, Friends. We then suggest four types of sequence-based convolutional neural network models with attention that leverage the sequence information encapsulated in dialogue. Our best model shows the accuracies of 37.9% and 54% for fine- and coarse-grained emotions, respectively. Given the difficulty of this task, this is promising.
Key facts. Cited by 102 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 16; 2023: 30; 2024: 18; 2025: 16; 2026: 9.
102 papers.
Sort:
By area:
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
- 2021Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detectioncited by 56
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
- 2023Towards Interpretable Mental Health Analysis with Large Language Modelscited by 53
- 2022M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Databasecited by 50
- 2025SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Informationcited by 42
- 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
- 2021Contrast and Generation Make BART a Good Dialogue Emotion Recognizercited by 35
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
38 more
- 2022A Multimodal Corpus for Emotion Recognition in Sarcasmcited by 29
- 2023DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversationscited by 29
- 2021Graph Based Network with Contextualized Representations of Turns in Dialoguecited by 26
- 2024Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directionscited by 26
- 2021Hybrid Curriculum Learning for Emotion Recognition in Conversationcited by 25
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspectivecited by 24
- 2021EmoWOZ: A Large-Scale Corpus and Labelling Scheme for Emotion Recognition in Task-Oriented Dialogue Systemscited by 20
- 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversationscited by 19
- 2023UniSA: Unified Generative Framework for Sentiment Analysiscited by 17
- 2021Automatically Select Emotion for Response via Personality-affected Emotion Transitioncited by 15
- 2023Cluster-Level Contrastive Learning for Emotion Recognition in Conversationscited by 14
- 2025Nature-Inspired Population-Based Evolution of Large Language Modelscited by 14
- 2023Is ChatGPT a Good Multi-Party Conversation Solver?cited by 13
- 2024LaERC-S: Improving LLM-based Emotion Recognition in Conversation with Speaker Characteristicscited by 13
- 2022Deep Emotion Recognition in Textual Conversations: A Surveycited by 12
- 2023Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Modelscited by 12
- 2022FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialoguecited by 11
- 2023InstructERC: Reforming Emotion Recognition in Conversation with Multi-task Retrieval-Augmented Large Language Modelscited by 11
- 2023Bias in Emotion Recognition with ChatGPTcited by 11
- 2024Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligencecited by 11
- 2024BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Taskscited by 11
- 2025Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospectscited by 10
- 2021S+PAGE: A Speaker and Position-Aware Graph Neural Network Model for Emotion Recognition in Conversationcited by 9
- 2023BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversationcited by 9
- 2024Major Entity Identification: A Generalizable Alternative to Coreference Resolutioncited by 9
- 2024EmoDynamiX: Emotional Support Dialogue Strategy Prediction by Modelling MiXed Emotions and Discourse Dynamicscited by 9
- 2022Speaker-Guided Encoder-Decoder Framework for Emotion Recognition in Conversationcited by 8
- 2023Commonsense Reasoning for Conversational AI: A Survey of the State of the Artcited by 7
- 2023EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversationcited by 7
- 2023Hierarchical Dialogue Understanding with Special Tokens and Turn-level Attentioncited by 6
- 2025Akan Cinematic Emotions (ACE): A Multimodal Multi-party Dataset for Emotion Recognition in Movie Dialoguescited by 6
- 2025Multi-Party Conversational Agents: A Surveycited by 6
- 2025Why Do More Experts Fail? A Theoretical Analysis of Model Mergingcited by 6
- 2023RBA-GCN: Relational Bilevel Aggregation Graph Convolutional Network for Emotion Recognitioncited by 5
- 2023Efficient Cross-Task Prompt Tuning for Few-Shot Conversational Emotion Recognitioncited by 5
- 2022The Emotion is Not One-hot Encoding: Learning with Grayscale Label for Emotion Recognition in Conversationcited by 4
- 2022Contextual Information and Commonsense Based Prompt for Emotion Recognition in Conversationcited by 4
- 2022GRASP: Guiding model with RelAtional Semantics using Prompt for Dialogue Relation Extractioncited by 4
50 most cited of 102 All 102 (JSON)
- 2026Exposing Weaknesses in Emotion Recognition in Conversations5 Sep 2026
- 2026AtmosERC: Modeling Dialogue-Level Affective Atmosphere for Emotion Recognition in Conversation29 Jul 2026
- 2026Model Merging to Evolution: Parameter Space Exploration for Expert Models17 Jun 2026
- 2026Self-EmoQ: Plutchik-Guided Value-based Planning to Drive Streaming Emotional TTS21 Apr 2026
- 2026SELF-EMO: Emotional Self-Evolution from Recognition to Consistent Expression20 Apr 2026
- 2026Linguistic Signatures for Enhanced Emotion Detection4 Mar 2026
- 2026A Mixture-of-Experts Model for Multimodal Emotion Recognition in Conversations26 Feb 2026
- 2026A benchmark for joint dialogue satisfaction, emotion recognition, and emotion state transition prediction10 Feb 2026
- 2026Towards Efficient and Robust Linguistic Emotion Diagnosis for Mental Health via Multi-Agent Instruction Refinement20 Jan 2026
- 2025OmniMER: Auxiliary-Enhanced LLM Adaptation for Indonesian Multimodal Emotion Recognition22 Dec 2025
- 2025A Customer Journey in the Land of Oz: Leveraging the Wizard of Oz Technique to Model Emotions in Customer Service Interactions26 Nov 2025
- 2025ResFormer: All-Time Reservoir Memory for Long Sequence Classification28 Sep 2025
38 more
- 2025MVRS: The Multimodal Virtual Reality Stimuli-based Emotion Recognition Dataset31 Aug 2025
- 2025Emotion Transfer with Enhanced Prototype for Unseen Emotion Recognition in Conversation27 Aug 2025
- 2025In-Context Examples Matter: Improving Emotion Recognition in Conversation with Instruction Tuning16 Aug 2025
- 2025Can Large Language Models Generate Effective Datasets for Emotion Recognition in Conversations?7 Aug 2025
- 2025How to Retrieve Examples in In-context Learning to Improve Conversational Emotion Recognition using Large Language Models?25 Jun 2025
- 2025When LLMs Team Up: The Emergence of Collaborative Affective Computing2 Jun 2025
- 2025Why Do More Experts Fail? A Theoretical Analysis of Model Merging27 May 2025
- 2025Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospects26 May 2025
- 2025Multi-Party Conversational Agents: A Survey24 May 2025
- 2025SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Information19 May 2025
- 2025Nature-Inspired Population-Based Evolution of Large Language Models3 Mar 2025
- 2025Akan Cinematic Emotions (ACE): A Multimodal Multi-party Dataset for Emotion Recognition in Movie Dialogues16 Feb 2025
- 2025TED: Turn Emphasis with Dialogue Feature Attention for Emotion Recognition in Conversation2 Jan 2025
- 2024The Emotional Spectrum of LLMs: Leveraging Empathy and Emotion-Based Markers for Mental Health Support28 Dec 2024
- 2024SentiXRL: An advanced large language Model Framework for Multilingual Fine-Grained Emotion Classification in Complex Text Environment27 Nov 2024
- 2024Once More, With Feeling: Measuring Emotion of Acting Performances in Contemporary American Film15 Nov 2024
- 2024CAPE: A Chinese Dataset for Appraisal-based Emotional Generation using Large Language Models18 Oct 2024
- 2024EmoDynamiX: Emotional Support Dialogue Strategy Prediction by Modelling MiXed Emotions and Discourse Dynamics16 Aug 2024
- 2024Recognizing Emotion Regulation Strategies from Human Behavior with Large Language Models8 Aug 2024
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspective30 Jul 2024
- 2024BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks5 Jul 2024
- 2024Major Entity Identification: A Generalizable Alternative to Coreference Resolution20 Jun 2024
- 2024ESIHGNN: Event-State Interactions Infused Heterogeneous Graph Neural Network for Conversational Emotion Recognition7 May 2024
- 2024Empirical Analysis of Dialogue Relation Extraction with Large Language Models27 Apr 2024
- 2024Samsung Research China-Beijing at SemEval-2024 Task 3: A multi-stage framework for Emotion-Cause Pair Extraction in Conversations25 Apr 2024
- 2024Personality-affected Emotion Generation in Dialog Systems3 Apr 2024
- 2024Token Trails: Navigating Contextual Depths in Conversational AI with ChatLLM3 Apr 2024
- 2024Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversation29 Mar 2024
- 2024LaERC-S: Improving LLM-based Emotion Recognition in Conversation with Speaker Characteristics12 Mar 2024
- 2024Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions2 Mar 2024
- 2024Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence15 Feb 2024
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learning10 Dec 2023
- 2023CESAR: Automatic Induction of Compositional Instructions for Multi-turn Dialogs29 Nov 2023
- 2023Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Models9 Nov 2023
- 2023SSL Framework for Causal Inconsistency between Structures and Representations28 Oct 2023
- 2023Is ChatGPT a Good Multi-Party Conversation Solver?25 Oct 2023
- 2023Efficient Cross-Task Prompt Tuning for Few-Shot Conversational Emotion Recognition23 Oct 2023
- 2023Bias in Emotion Recognition with ChatGPT18 Oct 2023
50 newest of 102 All 102 (JSON)
- 2025SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Informationcited by 42
- 2023Commonsense Reasoning for Conversational AI: A Survey of the State of the Artcited by 7
- 2023How to Enhance Causal Discrimination of Utterances: A Case on Affective Reasoningcited by 3
- 2023A Bipartite Graph is All We Need for Enhancing Emotional Reasoning with Commonsense Knowledgecited by 2
- 2025SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Information19 May 2025
- 2023A Bipartite Graph is All We Need for Enhancing Emotional Reasoning with Commonsense Knowledge9 Aug 2023
- 2023How to Enhance Causal Discrimination of Utterances: A Case on Affective Reasoning4 May 2023
- 2023Commonsense Reasoning for Conversational AI: A Survey of the State of the Art15 Feb 2023
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
- 2021Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detectioncited by 56
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
- 2023Towards Interpretable Mental Health Analysis with Large Language Modelscited by 53
- 2022M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Databasecited by 50
- 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
- 2021Contrast and Generation Make BART a Good Dialogue Emotion Recognizercited by 35
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
- 2022A Multimodal Corpus for Emotion Recognition in Sarcasmcited by 29
12 most cited of 94 All 94 (JSON)
- 2026Exposing Weaknesses in Emotion Recognition in Conversations5 Sep 2026
- 2026AtmosERC: Modeling Dialogue-Level Affective Atmosphere for Emotion Recognition in Conversation29 Jul 2026
- 2026Model Merging to Evolution: Parameter Space Exploration for Expert Models17 Jun 2026
- 2026Self-EmoQ: Plutchik-Guided Value-based Planning to Drive Streaming Emotional TTS21 Apr 2026
- 2026SELF-EMO: Emotional Self-Evolution from Recognition to Consistent Expression20 Apr 2026
- 2026Linguistic Signatures for Enhanced Emotion Detection4 Mar 2026
- 2026A benchmark for joint dialogue satisfaction, emotion recognition, and emotion state transition prediction10 Feb 2026
- 2025OmniMER: Auxiliary-Enhanced LLM Adaptation for Indonesian Multimodal Emotion Recognition22 Dec 2025
- 2025A Customer Journey in the Land of Oz: Leveraging the Wizard of Oz Technique to Model Emotions in Customer Service Interactions26 Nov 2025
- 2025ResFormer: All-Time Reservoir Memory for Long Sequence Classification28 Sep 2025
- 2025MVRS: The Multimodal Virtual Reality Stimuli-based Emotion Recognition Dataset31 Aug 2025
- 2025Emotion Transfer with Enhanced Prototype for Unseen Emotion Recognition in Conversation27 Aug 2025
12 newest of 94 All 94 (JSON)