EmotionLines: An Emotion Corpus of Multi-Party Conversations
Not on the map. Why?
Abstract (arXiv)
Feeling emotion is a critical characteristic to distinguish people from machines. Among all the multi-modal resources for emotion detection, textual datasets are those containing the least additional information in addition to semantics, and hence are adopted widely for testing the developed systems. However, most of the textual emotional datasets consist of emotion labels of only individual words, sentences or documents, which makes it challenging to discuss the contextual flow of emotions. In this paper, we introduce EmotionLines, the first dataset with emotions labeling on all utterances in each dialogue only based on their textual content. Dialogues in EmotionLines are collected from Friends TV scripts and private Facebook messenger dialogues. Then one of seven emotions, six Ekman's basic emotions plus the neutral emotion, is labeled on each utterance by 5 Amazon MTurkers. A total of 29,245 utterances from 2,000 dialogues are labeled in EmotionLines. We also provide several strong baselines for emotion detection models on EmotionLines in this paper.
Key facts. Cited by 80 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 15; 2023: 16; 2024: 15; 2025: 8; 2026: 9.
80 papers.
Sort:
By area:
- 2021MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversationcited by 99
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2021DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversationscited by 71
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
- 2022M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Databasecited by 50
- 2024SocialBench: Sociality Evaluation of Role-Playing Conversational Agentscited by 48
- 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
- 2025AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Modelscited by 43
- 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuningcited by 39
- 2024Distilling an End-to-End Voice Assistant Without Instruction Training Datacited by 35
- 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
38 more
- 2023Learning Emotion Representations from Verbal and Nonverbal Communicationcited by 31
- 2021Multimodal Emotion-Cause Pair Extraction in Conversationscited by 30
- 2022A Multimodal Corpus for Emotion Recognition in Sarcasmcited by 29
- 2021Automatic Evaluation and Moderation of Open-domain Dialogue Systemscited by 28
- 2023Refashioning Emotion Recognition Modelling: The Advent of Generalised Large Modelscited by 16
- 2021Automatically Select Emotion for Response via Personality-affected Emotion Transitioncited by 15
- 2022MSCTD: A Multimodal Sentiment Chat Translation Datasetcited by 15
- 2024Emotion and Intent Joint Understanding in Multimodal Conversation: A Benchmarking Datasetcited by 15
- 2023Is ChatGPT a Good Multi-Party Conversation Solver?cited by 13
- 2025OmniEval: A Benchmark for Evaluating Omni-modal Models with Visual, Auditory, and Textual Inputscited by 13
- 2021Advances in Multi-turn Dialogue Comprehension: A Surveycited by 12
- 2022Deep Emotion Recognition in Textual Conversations: A Surveycited by 12
- 2025Towards Online Multi-Modal Social Interaction Understandingcited by 12
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialoguecited by 12
- 2024SemEval-2024 Task 3: Multimodal Emotion Cause Analysis in Conversationscited by 11
- 2023Overview of Robust and Multilingual Automatic Evaluation Metrics for Open-Domain Dialogue Systems at DSTC 11 Track 4cited by 10
- 2025Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospectscited by 10
- 2021S+PAGE: A Speaker and Position-Aware Graph Neural Network Model for Emotion Recognition in Conversationcited by 9
- 2023StockEmotions: Discover Investor Emotions for Financial Sentiment Analysis and Multivariate Time Seriescited by 9
- 2021Supporting Cognitive and Emotional Empathic Writing of Studentscited by 8
- 2021Empathetic Dialogue Generation with Pre-trained RoBERTa-GPT2 and External Knowledgecited by 8
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoningcited by 8
- 2021English-Twi Parallel Corpus for Machine Translationcited by 7
- 2021Empathetic Dialog Generation with Fine-Grained Intentscited by 7
- 2024Self-Emotion Blended Dialogue Generation in Social Simulation Agentscited by 7
- 2021MultiTalk: A Highly-Branching Dialog Testbed for Diverse Conversationscited by 6
- 2022TSAM: A Two-Stream Attention Model for Causal Emotion Entailmentcited by 6
- 2024DiagESC: Dialogue Synthesis for Integrating Depression Diagnosis into Emotional Support Conversationcited by 6
- 2024Emphasis Rendering for Conversational Text-to-Speech with Multi-modal Multi-scale Context Modelingcited by 6
- 2025Akan Cinematic Emotions (ACE): A Multimodal Multi-party Dataset for Emotion Recognition in Movie Dialoguescited by 6
- 2025Multi-Party Conversational Agents: A Surveycited by 6
- 2021Emotion Dynamics Modeling via BERTcited by 5
- 2022EmoInHindi: A Multi-label Emotion and Intensity Annotated Dataset in Hindi for Emotion Recognition in Dialoguescited by 5
- 2021MUSER: MUltimodal Stress Detection using Emotion Recognition as an Auxiliary Taskcited by 4
- 2022Building a Dialogue Corpus Annotated with Expressed and Experienced Emotionscited by 4
- 2023Affective Visual Dialog: A Large-Scale Benchmark for Emotional Reasoning Based on Visually Grounded Conversationscited by 4
- 2025XModBench: Benchmarking Cross-Modal Capabilities and Consistency in Omni-Language Modelscited by 4
- 2022Whose Emotion Matters? Speaking Activity Localisation without Prior Knowledgecited by 3
50 most cited of 80 All 80 (JSON)
- 2026Bayesian Spectral Emotion Transition Discovery from Multi-Annotator Disagreement1 Jun 2026
- 2026Beyond Sentiment Classification: A Generative Framework for Emotion Intensity Evaluation in Text15 May 2026
- 2026EthicMind: A Risk-Aware Framework for Ethical-Emotional Alignment in Multi-Turn Dialogue10 Apr 2026
- 2026A-MBER: Affective Memory Benchmark for Emotion Recognition8 Apr 2026
- 2026Emotion Entanglement and Bayesian Inference for Multi-Dimensional Emotion Understanding1 Apr 2026
- 2026A benchmark for joint dialogue satisfaction, emotion recognition, and emotion state transition prediction10 Feb 2026
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning1 Feb 2026
- 2026What Gets Activated: Uncovering Domain and Driver Experts in MoE Language Models15 Jan 2026
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialogue9 Jan 2026
- 2025XModBench: Benchmarking Cross-Modal Capabilities and Consistency in Omni-Language Models16 Oct 2025
- 2025MVRS: The Multimodal Virtual Reality Stimuli-based Emotion Recognition Dataset31 Aug 2025
- 2025OmniEval: A Benchmark for Evaluating Omni-modal Models with Visual, Auditory, and Textual Inputs26 Jun 2025
38 more
- 2025Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospects26 May 2025
- 2025Multi-Party Conversational Agents: A Survey24 May 2025
- 2025Towards Online Multi-Modal Social Interaction Understanding25 Mar 2025
- 2025Akan Cinematic Emotions (ACE): A Multimodal Multi-party Dataset for Emotion Recognition in Movie Dialogues16 Feb 2025
- 2025AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Models27 Jan 2025
- 2024Emphasis Rendering for Conversational Text-to-Speech with Multi-modal Multi-scale Context Modeling12 Oct 2024
- 2024Song Emotion Classification of Lyrics with Out-of-Domain Data under Label Scarcity8 Oct 2024
- 2024Distilling an End-to-End Voice Assistant Without Instruction Training Data3 Oct 2024
- 2024DiagESC: Dialogue Synthesis for Integrating Depression Diagnosis into Emotional Support Conversation12 Aug 2024
- 2024Tracking Emotional Dynamics in Chat Conversations: A Hybrid Approach using DistilBERT and Emoji Sentiment Analysis3 Aug 2024
- 2024Self-Emotion Blended Dialogue Generation in Social Simulation Agents3 Aug 2024
- 2024Emotion and Intent Joint Understanding in Multimodal Conversation: A Benchmarking Dataset3 Jul 2024
- 2024Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in Conversations27 Jun 2024
- 2024EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimization27 Jun 2024
- 2024Emotion Identification for French in Written Texts: Considering their Modes of Expression as a Step Towards Text Complexity Analysis23 May 2024
- 2024SemEval-2024 Task 3: Multimodal Emotion Cause Analysis in Conversations19 May 2024
- 2024SocialBench: Sociality Evaluation of Role-Playing Conversational Agents20 Mar 2024
- 2024JMI at SemEval 2024 Task 3: Two-step approach for multimodal ECAC using in-context learning with GPT and instruction-tuned Llama models5 Mar 2024
- 2024KoDialogBench: Evaluating Conversational Understanding of Language Models with Korean Dialogue Benchmark27 Feb 2024
- 2024Learning from Implicit User Feedback, Emotions and Demographic Information in Task-Oriented and Document-Grounded Dialogues17 Jan 2024
- 2023Predicting Evoked Emotions in Conversations31 Dec 2023
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learning10 Dec 2023
- 2023LineConGraphs: Line Conversation Graphs for Effective Emotion Recognition using Graph Neural Networks4 Dec 2023
- 2023CESAR: Automatic Induction of Compositional Instructions for Multi-turn Dialogs29 Nov 2023
- 2023Is ChatGPT a Good Multi-Party Conversation Solver?25 Oct 2023
- 2023EmoTwiCS: A Corpus for Modelling Emotion Trajectories in Dutch Customer Service Dialogues on Twitter10 Oct 2023
- 2023Dynamic Causal Disentanglement Model for Dialogue Emotion Detection13 Sep 2023
- 2023Implicit Design Choices and Their Impact on Emotion Recognition Model Development and Evaluation6 Sep 2023
- 2023Affective Visual Dialog: A Large-Scale Benchmark for Emotional Reasoning Based on Visually Grounded Conversations30 Aug 2023
- 2023Refashioning Emotion Recognition Modelling: The Advent of Generalised Large Models21 Aug 2023
- 2023Overview of Robust and Multilingual Automatic Evaluation Metrics for Open-Domain Dialogue Systems at DSTC 11 Track 422 Jun 2023
- 2023Learning Emotion Representations from Verbal and Nonverbal Communication22 May 2023
- 2023How to Enhance Causal Discrimination of Utterances: A Case on Affective Reasoning4 May 2023
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?19 Apr 2023
- 2023Guilt Detection in Text: A Step Towards Understanding Complex Emotions6 Mar 2023
- 2023StockEmotions: Discover Investor Emotions for Financial Sentiment Analysis and Multivariate Time Series23 Jan 2023
- 2022Whose Emotion Matters? Speaking Activity Localisation without Prior Knowledge23 Nov 2022
- 2022Deep Emotion Recognition in Textual Conversations: A Survey16 Nov 2022
50 newest of 80 All 80 (JSON)
- 2021MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversationcited by 99
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2021DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversationscited by 71
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
- 2022M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Databasecited by 50
- 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
- 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuningcited by 39
- 2024Distilling an End-to-End Voice Assistant Without Instruction Training Datacited by 35
- 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
- 2023Learning Emotion Representations from Verbal and Nonverbal Communicationcited by 31
- 2021Multimodal Emotion-Cause Pair Extraction in Conversationscited by 30
12 most cited of 72 All 72 (JSON)
- 2026Bayesian Spectral Emotion Transition Discovery from Multi-Annotator Disagreement1 Jun 2026
- 2026Beyond Sentiment Classification: A Generative Framework for Emotion Intensity Evaluation in Text15 May 2026
- 2026EthicMind: A Risk-Aware Framework for Ethical-Emotional Alignment in Multi-Turn Dialogue10 Apr 2026
- 2026A-MBER: Affective Memory Benchmark for Emotion Recognition8 Apr 2026
- 2026Emotion Entanglement and Bayesian Inference for Multi-Dimensional Emotion Understanding1 Apr 2026
- 2026A benchmark for joint dialogue satisfaction, emotion recognition, and emotion state transition prediction10 Feb 2026
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialogue9 Jan 2026
- 2025XModBench: Benchmarking Cross-Modal Capabilities and Consistency in Omni-Language Models16 Oct 2025
- 2025MVRS: The Multimodal Virtual Reality Stimuli-based Emotion Recognition Dataset31 Aug 2025
- 2025OmniEval: A Benchmark for Evaluating Omni-modal Models with Visual, Auditory, and Textual Inputs26 Jun 2025
- 2025Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospects26 May 2025
- 2025Towards Online Multi-Modal Social Interaction Understanding25 Mar 2025
12 newest of 72 All 72 (JSON)