SemEval 2024 -- Task 10: Emotion Discovery and Reasoning its Flip in Conversation (EDiReF)
Not on the map. Why?
Abstract (arXiv)
We present SemEval-2024 Task 10, a shared task centred on identifying emotions and finding the rationale behind their flips within monolingual English and Hindi-English code-mixed dialogues. This task comprises three distinct subtasks - emotion recognition in conversation for code-mixed dialogues, emotion flip reasoning for code-mixed dialogues, and emotion flip reasoning for English dialogues. Participating systems were tasked to automatically execute one or more of these subtasks. The datasets for these tasks comprise manually annotated conversations focusing on emotions and triggers for emotion shifts (The task data is available at https://github.com/LCS2-IIITD/EDiReF-SemEval2024.git). A total of 84 participants engaged in this task, with the most adept systems attaining F1-scores of 0.70, 0.79, and 0.76 for the respective subtasks. This paper summarises the results and findings from 24 teams alongside their system descriptions.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 23 of its 72 references that are in the map. First posted on arXiv 29 Feb 2024.
Builds on
23 of 72 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 186
- 2019Knowledge-Enriched Transformer for Emotion Detection in Textual Conversationscited by 92
- 2020DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognitioncited by 79
- 2020Recognizing Emotion Cause in Conversationscited by 66
- 2019HiGRU: Hierarchical Gated Recurrent Units for Utterance-level Emotion Recognitioncited by 43
- 2019Real-Time Emotion Recognition via Attention Gated Hierarchical Memory Networkcited by 38
11 more
- 2021Multi-modal Sarcasm Detection and Humor Classification in Code-mixed Conversationscited by 33
- 2022When did you become so smart, oh wise one?! Sarcasm Explanation in Multi-modal Multi-party Dialoguescited by 33
- 2021Multimodal Emotion-Cause Pair Extraction in Conversationscited by 31
- 2020BiERU: Bidirectional Emotional Recurrent Unit for Conversational Sentiment Analysiscited by 28
- 2019Context-Aware Self-Attention Networkscited by 25
- 2021Hybrid Curriculum Learning for Emotion Recognition in Conversationcited by 25
- 2021Discovering Emotion and Reasoning its Flip in Multi-Party Conversations using Masked Memory Network and Transformercited by 14
- 2021Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approachcited by 8
- 2022Explaining (Sarcastic) Utterances to Enhance Affect Understanding in Multimodal Dialoguescited by 6
- 2023Emotion Flip Reasoning in Multiparty Conversationscited by 4
- 2023From Multilingual Complexity to Emotional Clarity: Leveraging Commonsense to Unveil Emotions in Code-Mixed Dialoguescited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 2.
5 papers.
- 2024Transformer based neural networks for emotion recognition in conversationscited by 2
- 2026SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversationscited by 2
- 2024IITK at SemEval-2024 Task 10: Who is the speaker? Improving Emotion Recognition and Flip Reasoning in Conversations via Speaker Embeddingscited by 0
- 2025AIMA at SemEval-2024 Task 10: History-Based Emotion Recognition in Hindi-English Code-Mixed Conversationscited by 0
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Surveycited by 0
- 2026SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations13 May 2026
- 2026NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey26 Jan 2026
- 2025AIMA at SemEval-2024 Task 10: History-Based Emotion Recognition in Hindi-English Code-Mixed Conversations19 Jan 2025
- 2024Transformer based neural networks for emotion recognition in conversations18 May 2024
- 2024IITK at SemEval-2024 Task 10: Who is the speaker? Improving Emotion Recognition and Flip Reasoning in Conversations via Speaker Embeddings6 Apr 2024