COSMIC: COmmonSense knowledge for eMotion Identification in Conversations
Not on the map. Why?
Abstract (arXiv)
In this paper, we address the task of utterance level emotion recognition in conversations using commonsense knowledge. We propose COSMIC, a new framework that incorporates different elements of commonsense such as mental states, events, and causal relations, and build upon them to learn interactions between interlocutors participating in a conversation. Current state-of-the-art methods often encounter difficulties in context propagation, emotion shift detection, and differentiating between related emotion classes. By learning distinct commonsense representations, COSMIC addresses these challenges and achieves new state-of-the-art results for emotion recognition on four different benchmark conversational datasets. Our code is available at https://github.com/declare-lab/conv-emotion.
Key facts. Cited by 135 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 24; 2023: 43; 2024: 24; 2025: 8; 2026: 18.
135 papers.
Sort:
By area:
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMscited by 62
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognitioncited by 61
- 2021EmoBERTa: Speaker-Aware Emotion Recognition in Conversation with RoBERTacited by 59
- 2021Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detectioncited by 56
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
- 2022EmoCaps: Emotion Capsule based Model for Conversational Emotion Recognitioncited by 48
- 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
- 2022CICERO: A Dataset for Contextualized Commonsense Inference in Dialoguescited by 38
- 2023A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in Conversationscited by 37
- 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
- 2021Contrast and Generation Make BART a Good Dialogue Emotion Recognizercited by 35
38 more
- 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
- 2021Graph Based Network with Contextualized Representations of Turns in Dialoguecited by 26
- 2024Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directionscited by 26
- 2021Hybrid Curriculum Learning for Emotion Recognition in Conversationcited by 25
- 2024MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent Recognition and Out-of-scope Detection in Conversationscited by 25
- 2021EmoWOZ: A Large-Scale Corpus and Labelling Scheme for Emotion Recognition in Task-Oriented Dialogue Systemscited by 20
- 2022GraphCFC: A Directed Graph Based Cross-Modal Feature Complementation Approach for Multimodal Conversational Emotion Recognitioncited by 20
- 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversationscited by 19
- 2023Conversation Understanding using Relational Temporal Graph Neural Networks with Auxiliary Cross-Modality Interactioncited by 18
- 2023UniSA: Unified Generative Framework for Sentiment Analysiscited by 17
- 2021Dyadformer: A Multi-modal Transformer for Long-Range Modeling of Dyadic Interactionscited by 16
- 2022Don't Lose Yourself! Empathetic Response Generation via Explicit Self-Other Awarenesscited by 16
- 2022Knowledge-Bridged Causal Interaction Network for Causal Emotion Entailmentcited by 16
- 2021Automatically Select Emotion for Response via Personality-affected Emotion Transitioncited by 15
- 2023Think Twice: A Human-like Two-stage Conversational Agent for Emotional Response Generationcited by 14
- 2023Cluster-Level Contrastive Learning for Emotion Recognition in Conversationscited by 14
- 2023CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognitioncited by 14
- 2023Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognitioncited by 14
- 2022Neutral Utterances are Also Causes: Enhancing Conversational Causal Emotion Entailment with Social Commonsense Knowledgecited by 13
- 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognitioncited by 13
- 2024LaERC-S: Improving LLM-based Emotion Recognition in Conversation with Speaker Characteristicscited by 13
- 2022Deep Emotion Recognition in Textual Conversations: A Surveycited by 12
- 2023Improving Empathetic Dialogue Generation by Dynamically Infusing Commonsense Knowledgecited by 12
- 2024TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversationcited by 12
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialoguecited by 12
- 2024BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Taskscited by 11
- 2024Synth-Empathy: Towards High-Quality Synthetic Empathy Datacited by 10
- 2025Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospectscited by 10
- 2021Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Modelscited by 9
- 2021Shapes of Emotions: Multimodal Emotion Recognition in Conversations via Emotion Shiftscited by 9
- 2023BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversationcited by 9
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directionscited by 9
- 2021Multi-Task Learning and Adapted Knowledge Models for Emotion-Cause Extractioncited by 8
- 2021SAPPHIRE: Approaches for Enhanced Concept-to-Text Generationcited by 8
- 2022C3KG: A Chinese Commonsense Conversation Knowledge Graphcited by 8
- 2022M2R2: Missing-Modality Robust emotion Recognition framework with iterative data augmentationcited by 8
50 most cited of 135 All 135 (JSON)
- 2026COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoning19 Sep 2026
- 2026When to Call an LLM: A Confidence-Gated Hybrid for Cost-Effective Emotion Recognition in Conversational AI16 Sep 2026
- 2026ReH-FUSE: Reliability-Aware Hierarchical Fusion of Experts for Multimodal Emotion Recognition in Conversation12 Sep 2026
- 2026Exposing Weaknesses in Emotion Recognition in Conversations5 Sep 2026
- 2026Chiaroscuro for Emotions: A Contrastive Emotion Benchmark Grounded in Appraisal Theory3 Sep 2026
- 2026DiaRelay: Relaying Dialogue Context with a Constant-Size Memory for Emotion Recognition in Conversation24 Aug 2026
- 2026Surfacing the Unsaid: CUE-Bench for Affective Stance in Chinese Discourse11 Aug 2026
- 2026AtmosERC: Modeling Dialogue-Level Affective Atmosphere for Emotion Recognition in Conversation29 Jul 2026
- 2026SHAP-Weighted Cross-Modal Expert Fusion for Emotion and Sentiment Recognition: Evidence and Limits9 Jul 2026
- 2026Emotion Recognition in Sign Language Conversation22 May 2026
- 2026Leveraging Self-Paced Curriculum Learning for Enhanced Modality Balance in Multimodal Conversational Emotion Recognition20 May 2026
- 2026SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations13 May 2026
38 more
- 2026Phase Transitions in Affective Meaning Divergence: The Hidden Drift Before the Break9 May 2026
- 2026Fuzzy Fingerprinting Encoder Pre-trained Language Models for Emotion Recognition in Conversations: Human Assessment and Validity Study4 May 2026
- 2026SELF-EMO: Emotional Self-Evolution from Recognition to Consistent Expression20 Apr 2026
- 2026Divide and Refine: Enhancing Multimodal Representation and Explainability for Emotion Recognition in Conversation10 Jan 2026
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialogue9 Jan 2026
- 2026Causal Emotion Recognition in Conversation: Context Saturation and Discourse-Marker Evidence1 Jan 2026
- 2025Cross-Space Synergy: A Unified Framework for Multimodal Emotion Recognition in Conversation3 Dec 2025
- 2025Do LLMs Feel? Teaching Emotion Recognition with Prompts, Retrieval, and Curriculum Learning10 Nov 2025
- 2025Emotion Transfer with Enhanced Prototype for Unseen Emotion Recognition in Conversation27 Aug 2025
- 2025CHEER-Ekman: Fine-grained Embodied Emotion Classification1 Jun 2025
- 2025Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospects26 May 2025
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions7 Apr 2025
- 2025Heterogeneous bimodal attention fusion for speech emotion recognition9 Mar 2025
- 2025TED: Turn Emphasis with Dialogue Feature Attention for Emotion Recognition in Conversation2 Jan 2025
- 2024Push the Limit of Multi-modal Emotion Recognition by Prompting LLMs with Receptive-Field-Aware Attention Weighting26 Nov 2024
- 2024Enhancing Multimodal Affective Analysis with Learned Live Comment Features21 Oct 2024
- 2024GCM-Net: Graph-enhanced Cross-Modal Infusion with a Metaheuristic-Driven Network for Video Sentiment and Emotion Analysis2 Oct 2024
- 2024Deep Knowledge-Infusion For Explainable Depression Detection1 Sep 2024
- 2024Knowledge-Aware Conversation Derailment Forecasting Using Graph Convolutional Networks24 Aug 2024
- 2024DiagESC: Dialogue Synthesis for Integrating Depression Diagnosis into Emotional Support Conversation12 Aug 2024
- 2024Analyzing Cultural Representations of Emotions in LLMs through Mixed Emotion Survey4 Aug 2024
- 2024Synth-Empathy: Towards High-Quality Synthetic Empathy Data31 Jul 2024
- 2024BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks5 Jul 2024
- 2024Efficient-Empathy: Towards Efficient and Effective Selection of Empathy Data2 Jul 2024
- 2024Think out Loud: Emotion Deducing Explanation in Dialogues7 Jun 2024
- 2024ESIHGNN: Event-State Interactions Infused Heterogeneous Graph Neural Network for Conversational Emotion Recognition7 May 2024
- 2024Samsung Research China-Beijing at SemEval-2024 Task 3: A multi-stage framework for Emotion-Cause Pair Extraction in Conversations25 Apr 2024
- 2024Context-Aware Siamese Networks for Efficient Emotion Recognition in Conversation17 Apr 2024
- 2024Token Trails: Navigating Contextual Depths in Conversational AI with ChatLLM3 Apr 2024
- 2024UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion Cause30 Mar 2024
- 2024Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversation29 Mar 2024
- 2024MIntRec2.0: A Large-scale Benchmark Dataset for Multimodal Intent Recognition and Out-of-scope Detection in Conversations16 Mar 2024
- 2024LaERC-S: Improving LLM-based Emotion Recognition in Conversation with Speaker Characteristics12 Mar 2024
- 2024TopicDiff: A Topic-enriched Diffusion Approach for Multimodal Conversational Emotion Detection4 Mar 2024
- 2024Emotion Analysis in NLP: Trends, Gaps and Roadmap for Future Directions2 Mar 2024
- 2024CauESC: A Causal Aware Model for Emotional Support Conversation31 Jan 2024
- 2024AMuSE: Adaptive Multimodal Analysis for Speaker Emotion Recognition in Group Conversations26 Jan 2024
- 2024TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversation16 Jan 2024
50 newest of 135 All 135 (JSON)
- 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMscited by 62
- 2023Commonsense Reasoning for Conversational AI: A Survey of the State of the Artcited by 7
- 2023A Bipartite Graph is All We Need for Enhancing Emotional Reasoning with Commonsense Knowledgecited by 2
- 2026COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoningcited by 0
- 2026COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoning19 Sep 2026
- 2023A Bipartite Graph is All We Need for Enhancing Emotional Reasoning with Commonsense Knowledge9 Aug 2023
- 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMs19 May 2023
- 2023Commonsense Reasoning for Conversational AI: A Survey of the State of the Art15 Feb 2023
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognitioncited by 61
- 2021EmoBERTa: Speaker-Aware Emotion Recognition in Conversation with RoBERTacited by 59
- 2021Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detectioncited by 56
- 2023Is ChatGPT Equipped with Emotional Dialogue Capabilities?cited by 54
- 2022EmoCaps: Emotion Capsule based Model for Conversational Emotion Recognitioncited by 48
- 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
- 2022CICERO: A Dataset for Contextualized Commonsense Inference in Dialoguescited by 38
- 2023A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in Conversationscited by 37
- 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
- 2021Contrast and Generation Make BART a Good Dialogue Emotion Recognizercited by 35
- 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
12 most cited of 129 All 129 (JSON)
- 2026When to Call an LLM: A Confidence-Gated Hybrid for Cost-Effective Emotion Recognition in Conversational AI16 Sep 2026
- 2026ReH-FUSE: Reliability-Aware Hierarchical Fusion of Experts for Multimodal Emotion Recognition in Conversation12 Sep 2026
- 2026Exposing Weaknesses in Emotion Recognition in Conversations5 Sep 2026
- 2026Chiaroscuro for Emotions: A Contrastive Emotion Benchmark Grounded in Appraisal Theory3 Sep 2026
- 2026DiaRelay: Relaying Dialogue Context with a Constant-Size Memory for Emotion Recognition in Conversation24 Aug 2026
- 2026Surfacing the Unsaid: CUE-Bench for Affective Stance in Chinese Discourse11 Aug 2026
- 2026AtmosERC: Modeling Dialogue-Level Affective Atmosphere for Emotion Recognition in Conversation29 Jul 2026
- 2026SHAP-Weighted Cross-Modal Expert Fusion for Emotion and Sentiment Recognition: Evidence and Limits9 Jul 2026
- 2026Emotion Recognition in Sign Language Conversation22 May 2026
- 2026Leveraging Self-Paced Curriculum Learning for Enhanced Modality Balance in Multimodal Conversational Emotion Recognition20 May 2026
- 2026SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations13 May 2026
- 2026Phase Transitions in Affective Meaning Divergence: The Hidden Drift Before the Break9 May 2026
12 newest of 129 All 129 (JSON)