Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detection
Not on the map. Why?
Abstract (arXiv)
Emotion detection in dialogues is challenging as it often requires the identification of thematic topics underlying a conversation, the relevant commonsense knowledge, and the intricate transition patterns between the affective states. In this paper, we propose a Topic-Driven Knowledge-Aware Transformer to handle the challenges above. We firstly design a topic-augmented language model (LM) with an additional layer specialized for topic detection. The topic-augmented LM is then combined with commonsense statements derived from a knowledge base based on the dialogue contextual information. Finally, a transformer-based encoder-decoder architecture fuses the topical and commonsense information, and performs the emotion label sequence prediction. The model has been experimented on four datasets in dialogue emotion detection, demonstrating its superiority empirically over the existing state-of-the-art approaches. Quantitative and qualitative results show that the model can discover topics which help in distinguishing emotion categories.
Key facts. Cited by 56 papers in the map (data through 14 Oct 2026). Builds on 33 of its 42 references that are in the map. First posted on arXiv 2 Jun 2021.
Builds on
33 of 42 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
- 2015Pointer Networkscited by 895
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
21 more
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
- 2015Generating Sentences from a Continuous Spacecited by 612
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 218
- 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 186
- 2016A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialoguescited by 174
- 2017Autoencoding Variational Inference For Topic Modelscited by 169
- 2020COSMIC: COmmonSense knowledge for eMotion Identification in Conversationscited by 136
- 2020Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Spacecited by 114
- 2015Neural Variational Inference for Text Processingcited by 111
- 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
- 2019Knowledge-Enriched Transformer for Emotion Detection in Textual Conversationscited by 92
- 2019HiGRU: Hierarchical Gated Recurrent Units for Utterance-level Emotion Recognitioncited by 43
- 2019Real-Time Emotion Recognition via Attention Gated Hierarchical Memory Networkcited by 38
- 2020BiERU: Bidirectional Emotional Recurrent Unit for Conversational Sentiment Analysiscited by 28
- 2019Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codescited by 25
- 2018A Hierarchical Latent Structure for Variational Conversation Modelingcited by 17
- 2019A Discrete CVAE for Response Generation on Short-Text Conversationcited by 17
- 2018Improving Variational Encoder-Decoders in Dialogue Generationcited by 13
- 2020A Discrete Variational Recurrent Topic Model without the Reparametrization Trickcited by 9
- 2020TopicBERT: A Transformer transfer learning based memory-graph approach for multimodal streaming social media topic detectioncited by 5
Built on by
Citing papers per year: 2021: 4; 2022: 10; 2023: 22; 2024: 12; 2025: 7; 2026: 1.
56 papers.
Sort:
By area:
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognitioncited by 61
- 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
- 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
- 2021Contrast and Generation Make BART a Good Dialogue Emotion Recognizercited by 35
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
- 2023DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversationscited by 30
- 2021Hybrid Curriculum Learning for Emotion Recognition in Conversationcited by 25
- 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversationscited by 19
- 2024Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representationscited by 18
- 2023Information Screening whilst Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modelingcited by 16
- 2021KGAP: Knowledge Graph Augmented Political Perspective Detection in News Mediacited by 14
38 more
- 2023Cluster-Level Contrastive Learning for Emotion Recognition in Conversationscited by 14
- 2022Deep Emotion Recognition in Textual Conversations: A Surveycited by 13
- 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognitioncited by 13
- 2024Comparison of Topic Modelling Approaches in the Banking Contextcited by 10
- 2022DARER: Dual-task Temporal Relational Recurrent Reasoning Network for Joint Dialog Sentiment Classification and Act Recognitioncited by 9
- 2024UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion Causecited by 8
- 2023EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversationcited by 7
- 2023Relational Temporal Graph Reasoning for Dual-task Dialogue Language Understandingcited by 7
- 2022TSAM: A Two-Stream Attention Model for Causal Emotion Entailmentcited by 6
- 2023How you feelin'? Learning Emotions and Mental States in Movie Scenescited by 6
- 2023Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in Conversationcited by 6
- 2023Disentangled Variational Autoencoder for Emotion Recognition in Conversationscited by 5
- 2023Diversity-Aware Coherence Loss for Improving Neural Topic Modelscited by 5
- 2022Disentangled Learning of Stance and Aspect Topics for Vaccine Attitude Detection in Social Mediacited by 4
- 2023Mimicking the Thinking Process for Emotion Recognition in Conversation with Prompts and Paraphrasingcited by 4
- 2023Multi-turn Dialogue Comprehension from a Topic-aware Perspectivecited by 4
- 2024Exploring Loss Landscapes through the Lens of Spin Glass Theorycited by 4
- 2022Whose Emotion Matters? Speaking Activity Localisation without Prior Knowledgecited by 3
- 2023Interactive Distillation of Large Single-Topic Corpora of Scientific Paperscited by 3
- 2024SciGisPy: a Novel Metric for Biomedical Text Simplification via Gist Inference Scorecited by 3
- 2023A Bipartite Graph is All We Need for Enhancing Emotional Reasoning with Commonsense Knowledgecited by 2
- 2023EmoTwiCS: A Corpus for Modelling Emotion Trajectories in Dutch Customer Service Dialogues on Twittercited by 2
- 2024Samsung Research China-Beijing at SemEval-2024 Task 3: A multi-stage framework for Emotion-Cause Pair Extraction in Conversationscited by 2
- 2024Deep Knowledge-Infusion For Explainable Depression Detectioncited by 2
- 2025Explaining Matters: Leveraging Definitions and Semantic Expansion for Sexism Detectioncited by 2
- 2025Can Large Language Models Generate Effective Datasets for Emotion Recognition in Conversations?cited by 2
- 2022"No, they did not": Dialogue response dynamics in pre-trained language modelscited by 1
- 2022A Commonsense-Infused Language-Agnostic Learning Framework for Enhancing Prediction of Political Polarity in Multilingual News Headlinescited by 1
- 2023A Dual-Stream Recurrence-Attention Network With Global-Local Awareness for Emotion Recognition in Textual Dialogcited by 1
- 2023FATRER: Full-Attention Topic Regularizer for Accurate and Robust Conversational Emotion Recognitioncited by 1
- 2023Dynamic Causal Disentanglement Model for Dialogue Emotion Detectioncited by 1
- 2023Watch the Speakers: A Hybrid Continuous Attribution Network for Emotion Recognition in Conversation With Emotion Disentanglementcited by 1
- 2024Think out Loud: Emotion Deducing Explanation in Dialoguescited by 1
- 2025SafeSpeech: A Comprehensive and Interactive Tool for Analysing Sexist and Abusive Language in Conversationscited by 1
- 2025Combating Toxic Language: A Review of LLM-Based Strategies for Software Engineeringcited by 1
- 2025Bias Beneath the Tone: Empirical Characterisation of Tone Bias in LLM-Driven UX Systemscited by 1
- 2025Reasoning in Action: MCTS-Driven Knowledge Retrieval for Large Language Modelscited by 1
- 2026Why Are Some Emotions Harder for LLMs? Uncovering the Causal Mechanisms of Emotion Inference via Sparse Autoencoderscited by 1
50 most cited of 56 All 56 (JSON)
- 2026Why Are Some Emotions Harder for LLMs? Uncovering the Causal Mechanisms of Emotion Inference via Sparse Autoencoders28 Apr 2026
- 2025Bias Beneath the Tone: Empirical Characterisation of Tone Bias in LLM-Driven UX Systems23 Dec 2025
- 2025Reasoning in Action: MCTS-Driven Knowledge Retrieval for Large Language Models28 Nov 2025
- 2025Can Large Language Models Generate Effective Datasets for Emotion Recognition in Conversations?7 Aug 2025
- 2025Explaining Matters: Leveraging Definitions and Semantic Expansion for Sexism Detection6 Jun 2025
- 2025Combating Toxic Language: A Review of LLM-Based Strategies for Software Engineering21 Apr 2025
- 2025SafeSpeech: A Comprehensive and Interactive Tool for Analysing Sexist and Abusive Language in Conversations9 Mar 2025
- 2025TED: Turn Emphasis with Dialogue Feature Attention for Emotion Recognition in Conversation2 Jan 2025
- 2024SciGisPy: a Novel Metric for Biomedical Text Simplification via Gist Inference Score12 Oct 2024
- 2024Society of Medical Simplifiers12 Oct 2024
- 2024Deep Knowledge-Infusion For Explainable Depression Detection1 Sep 2024
- 2024Knowledge-Aware Conversation Derailment Forecasting Using Graph Convolutional Networks24 Aug 2024
38 more
- 2024Exploring Loss Landscapes through the Lens of Spin Glass Theory30 Jul 2024
- 2024Think out Loud: Emotion Deducing Explanation in Dialogues7 Jun 2024
- 2024Samsung Research China-Beijing at SemEval-2024 Task 3: A multi-stage framework for Emotion-Cause Pair Extraction in Conversations25 Apr 2024
- 2024Context-Aware Siamese Networks for Efficient Emotion Recognition in Conversation17 Apr 2024
- 2024UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion Cause30 Mar 2024
- 2024TopicDiff: A Topic-enriched Diffusion Approach for Multimodal Conversational Emotion Detection4 Mar 2024
- 2024Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations4 Mar 2024
- 2024Comparison of Topic Modelling Approaches in the Banking Context5 Feb 2024
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learning10 Dec 2023
- 2023DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversations17 Oct 2023
- 2023EmoTwiCS: A Corpus for Modelling Emotion Trajectories in Dutch Customer Service Dialogues on Twitter10 Oct 2023
- 2023Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in Conversation4 Oct 2023
- 2023Interactive Distillation of Large Single-Topic Corpora of Scientific Papers19 Sep 2023
- 2023Watch the Speakers: A Hybrid Continuous Attribution Network for Emotion Recognition in Conversation With Emotion Disentanglement18 Sep 2023
- 2023Multi-turn Dialogue Comprehension from a Topic-aware Perspective18 Sep 2023
- 2023Dynamic Causal Disentanglement Model for Dialogue Emotion Detection13 Sep 2023
- 2023A Bipartite Graph is All We Need for Enhancing Emotional Reasoning with Commonsense Knowledge9 Aug 2023
- 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition8 Aug 2023
- 2023FATRER: Full-Attention Topic Regularizer for Accurate and Robust Conversational Emotion Recognition23 Jul 2023
- 2023A Dual-Stream Recurrence-Attention Network With Global-Local Awareness for Emotion Recognition in Textual Dialog2 Jul 2023
- 2023Exploiting Pseudo Future Contexts for Emotion Recognition in Conversations27 Jun 2023
- 2023Relational Temporal Graph Reasoning for Dual-task Dialogue Language Understanding15 Jun 2023
- 2023Mimicking the Thinking Process for Emotion Recognition in Conversation with Prompts and Paraphrasing11 Jun 2023
- 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversations2 Jun 2023
- 2023Diversity-Aware Coherence Loss for Improving Neural Topic Models25 May 2023
- 2023Disentangled Variational Autoencoder for Emotion Recognition in Conversations23 May 2023
- 2023Information Screening whilst Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modeling19 May 2023
- 2023How you feelin'? Learning Emotions and Mental States in Movie Scenes12 Apr 2023
- 2023EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversation20 Mar 2023
- 2023Cluster-Level Contrastive Learning for Emotion Recognition in Conversations7 Feb 2023
- 2022A Commonsense-Infused Language-Agnostic Learning Framework for Enhancing Prediction of Political Polarity in Multilingual News Headlines1 Dec 2022
- 2022Whose Emotion Matters? Speaking Activity Localisation without Prior Knowledge23 Nov 2022
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition21 Nov 2022
- 2022Deep Emotion Recognition in Textual Conversations: A Survey16 Nov 2022
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversation17 Oct 2022
- 2022"No, they did not": Dialogue response dynamics in pre-trained language models5 Oct 2022
- 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversation5 Jun 2022
- 2022Disentangled Learning of Stance and Aspect Topics for Vaccine Attitude Detection in Social Media6 May 2022
50 newest of 56 All 56 (JSON)
- 2022UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognitioncited by 61
- 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
- 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
- 2021Contrast and Generation Make BART a Good Dialogue Emotion Recognizercited by 35
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
- 2023DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversationscited by 30
- 2021Hybrid Curriculum Learning for Emotion Recognition in Conversationcited by 25
- 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversationscited by 19
- 2024Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representationscited by 18
- 2023Information Screening whilst Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modelingcited by 16
- 2021KGAP: Knowledge Graph Augmented Political Perspective Detection in News Mediacited by 14
12 most cited of 53 All 53 (JSON)
- 2025Bias Beneath the Tone: Empirical Characterisation of Tone Bias in LLM-Driven UX Systems23 Dec 2025
- 2025Can Large Language Models Generate Effective Datasets for Emotion Recognition in Conversations?7 Aug 2025
- 2025Explaining Matters: Leveraging Definitions and Semantic Expansion for Sexism Detection6 Jun 2025
- 2025Combating Toxic Language: A Review of LLM-Based Strategies for Software Engineering21 Apr 2025
- 2025SafeSpeech: A Comprehensive and Interactive Tool for Analysing Sexist and Abusive Language in Conversations9 Mar 2025
- 2025TED: Turn Emphasis with Dialogue Feature Attention for Emotion Recognition in Conversation2 Jan 2025
- 2024SciGisPy: a Novel Metric for Biomedical Text Simplification via Gist Inference Score12 Oct 2024
- 2024Society of Medical Simplifiers12 Oct 2024
- 2024Deep Knowledge-Infusion For Explainable Depression Detection1 Sep 2024
- 2024Knowledge-Aware Conversation Derailment Forecasting Using Graph Convolutional Networks24 Aug 2024
- 2024Exploring Loss Landscapes through the Lens of Spin Glass Theory30 Jul 2024
- 2024Think out Loud: Emotion Deducing Explanation in Dialogues7 Jun 2024
12 newest of 53 All 53 (JSON)