EmpBot: A T5-based Empathetic Chatbot focusing on Sentiments
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce EmpBot: an end-to-end empathetic chatbot. Empathetic conversational agents should not only understand what is being discussed, but also acknowledge the implied feelings of the conversation partner and respond appropriately. To this end, we propose a method based on a transformer pretrained language model (T5). Specifically, during finetuning we propose to use three objectives: response language modeling, sentiment understanding, and empathy forcing. The first objective is crucial for generating relevant and coherent responses, while the next ones are significant for acknowledging the sentimental state of the conversational partner and for favoring empathetic responses. We evaluate our model on the EmpatheticDialogues dataset using both automated metrics and human evaluation. The inclusion of the sentiment understanding and empathy forcing auxiliary losses favor empathetic responses, as human evaluation results indicate, comparing with the current state-of-the-art.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 35 of its 51 references that are in the map. First posted on arXiv 30 Oct 2021.
Builds on
35 of 51 references.
References · 35
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2018Hierarchical Neural Story Generationcited by 1,182
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2020Recipes for building an open-domain chatbotcited by 593
- 2016How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generationcited by 356
- 2016Deep Reinforcement Learning for Dialogue Generationcited by 286
- 2016A Persona-Based Neural Conversation Modelcited by 221
- 2015A Neural Conversational Modelcited by 195
- 2019TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agentscited by 188
23 more
- 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 178
- 2016A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialoguescited by 174
- 2017Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memorycited by 167
- 2015Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systemscited by 134
- 2018Training Millions of Personalized Dialogue Agentscited by 126
- 2020MIME: MIMicking Emotions for Empathetic Response Generationcited by 114
- 2015A Neural Network Approach to Context-Sensitive Generation of Conversational Responsescited by 98
- 2019MoEL: Mixture of Empathetic Listenerscited by 91
- 2019Personalizing Dialogue Agents via Meta-Learningcited by 83
- 2018Retrieve and Refine: Improved Sequence Generation Models For Dialoguecited by 82
- 2015A Hierarchical Recurrent Encoder-Decoder For Generative Context-Aware Query Suggestioncited by 68
- 2017MojiTalk: Generating Emotional Responses at Scalecited by 64
- 2018Skeleton-to-Response: Dialogue Generation Guided by Retrieval Memorycited by 49
- 2018Importance of Search and Evaluation Strategies in Neural Dialogue Modelingcited by 44
- 2018Response Generation by Context-aware Prototype Editingcited by 40
- 2017Personalization in Goal-Oriented Dialogcited by 28
- 2019DeepCopy: Grounded Response Generation with Hierarchical Pointer Networkscited by 22
- 2019CAiRE: An Empathetic Neural Chatbotcited by 14
- 2018Emo2Vec: Learning Generalized Emotion Representation by Multi-task Trainingcited by 11
- 2018Multi-Region Ensemble Convolutional Neural Network for Facial Expression Recognitioncited by 7
- 2018Aiming to Know You Better Perhaps Makes Me a More Engaging Dialogue Partnercited by 7
- 2019CAiRE_HKUST at SemEval-2019 Task 3: Hierarchical Attention for Dialogue Emotion Classificationcited by 3
- 2019A Simple Dual-decoder Model for Generating Response with Sentimentcited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 2; 2025: 1; 2026: 1.
5 papers.
- 2022Empathetic Conversational Systems: A Review of Current Advances, Gaps, and Opportunitiescited by 14
- 2024ASEM: Enhancing Empathy in Chatbot through Attention-based Sentiment and Emotion Modelingcited by 7
- 2024EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimizationcited by 3
- 2025Empathetic Conversational Agents: Utilizing Neural and Physiological Signals for Enhanced Empathetic Interactionscited by 3
- 2026Measuring What Matters!! Assessing Therapeutic Principles in Mental-Health Conversationcited by 1
- 2026Measuring What Matters!! Assessing Therapeutic Principles in Mental-Health Conversation7 Apr 2026
- 2025Empathetic Conversational Agents: Utilizing Neural and Physiological Signals for Enhanced Empathetic Interactions14 Jan 2025
- 2024EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimization27 Jun 2024
- 2024ASEM: Enhancing Empathy in Chatbot through Attention-based Sentiment and Emotion Modeling25 Feb 2024
- 2022Empathetic Conversational Systems: A Review of Current Advances, Gaps, and Opportunities9 May 2022