mlsanityData to 7 Oct 2026

Learning Implicit User Profiles for Personalized Retrieval-Based Chatbot

arXiv 2108.07935 ↗First posted 18 Aug 2021cs.IR cs.AI cs.CLcited by 12

Not on the map. Why?

Abstract (arXiv)

In this paper, we explore the problem of developing personalized chatbots. A personalized chatbot is designed as a digital chatting assistant for a user. The key characteristic of a personalized chatbot is that it should have a consistent personality with the corresponding user. It can talk the same way as the user when it is delegated to respond to others' messages. We present a retrieval-based personalized chatbot model, namely IMPChat, to learn an implicit user profile from the user's dialogue history. We argue that the implicit user profile is superior to the explicit user profile regarding accessibility and flexibility. IMPChat aims to learn an implicit user profile through modeling user's personalized language style and personalized preferences separately. To learn a user's personalized language style, we elaborately build language models from shallow to deep using the user's historical responses; To model a user's personalized preferences, we explore the conditional relations underneath each post-response pair of the user. The personalized preferences are dynamic and context-aware: we assign higher weights to those historical pairs that are topically related to the current query when aggregating the personalized preferences. We match each response candidate with the personalized language style and personalized preference, respectively, and fuse the two matching signals to determine the final ranking score. Comprehensive experiments on two large datasets show that our method outperforms all baseline models.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 34 of its 61 references that are in the map. First posted on arXiv 18 Aug 2021.

Builds on

34 of 61 references.

References · 34

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016Layer Normalizationcited by 5,579
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  5. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
  6. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  7. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  8. 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
  9. 2016A Persona-Based Neural Conversation Modelcited by 221
  10. 2015Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Modelscited by 207
  11. 2015A Neural Conversational Modelcited by 195
  12. 2015The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systemscited by 172
22 more
  1. 2018The Design and Implementation of XiaoIce, an Empathetic Social Chatbotcited by 172
  2. 2018Training Millions of Personalized Dialogue Agentscited by 126
  3. 2015Neural Responding Machine for Short-Text Conversationcited by 124
  4. 2016Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbotscited by 103
  5. 2017End-to-End Neural Ad-hoc Ranking with Kernel Poolingcited by 85
  6. 2018From Eliza to XiaoIce: Challenges and Opportunities with Social Chatbotscited by 85
  7. 2020You Impress Me: Dialogue Generation via Mutual Persona Perceptioncited by 85
  8. 2015Convolutional Neural Network Architectures for Matching Natural Language Sentencescited by 82
  9. 2018Modeling Multi-turn Conversation with Deep Utterance Aggregationcited by 65
  10. 2019How should my chatbot interact? A survey on human-chatbot interaction designcited by 56
  11. 2020Towards Persona-Based Empathetic Conversational Modelscited by 53
  12. 2020Generate, Delete and Rewrite: A Three-Stage Framework for Improving Persona Consistency of Dialogue Generationcited by 41
  13. 2019Generating Persona Consistent Dialogues by Exploiting Natural Language Inferencecited by 33
  14. 2018AliMe Assist: An Intelligent Assistant for Creating an Innovative E-commerce Experiencecited by 26
  15. 2020Pchatbot: A Large-Scale Dataset for Personalized Chatbotcited by 26
  16. 2019Dually Interactive Matching Network for Personalized Response Selection in Retrieval-Based Chatbotscited by 23
  17. 2016Conversational Contextual Cues: The Case of Personalization and History for Response Rankingcited by 21
  18. 2020ScriptWriter: Narrative-Guided Script Generationcited by 15
  19. 2019A Document-grounded Matching Network for Response Selection in Retrieval-based Chatbotscited by 14
  20. 2015Syntax-based Deep Matching of Short Textscited by 10
  21. 2021Content Selection Network for Document-grounded Retrieval-based Chatbotscited by 10
  22. 2021Proactive Retrieval-based Chatbots based on Relevant Knowledge and Goalscited by 9

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 6; 2024: 0; 2025: 5.

12 papers.