Learning Implicit User Profiles for Personalized Retrieval-Based Chatbot
Not on the map. Why?
Abstract (arXiv)
In this paper, we explore the problem of developing personalized chatbots. A personalized chatbot is designed as a digital chatting assistant for a user. The key characteristic of a personalized chatbot is that it should have a consistent personality with the corresponding user. It can talk the same way as the user when it is delegated to respond to others' messages. We present a retrieval-based personalized chatbot model, namely IMPChat, to learn an implicit user profile from the user's dialogue history. We argue that the implicit user profile is superior to the explicit user profile regarding accessibility and flexibility. IMPChat aims to learn an implicit user profile through modeling user's personalized language style and personalized preferences separately. To learn a user's personalized language style, we elaborately build language models from shallow to deep using the user's historical responses; To model a user's personalized preferences, we explore the conditional relations underneath each post-response pair of the user. The personalized preferences are dynamic and context-aware: we assign higher weights to those historical pairs that are topically related to the current query when aggregating the personalized preferences. We match each response candidate with the personalized language style and personalized preference, respectively, and fuse the two matching signals to determine the final ranking score. Comprehensive experiments on two large datasets show that our method outperforms all baseline models.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 34 of its 61 references that are in the map. First posted on arXiv 18 Aug 2021.
Builds on
34 of 61 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Layer Normalizationcited by 5,579
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
- 2016A Persona-Based Neural Conversation Modelcited by 221
- 2015Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Modelscited by 207
- 2015A Neural Conversational Modelcited by 195
- 2015The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systemscited by 172
22 more
- 2018The Design and Implementation of XiaoIce, an Empathetic Social Chatbotcited by 172
- 2018Training Millions of Personalized Dialogue Agentscited by 126
- 2015Neural Responding Machine for Short-Text Conversationcited by 124
- 2016Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbotscited by 103
- 2017End-to-End Neural Ad-hoc Ranking with Kernel Poolingcited by 85
- 2018From Eliza to XiaoIce: Challenges and Opportunities with Social Chatbotscited by 85
- 2020You Impress Me: Dialogue Generation via Mutual Persona Perceptioncited by 85
- 2015Convolutional Neural Network Architectures for Matching Natural Language Sentencescited by 82
- 2018Modeling Multi-turn Conversation with Deep Utterance Aggregationcited by 65
- 2019How should my chatbot interact? A survey on human-chatbot interaction designcited by 56
- 2020Towards Persona-Based Empathetic Conversational Modelscited by 53
- 2020Generate, Delete and Rewrite: A Three-Stage Framework for Improving Persona Consistency of Dialogue Generationcited by 41
- 2019Generating Persona Consistent Dialogues by Exploiting Natural Language Inferencecited by 33
- 2018AliMe Assist: An Intelligent Assistant for Creating an Innovative E-commerce Experiencecited by 26
- 2020Pchatbot: A Large-Scale Dataset for Personalized Chatbotcited by 26
- 2019Dually Interactive Matching Network for Personalized Response Selection in Retrieval-Based Chatbotscited by 23
- 2016Conversational Contextual Cues: The Case of Personalization and History for Response Rankingcited by 21
- 2020ScriptWriter: Narrative-Guided Script Generationcited by 15
- 2019A Document-grounded Matching Network for Response Selection in Retrieval-based Chatbotscited by 14
- 2015Syntax-based Deep Matching of Short Textscited by 10
- 2021Content Selection Network for Document-grounded Retrieval-based Chatbotscited by 10
- 2021Proactive Retrieval-based Chatbots based on Relevant Knowledge and Goalscited by 9
Built on by
Citing papers per year: 2022: 1; 2023: 6; 2024: 0; 2025: 5.
12 papers.
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2022Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generationcited by 47
- 2025A Survey of Personalization: From RAG to Agentcited by 26
- 2025YoChameleon: Personalized Vision and Language Generationcited by 20
- 2023History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue Systemcited by 15
- 2023Towards Asking Clarification Questions for Information Seeking on Task-Oriented Dialoguescited by 7
- 2023A Survey of Personality, Persona, and Profile in Conversational Agents and Chatbotscited by 5
- 2025ProfiLLM: An LLM-Based Framework for Implicit Profiling of Chatbot Userscited by 3
- 2025The Adaptation Paradox: Agency vs. Mimicry in Companion Chatbotscited by 1
- 2023A Personalized Utterance Style (PUS) based Dialogue Strategy for Efficient Service Requirement Elicitationcited by 0
- 2023How Can Context Help? Exploring Joint Retrieval of Passage and Personalized Contextcited by 0
- 2025Contextualized Multimodal Lifelong Person Re-Identification in Hybrid Clothing Statescited by 0
- 2025The Adaptation Paradox: Agency vs. Mimicry in Companion Chatbots16 Sep 2025
- 2025Contextualized Multimodal Lifelong Person Re-Identification in Hybrid Clothing States14 Sep 2025
- 2025ProfiLLM: An LLM-Based Framework for Implicit Profiling of Chatbot Users16 Jun 2025
- 2025YoChameleon: Personalized Vision and Language Generation29 Apr 2025
- 2025A Survey of Personalization: From RAG to Agent14 Apr 2025
- 2023A Survey of Personality, Persona, and Profile in Conversational Agents and Chatbots31 Dec 2023
- 2023How Can Context Help? Exploring Joint Retrieval of Passage and Personalized Context26 Aug 2023
- 2023Large Language Models for Information Retrieval: A Survey14 Aug 2023
- 2023Towards Asking Clarification Questions for Information Seeking on Task-Oriented Dialogues23 May 2023
- 2023History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue System2 Feb 2023
- 2023A Personalized Utterance Style (PUS) based Dialogue Strategy for Efficient Service Requirement Elicitation7 Jan 2023
- 2022Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generation18 Apr 2022