Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluations
Not on the map. Why?
Abstract (arXiv)
Enhancing user engagement through personalization in conversational agents has gained significance, especially with the advent of large language models that generate fluent responses. Personalized dialogue generation, however, is multifaceted and varies in its definition -- ranging from instilling a persona in the agent to capturing users' explicit and implicit cues. This paper seeks to systemically survey the recent landscape of personalized dialogue generation, including the datasets employed, methodologies developed, and evaluation metrics applied. Covering 22 datasets, we highlight benchmark datasets and newer ones enriched with additional features. We further analyze 17 seminal works from top conferences between 2021-2023 and identify five distinct types of problems. We also shed light on recent progress by LLMs in personalized dialogue generation. Our evaluation section offers a comprehensive summary of assessment facets and metrics utilized in these works. In conclusion, we discuss prevailing challenges and envision prospect directions for future research in personalized dialogue generation.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 75 of its 107 references that are in the map. First posted on arXiv 28 May 2024.
Builds on
75 of 107 references.
References · 75
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2015A large annotated corpus for learning natural language inferencecited by 1,847
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
38 more
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 598
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2016How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generationcited by 356
- 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 309
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 267
- 2017Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoderscited by 222
- 2020USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generationcited by 188
- 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 179
- 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 155
- 2023In-Context Impersonation Reveals Large Language Models' Strengths and Biasescited by 155
- 2019PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variablecited by 145
- 2018Dialogue Natural Language Inferencecited by 135
- 2020Can You Put it All Together: Evaluating Conversational Agents' Ability to Blend Skillscited by 131
- 2018Training Millions of Personalized Dialogue Agentscited by 126
- 2019Survey on Evaluation Methods for Dialogue Systemscited by 126
- 2019Audio-Visual Scene-Aware Dialogcited by 123
- 2018Generating Informative and Diverse Conversational Responses via Adversarial Information Maximizationcited by 116
- 2019Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Trainingcited by 110
- 2022Long Time No See! Open-Domain Conversation with Long-Term Persona Memorycited by 108
- 2021A Comprehensive Assessment of Dialog Evaluation Metricscited by 90
- 2019Personalizing Dialogue Agents via Meta-Learningcited by 83
- 2019Learning to Select Knowledge for Response Generation in Dialog Systemscited by 80
- 2021BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Datacited by 75
- 2019Personalized Dialogue Generation with Diversified Traitscited by 74
- 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
- 2020I like fish, especially dolphins: Addressing Contradictions in Dialogue Modelingcited by 68
- 2022Keep Me Updated! Memory Management in Long-term Conversationscited by 63
- 2022Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agentscited by 62
- 2023CharacterChat: Learning towards Conversational AI with Personalized Social Supportcited by 60
- 2019Exploiting Persona Information for Diverse Generation of Conversational Responsescited by 58
- 2020Towards Persona-Based Empathetic Conversational Modelscited by 53
- 2022Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generationcited by 47
- 2021One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profilescited by 39
- 2022PAL: Persona-Augmented Emotional Support Conversation Generationcited by 39
- 2020XPersona: Evaluating Multilingual Personalized Chatbotcited by 36
- 2022DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generationcited by 35
- 2021Call for Customized Conversation: Customized Conversation Grounding Persona and Knowledgecited by 30
50 most cited of 75 All 75 (JSON)
Built on by
Citing papers per year: 2024: 4; 2025: 10; 2026: 6.
20 papers.
Sort:
By area:
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 44
- 2026OP-Bench: Benchmarking Over-Personalization for Memory-Augmented Personalized Conversational Agentscited by 22
- 2025PersuasiveToM: A Benchmark for Evaluating Machine Theory of Mind in Persuasive Dialoguescited by 17
- 2024PersoBench: Benchmarking Personalized Response Generation in Large Language Modelscited by 13
- 2024X-TURING: Towards an Enhanced and Efficient Turing Test for Long-Term Dialogue Agentscited by 6
- 2024MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Spacecited by 5
- 2025Injecting Knowledge Graphs into Large Language Modelscited by 5
- 2025PersonaTwin: A Multi-Tier Prompt Conditioning Framework for Generating and Evaluating Personalized Digital Twinscited by 5
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourismcited by 5
- 2026STRUCTSURVEY: Structured Agentic Retrieval for Automated Survey Paper Generationcited by 4
- 2025Exploring Persona Sentiment Sensitivity in Personalized Dialogue Generationcited by 3
- 2025SoftMatcha: A Soft and Fast Pattern Matcher for Billion-Scale Corpus Searchescited by 3
8 more
- 2025Modeling and Optimizing User Preferences in AI Copilots: A Comprehensive Survey and Taxonomycited by 3
- 2025Agent WARPP: Workflow Adherence via Runtime Parallel Personalizationcited by 3
- 2024Personalized LLM for Generating Customized Responses to the Same Query from Different Userscited by 2
- 2025Investigating Co-Constructive Behavior of Large Language Models in Explanation Dialoguescited by 2
- 2025Enhancing User-Oriented Proactivity in Open-Domain Dialogues with Critic Guidancecited by 2
- 2026HARMONI: Multimodal Personalization of Multi-User Human-Robot Interactions with LLMscited by 1
- 2026PersoDPO: Scalable Preference Optimization for Instruction-Adherent, Persona-Grounded Dialogue via Multi-LLM Evaluationcited by 0
- 2026New AI-Driven Tools for Enhancing Campus Well-being: A Prevention and Intervention Approachcited by 0
- 2026STRUCTSURVEY: Structured Agentic Retrieval for Automated Survey Paper Generation12 May 2026
- 2026New AI-Driven Tools for Enhancing Campus Well-being: A Prevention and Intervention Approach11 May 2026
- 2026PersoDPO: Scalable Preference Optimization for Instruction-Adherent, Persona-Grounded Dialogue via Multi-LLM Evaluation4 Feb 2026
- 2026HARMONI: Multimodal Personalization of Multi-User Human-Robot Interactions with LLMs27 Jan 2026
- 2026OP-Bench: Benchmarking Over-Personalization for Memory-Augmented Personalized Conversational Agents20 Jan 2026
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents14 Jan 2026
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourism14 Sep 2025
- 2025PersonaTwin: A Multi-Tier Prompt Conditioning Framework for Generating and Evaluating Personalized Digital Twins30 Jul 2025
- 2025Agent WARPP: Workflow Adherence via Runtime Parallel Personalization23 Jul 2025
- 2025Modeling and Optimizing User Preferences in AI Copilots: A Comprehensive Survey and Taxonomy28 May 2025
- 2025Enhancing User-Oriented Proactivity in Open-Domain Dialogues with Critic Guidance18 May 2025
- 2025Injecting Knowledge Graphs into Large Language Models12 May 2025
8 more
- 2025Investigating Co-Constructive Behavior of Large Language Models in Explanation Dialogues25 Apr 2025
- 2025SoftMatcha: A Soft and Fast Pattern Matcher for Billion-Scale Corpus Searches5 Mar 2025
- 2025PersuasiveToM: A Benchmark for Evaluating Machine Theory of Mind in Persuasive Dialogues28 Feb 2025
- 2025Exploring Persona Sentiment Sensitivity in Personalized Dialogue Generation17 Feb 2025
- 2024Personalized LLM for Generating Customized Responses to the Same Query from Different Users16 Dec 2024
- 2024PersoBench: Benchmarking Personalized Response Generation in Large Language Models4 Oct 2024
- 2024X-TURING: Towards an Enhanced and Efficient Turing Test for Long-Term Dialogue Agents19 Aug 2024
- 2024MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Space2 Jul 2024
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 44
- 2026OP-Bench: Benchmarking Over-Personalization for Memory-Augmented Personalized Conversational Agentscited by 22
- 2024X-TURING: Towards an Enhanced and Efficient Turing Test for Long-Term Dialogue Agentscited by 6
- 2026STRUCTSURVEY: Structured Agentic Retrieval for Automated Survey Paper Generationcited by 4
- 2025Agent WARPP: Workflow Adherence via Runtime Parallel Personalizationcited by 3
- 2026STRUCTSURVEY: Structured Agentic Retrieval for Automated Survey Paper Generation12 May 2026
- 2026OP-Bench: Benchmarking Over-Personalization for Memory-Augmented Personalized Conversational Agents20 Jan 2026
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents14 Jan 2026
- 2025Agent WARPP: Workflow Adherence via Runtime Parallel Personalization23 Jul 2025
- 2024X-TURING: Towards an Enhanced and Efficient Turing Test for Long-Term Dialogue Agents19 Aug 2024
- 2025Injecting Knowledge Graphs into Large Language Modelscited by 5
- 2025Injecting Knowledge Graphs into Large Language Models12 May 2025
- 2025PersuasiveToM: A Benchmark for Evaluating Machine Theory of Mind in Persuasive Dialoguescited by 17
- 2024PersoBench: Benchmarking Personalized Response Generation in Large Language Modelscited by 13
- 2024MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Spacecited by 5
- 2025PersonaTwin: A Multi-Tier Prompt Conditioning Framework for Generating and Evaluating Personalized Digital Twinscited by 5
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourismcited by 5
- 2025Exploring Persona Sentiment Sensitivity in Personalized Dialogue Generationcited by 3
- 2025SoftMatcha: A Soft and Fast Pattern Matcher for Billion-Scale Corpus Searchescited by 3
- 2024Personalized LLM for Generating Customized Responses to the Same Query from Different Userscited by 2
- 2025Investigating Co-Constructive Behavior of Large Language Models in Explanation Dialoguescited by 2
- 2025Enhancing User-Oriented Proactivity in Open-Domain Dialogues with Critic Guidancecited by 2
- 2026HARMONI: Multimodal Personalization of Multi-User Human-Robot Interactions with LLMscited by 1
- 2026New AI-Driven Tools for Enhancing Campus Well-being: A Prevention and Intervention Approachcited by 0
- 2026New AI-Driven Tools for Enhancing Campus Well-being: A Prevention and Intervention Approach11 May 2026
- 2026HARMONI: Multimodal Personalization of Multi-User Human-Robot Interactions with LLMs27 Jan 2026
- 2025We Argue to Agree: Towards Personality-Driven Argumentation-Based Negotiation Dialogue Systems for Tourism14 Sep 2025
- 2025PersonaTwin: A Multi-Tier Prompt Conditioning Framework for Generating and Evaluating Personalized Digital Twins30 Jul 2025
- 2025Enhancing User-Oriented Proactivity in Open-Domain Dialogues with Critic Guidance18 May 2025
- 2025Investigating Co-Constructive Behavior of Large Language Models in Explanation Dialogues25 Apr 2025
- 2025SoftMatcha: A Soft and Fast Pattern Matcher for Billion-Scale Corpus Searches5 Mar 2025
- 2025PersuasiveToM: A Benchmark for Evaluating Machine Theory of Mind in Persuasive Dialogues28 Feb 2025
- 2025Exploring Persona Sentiment Sensitivity in Personalized Dialogue Generation17 Feb 2025
- 2024Personalized LLM for Generating Customized Responses to the Same Query from Different Users16 Dec 2024
- 2024PersoBench: Benchmarking Personalized Response Generation in Large Language Models4 Oct 2024
- 2024MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Space2 Jul 2024