Exploring Persona Sentiment Sensitivity in Personalized Dialogue Generation
Not on the map. Why?
Abstract (arXiv)
Personalized dialogue systems have advanced considerably with the integration of user-specific personas into large language models (LLMs). However, while LLMs can effectively generate personalized responses, the influence of persona sentiment on dialogue quality remains underexplored. In this work, we conduct a large-scale analysis of dialogues generated using a range of polarized user profiles. Our experiments reveal that dialogues involving negatively polarized users tend to overemphasize persona attributes. In contrast, positively polarized profiles yield dialogues that selectively incorporate persona information, resulting in smoother interactions. Furthermore, we find that personas with weak or neutral sentiment generally produce lower-quality dialogues. Motivated by these findings, we propose a dialogue generation approach that explicitly accounts for persona polarity by combining a turn-based generation strategy with a profile ordering mechanism and sentiment-aware prompting. Our study provides new insights into the sensitivity of LLMs to persona sentiment and offers guidance for developing more robust and nuanced personalized dialogue systems.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 40 of its 60 references that are in the map. First posted on arXiv 17 Feb 2025.
Builds on
40 of 60 references.
References · 40
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2015A large annotated corpus for learning natural language inferencecited by 1,847
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
- 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
- 2020Recipes for building an open-domain chatbotcited by 593
28 more
- 2023LaMP: When Large Language Models Meet Personalizationcited by 437
- 2016A Persona-Based Neural Conversation Modelcited by 223
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
- 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 198
- 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 179
- 2018Dialogue Natural Language Inferencecited by 135
- 2024PersonaGym: Evaluating Persona Agents and LLMscited by 97
- 2023PALR: Personalization Aware LLMs for Recommendationcited by 96
- 2020You Impress Me: Dialogue Generation via Mutual Persona Perceptioncited by 85
- 2019Personalizing Dialogue Agents via Meta-Learningcited by 83
- 2021BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Datacited by 75
- 2024Understanding the Capabilities and Limitations of Large Language Models for Cultural Commonsensecited by 51
- 2024RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMscited by 43
- 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personascited by 37
- 2023Learning Personalized Alignment for Evaluating Open-ended Text Generationcited by 29
- 2023LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streamingcited by 27
- 2022DEAM: Dialogue Coherence Evaluation using AMR-based Semantic Manipulationscited by 25
- 2021Towards Quantifiable Dialogue Coherence Evaluationcited by 21
- 2022COSPLAY: Concept Set Guided Personalized Dialogue Generation Across Both Party Personascited by 20
- 2023Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layerscited by 20
- 2024Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluationscited by 20
- 2023Learning to Memorize Entailment and Discourse Relations for Persona-Consistent Dialoguescited by 17
- 2022Improving Contextual Coherence in Variational Personalized and Empathetic Dialogue Agentscited by 14
- 2023SimOAP: Improve Coherence and Consistency in Persona-based Dialogue Generation via Over-sampling and Post-evaluationcited by 11
- 2024PairEval: Open-domain Dialogue Evaluation with Pairwise Comparisoncited by 11
- 2017Assigning personality/identity to a chatting machine for coherent conversation generationcited by 10
- 2023P5: Plug-and-Play Persona Prompting for Personalized Response Selectioncited by 8
- 2024Do Large Language Models Possess Sensitive to Sentiment?cited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Identifying and Mitigating Bottlenecks in Role-Playing Agents: A Systematic Study of Disentangling Character Profile Axescited by 2
- 2026Reinforcing Real-world Service Agents: Balancing Utility and Cost in Task-oriented Dialoguecited by 1
- 2026Toward Natural and Companionable Virtual Agents via Cross-Temporal Emotional Modelingcited by 0
- 2026Toward Natural and Companionable Virtual Agents via Cross-Temporal Emotional Modeling15 May 2026
- 2026Reinforcing Real-world Service Agents: Balancing Utility and Cost in Task-oriented Dialogue26 Feb 2026
- 2026Identifying and Mitigating Bottlenecks in Role-Playing Agents: A Systematic Study of Disentangling Character Profile Axes8 Jan 2026