mlsanityData to 7 Oct 2026

From Empathy to Personalized Empathy: Adapting Empathetic Strategies to Individual Users

arXiv 2606.00728 ↗First posted 30 May 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

As Large Language Models (LLMs) are increasingly deployed in long-term interactions with users, empathy has become an increasingly important capability. However, existing research overlooks the influence of users' personality traits on empathetic strategies during long-term interactions. To address this gap, we introduce the task of personalized empathy, which focuses on adapting empathetic strategies according to users' personalized characteristics derived from history. To study and enhance this capability, we construct PersonaEmp, a personalized empathy dataset built from long-term user-AI interactions, featuring rich user histories, persona information, and empathy-seeking queries. We further propose PereGRM, a reward modeling framework that combines the empathy evaluation structure with dynamic evaluation criteria generation for fine-grained reward modeling. Experimental results across different settings and multiple judge models show that PereGRM consistently achieves the strongest performance improvements, indicating its effectiveness for enhancing personalized empathetic capabilities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 63 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

39 of 63 references.

References · 39

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  6. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  7. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  8. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  9. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
  10. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  11. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
  12. 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
27 more
  1. 2023Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Mergingcited by 271
  2. 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
  3. 2025Inference-Time Scaling for Generalist Reward Modelingcited by 233
  4. 2024Personalized Language Modeling from Personalized Human Feedbackcited by 124
  5. 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 117
  6. 2023SoulChat: Improving LLMs' Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversationscited by 109
  7. 2021PsyQA: A Chinese Dataset for Generating Long Counseling Text for Mental Health Supportcited by 92
  8. 2022MISC: A MIxed Strategy-Aware Model Integrating COMET for Emotional Support Conversationcited by 84
  9. 2022AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversationcited by 79
  10. 2021Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approachcited by 75
  11. 2024Multi-turn Reinforcement Learning from Preference Human Feedbackcited by 65
  12. 2025A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applicationscited by 40
  13. 2024Crafting Personalized Agents through Retrieval-Augmented Generation on Editable Memory Graphscited by 38
  14. 2025NextQuill: Causal Preference Modeling for Enhancing LLM Personalizationcited by 29
  15. 2025Think-While-Generating: On-the-Fly Reasoning for Personalized Long-Form Generationcited by 29
  16. 2024PersonaRAG: Enhancing Retrieval-Augmented Generation Systems with User-Centric Agentscited by 28
  17. 2025RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agentscited by 24
  18. 2025Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignmentcited by 22
  19. 2025Kardia-R1: Unleashing LLMs to Reason toward Understanding and Empathy for Emotional Support via Rubric-as-Judge Reinforcement Learningcited by 22
  20. 2025"My Boyfriend is AI": A Computational Analysis of Human-AI Companionship in Reddit's AI Communitycited by 19
  21. 2025Personalize Before Retrieve: LLM-based Personalized Query Expansion for User-Centric Retrievalcited by 11
  22. 2025Humanizing LLMs: A Survey of Psychological Measurements with Tools, Datasets, and Human-Agent Applicationscited by 10
  23. 2025DEEPER Insight into Your User: Directed Persona Refinement for Dynamic Persona Modelingcited by 9
  24. 2024Empathy Level Alignment via Reinforcement Learning for Empathetic Response Generationcited by 8
  25. 2025The Pursuit of Empathy: Evaluating Small Language Models for PTSD Dialogue Supportcited by 6
  26. 2025PersonaFuse: A Personality Activation-Driven Framework for Enhancing Human-LLM Interactionscited by 5
  27. 2025RECAP: Transparent Inference-Time Emotion Alignment for Medical Dialogue Systemscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Models
  2. 2025From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment
  3. 2025From Measurement to Expertise: Empathetic Expert Adapters for Context-Based Empathy in Conversational AI Agents
  4. 2024EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimization
  5. 2026EMPA: Evaluating Persona-Aligned Empathy as a Process
  6. 2025PEER: Unified Process-Outcome Reinforcement Learning for Structured Empathetic Reasoning
  7. 2026ComPASS: Towards Personalized Agentic Social Support via Tool-Augmented Companionship
  8. 2024PersonalLLM: Tailoring LLMs to Individual Preferences