Dialogue Systems for Emotional Support via Value Reinforcement
Not on the map. Why?
Abstract (arXiv)
Emotional support dialogue systems aim to reduce help-seekers' distress and help them overcome challenges. While human valuesunicodex2013core beliefs that shape an individual's prioritiesunicodex2013are increasingly emphasized in contemporary psychological therapy for their role in fostering internal transformation and long-term emotional well-being, their integration into emotional support systems remains underexplored. To bridge this gap, we present a value-driven method for training emotional support dialogue systems designed to reinforce positive values in seekers. Notably, our model identifies which values to reinforce at each turn and how to do so, by leveraging online support conversations from Reddit. We evaluate the method across support skills, seekers' emotional intensity, and value reinforcement. Our method consistently outperforms various baselines, effectively exploring and eliciting values from seekers. Additionally, leveraging crowd knowledge from Reddit significantly enhances its effectiveness. Therapists highlighted its ability to validate seekers' challenges and emphasize positive aspects of their situationsunicodex2013both crucial elements of value reinforcement. Our work, being the first to integrate value reinforcement into emotional support systems, demonstrates its promise and establishes a foundation for future research.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 15 of its 47 references that are in the map. First posted on arXiv 25 Jan 2025.
Builds on
15 of 47 references.
References · 15
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Large Language Modelscited by 774
- 2021Towards Emotional Support Dialog Systemscited by 294
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 76
- 2024EmoLLMs: A Series of Emotional Large Language Models and Annotation Tools for Comprehensive Affective Analysiscited by 62
- 2024Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theorycited by 60
- 2022Improving Multi-turn Emotional Support Dialogue Generation with Lookahead Strategy Planningcited by 59
- 2023Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Valuescited by 49
- 2024ESCoT: Towards Interpretable Emotional Support Dialogue Systemscited by 46
- 2022PAL: Persona-Augmented Emotional Support Conversation Generationcited by 39
- 2023Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue Modelscited by 30
- 2019Generating Empathetic Responses by Looking Ahead the User's Sentimentcited by 27
3 more
- 2023Do Differences in Values Influence Disagreements in Online Discussions?cited by 15
- 2023Adam-Smith at SemEval-2023 Task 4: Discovering Human Values in Arguments with Ensembles of Transformer-based Modelscited by 6
- 2023K-ESConv: Knowledge Injection for Emotional Support Dialogue Systems via Prompt Learningcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2025Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguitycited by 2
- 2026Responsible Evaluation of AI for Mental Healthcited by 2
- 2026Affective Flow Language Model for Emotional Support Conversationcited by 2
- 2026Stress-Testing Emotional Support Models: Moving from Homogeneous to Diverse Help Seekerscited by 1
- 2026Listening to the Echo: User-Reaction Aware Policy Optimization via Scalar-Verbal Hybrid Reinforcement Learningcited by 1
- 2026Discourse Diversity in Multi-Turn Empathic Dialoguecited by 1
- 2026Discourse Coherence and Response-Guided Context Rewriting for Multi-Party Dialogue Generationcited by 0
- 2026MindTailor: Personalized Emotional Support via Post History-Grounded Case Formulation and Collaborative Refinementcited by 0
- 2026MindTailor: Personalized Emotional Support via Post History-Grounded Case Formulation and Collaborative Refinement20 Jun 2026
- 2026Discourse Diversity in Multi-Turn Empathic Dialogue13 Apr 2026
- 2026Discourse Coherence and Response-Guided Context Rewriting for Multi-Party Dialogue Generation8 Apr 2026
- 2026Listening to the Echo: User-Reaction Aware Policy Optimization via Scalar-Verbal Hybrid Reinforcement Learning16 Mar 2026
- 2026Affective Flow Language Model for Emotional Support Conversation9 Feb 2026
- 2026Responsible Evaluation of AI for Mental Health20 Jan 2026
- 2026Stress-Testing Emotional Support Models: Moving from Homogeneous to Diverse Help Seekers12 Jan 2026
- 2025Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguity29 May 2025