Discourse Diversity in Multi-Turn Empathic Dialogue
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) produce responses rated as highly empathic in single-turn settings (Ayers et al., 2023; Lee et al., 2024), yet they are also known to be formulaic generators that reuse the same lexical patterns, syntactic templates, and discourse structures across tasks (Jiang et al., 2025; Shaib et al., 2024; Namuduri et al., 2025). Less attention has been paid to whether this formulaicity extends to the level of discourse moves, i.e., what a response does for the person it is addressing. This question is especially consequential for empathic dialogue, where effective support demands not just a kind response at one moment but varied strategies as a conversation unfolds (Stiles et al., 1998). Indeed, prior work shows that LLMs reuse the same tactic sequences more than human supporters in single-turn settings (Gueorguieva et al., 2026). We extend this analysis to multi-turn conversations and find that the rigidity compounds: once a tactic appears in a supporter turn, LLMs reuse it in the next at nearly double the rate of humans (0.50-0.56 vs. 0.27). This pattern holds across LLMs serving as supporters in real emotional support conversations, and is invisible to standard similarity metrics. To address this gap, we introduce MINT (Multi-turn Inter-tactic Novelty Training), the first reinforcement learning framework to optimize discourse move diversity across multi-turn empathic dialogue. The best MINT variant combines an empathy quality reward with a cross-turn tactic novelty signal, improving aggregate empathy by 25.3% over vanilla across 1.7B and 4B models while reducing cross-turn discourse move repetition by 26.3% on the 4B model, surpassing all baselines including quality-only and token-level diversity methods on both measures. These results suggest that what current models lack is not empathy itself, but the ability to vary their discourse moves across a conversation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 77 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
42 of 77 references.
References · 42
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
- 2021Towards Emotional Support Dialog Systemscited by 299
- 2023A Long Way to Go: Investigating Length Correlations in RLHFcited by 291
30 more
- 2020A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Supportcited by 182
- 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 141
- 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 105
- 2022MISC: A MIxed Strategy-Aware Model Integrating COMET for Emotional Support Conversationcited by 85
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 77
- 2022Improving Multi-turn Emotional Support Dialogue Generation with Lookahead Strategy Planningcited by 60
- 2024Detection and Measurement of Syntactic Templates in Generated Textcited by 44
- 2025Diversity-Aware Policy Optimization for Large Language Model Reasoningcited by 41
- 2025Investigating Affective Use and Emotional Well-being on ChatGPTcited by 38
- 2024Large Language Models Produce Responses Perceived to be Empathiccited by 36
- 2023TransESC: Smoothing Emotional Support Conversation via Turn-Level State Transitioncited by 30
- 2024AI Companions Reduce Lonelinesscited by 28
- 2025Diversity-Incentivized Exploration for Versatile Reasoningcited by 28
- 2025RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agentscited by 25
- 2025When Large Language Models are Reliable for Judging Empathic Communicationcited by 21
- 2025Post-training Large Language Models for Diverse High-Quality Responsescited by 19
- 2023Facilitating Multi-turn Emotional Support Conversation with Positive Emotion Elicitation: A Reinforcement Learning Approachcited by 15
- 2024Large Language Models are Capable of Offering Cognitive Reappraisal, if Guidedcited by 13
- 2025QUDsim: Quantifying Discourse Similarities in LLM-Generated Textcited by 13
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialoguecited by 13
- 2023Evaluating Subjective Cognitive Appraisals of Emotions from Large Language Modelscited by 12
- 2024The Illusion of Empathy: How AI Chatbots Shape Conversation Perceptioncited by 12
- 2025Preference Learning Unlocks LLMs' Psycho-Counseling Skillscited by 10
- 2025From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignmentcited by 9
- 2025SENSE-7: Taxonomy and Dataset for Measuring User Perceptions of Empathy in Sustained Human-AI Conversationscited by 9
- 2025Dialogue Systems for Emotional Support via Value Reinforcementcited by 8
- 2024Taking a turn for the better: Conversation redirection throughout the course of mental-health therapycited by 5
- 2025SPRI: Aligning Large Language Models with Context-Situated Principlescited by 5
- 2026AI generates well-liked but templatic empathic responsescited by 3
- 2025From Measurement to Expertise: Empathetic Expert Adapters for Context-Based Empathy in Conversational AI Agentscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Modeling Multiple Support Strategies within a Single Turn for Emotional Support Conversations
- 2023SoulChat: Improving LLMs' Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversations
- 2025A Survey on Multi-Turn Interaction Capabilities of Large Language Models
- 2026Found in Conversation: LLMs Teach Themselves to Close the Multi-Turn Gap
- 2025How Do LLMs Persuade? Linear Probes Can Uncover Persuasion Dynamics in Multi-Turn Conversations
- 2026Attractor States Emerge in Multi-Turn LLM Conversations
- 2026Personality Expression Across Contexts: Linguistic and Behavioral Variation in LLM Agents
- 2026Reflecting Twice before Speaking with Empathy: Self-Reflective Alternating Inference for Empathy-Aware End-to-End Spoken Dialogue