mlsanityData to 14 Oct 2026

User-Aware Active Knowledge Acquisition for Emotional Support Dialogue

arXiv 2605.29715 ↗First posted 28 May 2026cs.CLcited by 0

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

Emotional support plays an important role in dialogue systems, and its success depends on adapting to a user's evolving and implicit needs across multi-turn interactions while leveraging the strong reasoning capacity of large language models. However, since signals about user needs are often weak, indirect, and can only be disambiguated through multi-turn interaction, existing emotional support methods often struggle to acquire and generalize relevant conversational knowledge efficiently. To bridge this gap, we introduce User-Aware Active Knowledge Acquisition (UKA), a gradient-free active dialogue learning framework that explicitly represents uncertainty about user needs and incorporates active learning into both knowledge acquisition and response selection.We propose a Theory-of-Mind uncertainty estimation mechanism that allows the model to prioritize responses, thereby eliciting more informative user feedback. UKA is capable of efficiently exploring user-aligned conversational knowledge during training while maintaining robustness at test time. Experiments across multiple dialogue benchmarks and model architectures demonstrate that our approach consistently outperforms strong baselines in dialogue quality and user alignment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 43 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

32 of 43 references.

References · 32

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  3. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
  4. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  5. 2021Towards Emotional Support Dialog Systemscited by 299
  6. 2024RLHF Workflow: From Reward Modeling to Online RLHFcited by 267
  7. 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
  8. 2025EmbeddingGemma: Powerful and Lightweight Text Representationscited by 139
  9. 2024Hypothetical Minds: Scaffolding Theory of Mind for Multi-Agent Tasks with Large Language Modelscited by 48
  10. 2024Personalized LLM Response Generation with Parameterized Memory Injectioncited by 33
  11. 2025Evaluating and Steering Modality Preferences in Multimodal Large Language Modelcited by 33
  12. 2024Language Models Represent Beliefs of Self and Otherscited by 31
20 more
  1. 2025Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Modelscited by 21
  2. 2023User Simulation with Large Language Models for Evaluating Task-Oriented Dialoguecited by 19
  3. 2024Learning Retrieval Augmentation for Personalized Dialogue Generationcited by 18
  4. 2024Generalizing Conversational Dense Retrieval via LLM-Cognition Data Augmentationcited by 17
  5. 2024DiaHalu: A Dialogue-level Hallucination Evaluation Benchmark for Large Language Modelscited by 15
  6. 2024MADial-Bench: Towards Real-world Evaluation of Memory-Augmented Dialogue Generationcited by 15
  7. 2024ReSpAct: Harmonizing Reasoning, Speaking, and Acting Towards Building Large Language Model-Based Conversational AI Agentscited by 15
  8. 2025PRINCIPLES: Synthetic Strategy Memory for Proactive Dialogue Agentscited by 15
  9. 2025Large Language Models as Theory of Mind Aware Generative Agents with Counterfactual Reflectioncited by 13
  10. 2025MetaMind: Modeling Human Social Thoughts with Metacognitive Multi-Agent Systemscited by 13
  11. 2025IntentionESC: An Intention-Centered Framework for Enhancing Emotional Support in Dialogue Systemscited by 11
  12. 2025Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoningcited by 10
  13. 2024Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QAcited by 9
  14. 2025The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agentscited by 7
  15. 2017Customized Nonlinear Bandits for Online Response Selection in Neural Conversation Modelscited by 6
  16. 2024Knowledge Graph Tuning: Real-time Large Language Model Personalization based on Human Feedbackcited by 6
  17. 2024Reasoning in Conversation: Solving Subjective Tasks through Dialogue Simulation for Large Language Modelscited by 5
  18. 2025Agent-to-Agent Theory of Mind: Testing Interlocutor Awareness among Large Language Modelscited by 5
  19. 2026InftyThink+: Effective and Efficient Infinite-Horizon Reasoning via Reinforcement Learningcited by 5
  20. 2025Reasoning over Boundaries: Enhancing Specification Alignment via Test-time Deliberationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025EMO-Reasoning: Benchmarking Emotional Reasoning Capabilities in Spoken Dialogue Systems
  2. 2026Listening to the Echo: User-Reaction Aware Policy Optimization via Scalar-Verbal Hybrid Reinforcement Learning
  3. 2025DialogXpert: Driving Intelligent and Emotion-Aware Conversations through Online Value-Based Reinforcement Learning with LLM Priors
  4. 2020Human-centric Dialog Training via Offline Reinforcement Learning
  5. 2025All Learning Has an Emotional Basis, So Does Task-Oriented Dialogue
  6. 2025Affective Multimodal Agents with Proactive Knowledge Grounding for Emotionally Aligned Marketing Dialogue
  7. 2025Dream to Chat: Model-based Reinforcement Learning on Dialogues with User Belief Modeling
  8. 2022Learning New Skills after Deployment: Improving open-domain internet-driven dialogue with human feedback