mlsanityData to 14 Oct 2026

ER-EDF: A Psychology-Grounded Emotion Regulation Framework for Speech Empathetic Dialogue Generation in Large Audio-Language Models

arXiv 2609.15089 ↗First posted 14 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Empathetic response generation in spoken dialogue systems requires both accurate emotion perception and appropriate emotion regulation. Grounded in psychological theories such as the Perception-Action Model and emotion regulation theory, effective empathy depends not only on inferring a user's affective state but also on regulating how it is expressed in responses. However, recent large audio-language models (LALMs) largely treat emotion as a direct conditioning signal, lacking explicit regulatory mechanisms, which often leads to affect mirroring rather than calibrated support. We propose ER-EDF, a psychology-grounded framework that explicitly decouples emotion perception and emotion regulation in LALMs. Perception tracks the user's emotional state, while regulation determines how this state should guide empathetic response generation. The framework is model-agnostic and integrates seamlessly into existing LALMs. We further construct a spoken empathetic dialogue dataset and introduce empathy-aware evaluation metrics beyond lexical matching. Experiments across five LALMs and two datasets show that ER-EDF consistently improves empathetic response quality in both automatic and human evaluations, highlighting the importance of jointly modeling emotion perception and regulation in spoken empathetic dialogue systems, paving a new direction for psychologically grounded empathetic AI.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 48 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

13 of 48 references.

References · 13

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
  5. 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 529
  6. 2020A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Supportcited by 182
  7. 2020MIME: MIMicking Emotions for Empathetic Response Generationcited by 114
  8. 2021EmoBERTa: Speaker-Aware Emotion Recognition in Conversation with RoBERTacited by 60
  9. 2024Advancing Large Language Models to Capture Varied Speaking Styles and Respond Properly in Spoken Conversationscited by 45
  10. 2024BLSP-Emo: Towards Empathetic Large Speech-Language Modelscited by 36
  11. 2023Paralinguistics-Enhanced Large Language Modeling of Spoken Dialoguecited by 25
  12. 2025OSUM-EChat: Enhancing End-to-End Empathetic Spoken Chatbot via Understanding-Driven Spoken Dialoguecited by 21
1 more
  1. 2019Learning Word Ratings for Empathy and Distress from Document-Level User Responsescited by 10

Built on by

Not cited yet.