mlsanityData to 14 Oct 2026

SELF-EMO: Emotional Self-Evolution from Recognition to Consistent Expression

arXiv 2604.18003 ↗First posted 20 Apr 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Emotion Recognition in Conversation (ERC) has become a fundamental capability for large language models (LLMs) in human-centric interaction. Beyond accurate recognition, coherent emotional expression is also crucial, yet both are limited by the scarcity and static nature of high-quality annotated data. In this work, we propose SELF-EMO, a self-evolution framework grounded in the hypothesis that better emotion prediction leads to more consistent emotional responses. We introduce two auxiliary tasks, emotional understanding and emotional expression, and design a role-based self-play paradigm where the model acts as both an emotion recognizer and a dialogue responder. Through iterative interactions, the model generates diverse conversational trajectories, enabling scalable data generation. To ensure quality, we adopt a data flywheel mechanism that filters candidate predictions and responses using a smoothed IoU-based reward and feeds selected samples back for continuous self-improvement without external supervision. We further develop SELF-GRPO, a reinforcement learning algorithm that stabilizes optimization with multi-label alignment rewards and group-level consistency signals. Experiments on IEMOCAP, MELD, and EmoryNLP show that SELF-EMO achieves state-of-the-art performance, improving accuracy by +6.33% on Qwen3-4B and +8.54% on Qwen3-8B, demonstrating strong effectiveness and generalization.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 37 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

20 of 37 references.

References · 20

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
  5. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
  6. 2015A Critical Review of Recurrent Neural Networks for Sequence Learningcited by 224
  7. 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 218
  8. 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 186
  9. 2020COSMIC: COmmonSense knowledge for eMotion Identification in Conversationscited by 136
  10. 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
  11. 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
  12. 2021MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversationcited by 99
8 more
  1. 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
  2. 2021DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversationscited by 71
  3. 2025Beyond Pass@1: Self-Play with Variational Problem Synthesis Sustains RLVRcited by 54
  4. 2023Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversationscited by 47
  5. 2025One-shot Entropy Minimizationcited by 32
  6. 2025SPELL: Self-Play Reinforcement Learning for Evolving Long-Context Language Modelscited by 29
  7. 2023BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversationcited by 9
  8. 2025Long-Short Distance Graph Neural Networks and Improved Curriculum Learning for Emotion Recognition in Conversationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Dual-Loop Self-Evolution via Verifiable Emotion Feedback for Multi-Turn Empathetic Dialogue
  2. 2026Self-EmoQ: Plutchik-Guided Value-based Planning to Drive Streaming Emotional TTS
  3. 2024Self-Emotion Blended Dialogue Generation in Social Simulation Agents
  4. 2025EMO-Reasoning: Benchmarking Emotional Reasoning Capabilities in Spoken Dialogue Systems
  5. 2026EmoS: A Theory-Grounded Framework for Evaluating and Aligning Emotional Intelligence in Spoken Language Models
  6. 2025Conversations: Love Them, Hate Them, Steer Them
  7. 2026OneEmo: A Unified Multimodal Reasoning Model for Emotion Perception, Understanding, and Interaction
  8. 2024EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimization