EIBench: A Simulator-Based Benchmark and Turn-Credit RL for Emotion Management
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
Emotional intelligence (EI) in Large Language Models (LLMs) is often evaluated through static understanding tasks or single-response dialogue generation. However, emotion management is interactive: a good model should not only recognize a user's emotion, but also improve the user's emotional and relational state over several turns. We introduce EIBench, a simulator-based benchmark for interactive emotion management. EIBench contains 2,222 scenarios, with 2,009 for training and 213 for held-out testing. The scenarios are organized by a 2x2 taxonomy covering Support, Defense, Repair, and Charm, which together capture different forms of support, boundary maintenance, trust repair, and rapport building. In each scenario, an LLM simulator plays the user, updates an emotion-relation state after each turn, and maps the final state to an anchor-based score. This design makes EIBench both an evaluation benchmark and a training environment: the final state gives the outcome reward, while the per-turn state updates provide dense feedback for RL. We evaluate 15 open- and closed-source LLMs. Current models perform well on support and rapport-building scenes, but struggle with boundary maintenance under user pressure. To improve the EI ability of LLMs, we propose Centered Turn-Credit GRPO (CTC-GRPO), a GRPO extension that reuses the simulator's per-turn state updates as dense turn-level feedback while preserving the final outcome reward. CTC-GRPO improves Qwen3-8B from -22.4 to +22.4 on EIBench and also improves on out-of-distribution evaluations including SAGE (+12.4) and EQBench3 (+20.9%). Our results show that simulator-tracked user states can support both evaluation and training for multi-turn emotion management.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 31 of its 38 references that are in the map. First posted on arXiv 14 Jun 2026.
Builds on
31 of 38 references.
Closest ancestors · 1
Same direction, newest first
Other references · 30
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
- 2025Group Sequence Policy Optimizationcited by 835
- 2025SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wildcited by 511
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
18 more
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
- 2021Towards Emotional Support Dialog Systemscited by 299
- 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
- 2025VAPO: Efficient and Reliable Reinforcement Learning for Advanced Reasoning Taskscited by 285
- 2025Gold-medalist Performance in Solving Olympiad Geometry with AlphaGeometry2cited by 97
- 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoningcited by 94
- 2021PsyQA: A Chinese Dataset for Generating Long Counseling Text for Mental Health Supportcited by 92
- 2023EQ-Bench: An Emotional Intelligence Benchmark for Large Language Modelscited by 80
- 2024ToMBench: Benchmarking Theory of Mind in Large Language Modelscited by 72
- 2026Qwen3-Coder-Next Technical Reportcited by 71
- 2024EmoBench: Evaluating the Emotional Intelligence of Large Language Modelscited by 53
- 2025Search and Refine During Think: Facilitating Knowledge Refinement for Improved Retrieval-Augmented Reasoningcited by 35
- 2025Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Modelscited by 21
- 2026ArenaRL: Scaling RL for Open-Ended Agents via Tournament-based Relative Rankingcited by 17
- 2026Reward Modeling from Natural Language Human Feedbackcited by 11
- 2025SI-Bench: Benchmarking Social Intelligence of Large Language Models in Human-to-Human Conversationscited by 7
- 2025Echo-N1: Affective RL Frontiercited by 6
- 2025AgentSense: LLMs Empower Generalizable and Explainable Web-Based Participatory Urban Sensingcited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026CompanionBench: A Theory-Anchored, Real-World-Grounded Benchmark for AI Emotional Companionshipcited by 5
- 2026Towards Better Agents for Multi-Turn User Interaction: The Next User Turn Is More Than Contextcited by 1
- 2026Dual-Loop Self-Evolution via Verifiable Emotion Feedback for Multi-Turn Empathetic Dialoguecited by 0
- 2026Towards Better Agents for Multi-Turn User Interaction: The Next User Turn Is More Than Context18 Aug 2026
- 2026Dual-Loop Self-Evolution via Verifiable Emotion Feedback for Multi-Turn Empathetic Dialogue11 Aug 2026
- 2026CompanionBench: A Theory-Anchored, Real-World-Grounded Benchmark for AI Emotional Companionship3 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Models
- 2026EmoLLM: Appraisal-Grounded Cognitive-Emotional Co-Reasoning in Large Language Models
- 2026EmoS: A Theory-Grounded Framework for Evaluating and Aligning Emotional Intelligence in Spoken Language Models
- 2026TEA-Bench: A Systematic Benchmarking of Tool-enhanced Emotional Support Dialogue Agent
- 2025EMO-Reasoning: Benchmarking Emotional Reasoning Capabilities in Spoken Dialogue Systems
- 2025LongEmotion: Measuring Emotional Intelligence of Large Language Models in Long-Context Interaction
- 2025ESC-Judge: A Framework for Comparing Emotional Support Conversational Agents
- 2025EmoFSM: A Finite State Machine for Emotional Support Conversation