mlsanityData to 14 Oct 2026

EIBench: A Simulator-Based Benchmark and Turn-Credit RL for Emotion Management

arXiv 2606.15532 ↗First posted 14 Jun 2026cs.CL cs.LGcited by 3

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

Emotional intelligence (EI) in Large Language Models (LLMs) is often evaluated through static understanding tasks or single-response dialogue generation. However, emotion management is interactive: a good model should not only recognize a user's emotion, but also improve the user's emotional and relational state over several turns. We introduce EIBench, a simulator-based benchmark for interactive emotion management. EIBench contains 2,222 scenarios, with 2,009 for training and 213 for held-out testing. The scenarios are organized by a 2x2 taxonomy covering Support, Defense, Repair, and Charm, which together capture different forms of support, boundary maintenance, trust repair, and rapport building. In each scenario, an LLM simulator plays the user, updates an emotion-relation state after each turn, and maps the final state to an anchor-based score. This design makes EIBench both an evaluation benchmark and a training environment: the final state gives the outcome reward, while the per-turn state updates provide dense feedback for RL. We evaluate 15 open- and closed-source LLMs. Current models perform well on support and rapport-building scenes, but struggle with boundary maintenance under user pressure. To improve the EI ability of LLMs, we propose Centered Turn-Credit GRPO (CTC-GRPO), a GRPO extension that reuses the simulator's per-turn state updates as dense turn-level feedback while preserving the final outcome reward. CTC-GRPO improves Qwen3-8B from -22.4 to +22.4 on EIBench and also improves on out-of-distribution evaluations including SAGE (+12.4) and EQBench3 (+20.9%). Our results show that simulator-tracked user states can support both evaluation and training for multi-turn emotion management.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 31 of its 38 references that are in the map. First posted on arXiv 14 Jun 2026.

Builds on

31 of 38 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agents3 Jul

Other references · 30

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  5. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  6. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  7. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  8. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
  9. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  10. 2025Group Sequence Policy Optimizationcited by 835
  11. 2025SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wildcited by 511
  12. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
18 more
  1. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
  2. 2021Towards Emotional Support Dialog Systemscited by 299
  3. 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 289
  4. 2025VAPO: Efficient and Reliable Reinforcement Learning for Advanced Reasoning Taskscited by 285
  5. 2025Gold-medalist Performance in Solving Olympiad Geometry with AlphaGeometry2cited by 97
  6. 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoningcited by 94
  7. 2021PsyQA: A Chinese Dataset for Generating Long Counseling Text for Mental Health Supportcited by 92
  8. 2023EQ-Bench: An Emotional Intelligence Benchmark for Large Language Modelscited by 80
  9. 2024ToMBench: Benchmarking Theory of Mind in Large Language Modelscited by 72
  10. 2026Qwen3-Coder-Next Technical Reportcited by 71
  11. 2024EmoBench: Evaluating the Emotional Intelligence of Large Language Modelscited by 53
  12. 2025Search and Refine During Think: Facilitating Knowledge Refinement for Improved Retrieval-Augmented Reasoningcited by 35
  13. 2025Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Modelscited by 21
  14. 2026ArenaRL: Scaling RL for Open-Ended Agents via Tournament-based Relative Rankingcited by 17
  15. 2026Reward Modeling from Natural Language Human Feedbackcited by 11
  16. 2025SI-Bench: Benchmarking Social Intelligence of Large Language Models in Human-to-Human Conversationscited by 7
  17. 2025Echo-N1: Affective RL Frontiercited by 6
  18. 2025AgentSense: LLMs Empower Generalizable and Explainable Web-Based Participatory Urban Sensingcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Models
  2. 2026EmoLLM: Appraisal-Grounded Cognitive-Emotional Co-Reasoning in Large Language Models
  3. 2026EmoS: A Theory-Grounded Framework for Evaluating and Aligning Emotional Intelligence in Spoken Language Models
  4. 2026TEA-Bench: A Systematic Benchmarking of Tool-enhanced Emotional Support Dialogue Agent
  5. 2025EMO-Reasoning: Benchmarking Emotional Reasoning Capabilities in Spoken Dialogue Systems
  6. 2025LongEmotion: Measuring Emotional Intelligence of Large Language Models in Long-Context Interaction
  7. 2025ESC-Judge: A Framework for Comparing Emotional Support Conversational Agents
  8. 2025EmoFSM: A Finite State Machine for Emotional Support Conversation