EQ-Bench: An Emotional Intelligence Benchmark for Large Language Models
Not on the map. Why?
Abstract (arXiv)
We introduce EQ-Bench, a novel benchmark designed to evaluate aspects of emotional intelligence in Large Language Models (LLMs). We assess the ability of LLMs to understand complex emotions and social interactions by asking them to predict the intensity of emotional states of characters in a dialogue. The benchmark is able to discriminate effectively between a wide range of models. We find that EQ-Bench correlates strongly with comprehensive multi-domain benchmarks like MMLU (Hendrycks et al., 2020) (r=0.97), indicating that we may be capturing similar aspects of broad intelligence. Our benchmark produces highly repeatable results using a set of 60 English-language questions. We also provide open-source code for an automated benchmarking pipeline at https://github.com/EQ-bench/EQ-Bench and a leaderboard at https://eqbench.com
Key facts. Cited by 80 papers in the map (data through 14 Oct 2026). Builds on 11 of its 23 references that are in the map. First posted on arXiv 11 Dec 2023.
Builds on
11 of 23 references.
References · 11
- 2017Attention Is All You Needcited by 60,361
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
- 20218-bit Optimizers via Block-wise Quantizationcited by 403
- 2023Emotional Intelligence of Large Language Modelscited by 58
Built on by
Citing papers per year: 2023: 1; 2024: 8; 2025: 34; 2026: 37.
80 papers.
Sort:
By area:
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 150
- 2026Ministral 3cited by 114
- 2025Reinforcement Learning with Rubric Anchorscited by 113
- 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 106
- 2024AgentInstruct: Toward Generative Teaching with Agentic Flowscited by 89
- 2025Jointly Reinforcing Diversity and Quality in Language Model Generationscited by 80
- 2024Self-Exploring Language Models: Active Preference Elicitation for Online Alignmentcited by 63
- 2024Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?cited by 61
- 2024Reward-Robust RLHF in LLMscited by 32
- 2025EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Modelscited by 32
- 2025Online Preference Alignment for Language Models via Count-based Explorationcited by 26
38 more
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspectivecited by 25
- 2024Sloth: scaling laws for LLM skills to predict multi-benchmark performance across familiescited by 24
- 2025Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Modelscited by 21
- 2025Compute as Teacher: Turning Inference Compute Into Reference-Free Supervisioncited by 18
- 2025Beyond the Surface: Enhancing LLM-as-a-Judge Alignment with Human via Internal Representationscited by 15
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialoguecited by 13
- 2025Are Language Models Consequentialist or Deontological Moral Reasoners?cited by 12
- 2026Outcome Accuracy is Not Enough: Aligning the Reasoning Process of Reward Modelscited by 11
- 2023The Good, The Bad, and Why: Unveiling Emotions in Generative AIcited by 10
- 2025Evaluating Text Creativity across Diverse Domains: A Dataset and Large Language Model Evaluatorcited by 10
- 2026StoryScope: Investigating idiosyncrasies in AI fictioncited by 9
- 2025Frankentext: Stitching random text fragments into long-form narrativescited by 8
- 2025Hermes 4 Technical Reportcited by 8
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoningcited by 8
- 2025CML-Bench: A Framework for Evaluating and Enhancing LLM-Powered Movie Scripts Generationcited by 7
- 2025Understanding DeepResearch via Reportscited by 7
- 2025Escaping the Verifier: Learning to Reason via Demonstrationscited by 7
- 2025Bielik 11B v3: Multilingual Large Language Model for European Languagescited by 6
- 2026Negation Neglect: When models fail to learn negations in trainingcited by 6
- 2025Bielik v3 Small: Technical Reportcited by 5
- 2025Accidental Vulnerability: Factors in Fine-Tuning that Shift Model Safeguardscited by 5
- 2025Exploiting Leaderboards for Large-Scale Distribution of Malicious Modelscited by 5
- 2025PersonaFuse: A Personality Activation-Driven Framework for Enhancing Human-LLM Interactionscited by 5
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligencecited by 5
- 2025Decentralized Arena: Towards Democratic and Scalable Automatic Evaluation of Language Modelscited by 4
- 2025CoSineVerifier: Tool-Augmented Answer Verification for Computation-Oriented Scientific Questionscited by 4
- 2026Focal Reward: Balanced Reinforcement Learning under Rubric-Based Rewardscited by 4
- 2025RECAP: Transparent Inference-Time Emotion Alignment for Medical Dialogue Systemscited by 3
- 2026ROMA: Recursive Open Meta-Agent Framework for Long-Horizon Multi-Agent Systemscited by 3
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialoguecited by 3
- 2026EIBench: A Simulator-Based Benchmark and Turn-Credit RL for Emotion Managementcited by 3
- 2025Playpen: An Environment for Exploring Learning Through Conversational Interactioncited by 2
- 2025Bielik 11B v2 Technical Reportcited by 2
- 2025Empathic Prompting: Non-Verbal Context Integration for Multimodal LLM Conversationscited by 2
- 2025PRISM: A Personality-Driven Multi-Agent Framework for Social Media Simulationcited by 2
- 2026Measuring and Mitigating Post-hoc Rationalization in Reverse Chain-of-Thought Generationcited by 2
- 2026PowerFlow: Unlocking the Dual Nature of LLMs via Principled Distribution Matchingcited by 2
- 2026PoliticsBench: Benchmarking Political Values in Large Language Models with Multi-Turn Roleplaycited by 2
50 most cited of 80 All 80 (JSON)
- 2026DART-ES: Difficulty-Aware Reweighting and Targeted Replay for Fine-Tuning LLMs with Evolution Strategies4 Oct 2026
- 2026Gacha Decoding: Eliciting Diverse Generations Through Instruction Following1 Oct 2026
- 2026Large-scale factor analysis shows machine intelligence is only partially interpretable29 Sep 2026
- 2026On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics28 Sep 2026
- 2026RLVR2: Reinforcement Learning with Verifiable Rubric-based Ranking20 Sep 2026
- 2026Rethinking Multi-Agent Collaboration: When More Is Less17 Sep 2026
- 2026On the Impact of Anonymization on the Performance of Large Language Models10 Sep 2026
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence31 Aug 2026
- 2026PTEI: Integrating Personality Traits to Enhance Emotional Intelligence in Large Language Models11 Jul 2026
- 2026SPLIT: Cross-Lingual Empathy and Cultural Grounding in English and Ukrainian LLM Responses2 Jul 2026
- 2026SpeechEQ: Benchmarking Emotional Intelligence Quotient in Socially Aware Voice Conversational Models24 Jun 2026
- 2026OPERA: Aligning Open-Ended Reasoning via Objective Perplexity-based Reinforcement Learning24 Jun 2026
38 more
- 2026EIBench: A Simulator-Based Benchmark and Turn-Credit RL for Emotion Management14 Jun 2026
- 2026Focal Reward: Balanced Reinforcement Learning under Rubric-Based Rewards26 May 2026
- 2026Emotional intelligence in large language models is fragmented across perception, cognition, and interaction23 May 2026
- 2026AttuneBench: A Conversation-Based Benchmark for LLM Emotional Intelligence20 May 2026
- 2026Negation Neglect: When models fail to learn negations in training13 May 2026
- 2026Assessing the Creativity of Large Language Models: Testing, Limits, and New Frontiers13 May 2026
- 2026Limits of Reliability and Scaling in Language Models8 May 2026
- 2026StoryAlign: Evaluating and Training Reward Models for Story Generation6 May 2026
- 2026Advancing Polish Language Modeling through Tokenizer Optimization in the Bielik v3 7B and 11B Series12 Apr 2026
- 2026Spoiler Alert: Narrative Forecasting as a Metric for Tension in LLM Storytelling10 Apr 2026
- 2026Beneath the Surface: Investigating LLMs' Capabilities for Communicating with Subtext7 Apr 2026
- 2026StoryScope: Investigating idiosyncrasies in AI fiction3 Apr 2026
- 2026Breakdowns in Conversational AI: Interactional Failures in Emotionally and Ethically Sensitive Contexts3 Apr 2026
- 2026Can Large Language Models Simulate Human Cognition Beyond Behavioral Imitation?29 Mar 2026
- 2026PoliticsBench: Benchmarking Political Values in Large Language Models with Multi-Turn Roleplay25 Mar 2026
- 2026PowerFlow: Unlocking the Dual Nature of LLMs via Principled Distribution Matching19 Mar 2026
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialogue6 Mar 2026
- 2026CharacterFlywheel: Scaling Iterative Improvement of Engaging and Steerable LLMs in Production2 Mar 2026
- 2026Measuring and Mitigating Post-hoc Rationalization in Reverse Chain-of-Thought Generation16 Feb 2026
- 2026Outcome Accuracy is Not Enough: Aligning the Reasoning Process of Reward Models4 Feb 2026
- 2026ROMA: Recursive Open Meta-Agent Framework for Long-Horizon Multi-Agent Systems2 Feb 2026
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning1 Feb 2026
- 2026Identifying Models Behind Text-to-Image Leaderboards14 Jan 2026
- 2026Ministral 313 Jan 2026
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialogue9 Jan 2026
- 2025Bielik 11B v3: Multilingual Large Language Model for European Languages30 Dec 2025
- 2025HeartBench: Probing Core Dimensions of Anthropomorphic Intelligence in LLMs26 Dec 2025
- 2025PRISM: A Personality-Driven Multi-Agent Framework for Social Media Simulation22 Dec 2025
- 2025Capturing Classic Authorial Style in Long-Form Story Generation with GRPO Fine-Tuning5 Dec 2025
- 2025CoSineVerifier: Tool-Augmented Answer Verification for Computation-Oriented Scientific Questions1 Dec 2025
- 2025Escaping the Verifier: Learning to Reason via Demonstrations26 Nov 2025
- 2025Qwen3-VL Technical Report26 Nov 2025
- 2025InvisibleBench: A Deployment Gate for Caregiving Relationship AI25 Nov 2025
- 2025Empathic Prompting: Non-Verbal Context Integration for Multimodal LLM Conversations23 Oct 2025
- 2025Antislop: A Comprehensive Framework for Identifying and Eliminating Repetitive Patterns in Language Models16 Oct 2025
- 2025Understanding DeepResearch via Reports9 Oct 2025
- 2025CML-Bench: A Framework for Evaluating and Enhancing LLM-Powered Movie Scripts Generation1 Oct 2025
- 2025Compute as Teacher: Turning Inference Compute Into Reference-Free Supervision17 Sep 2025
50 newest of 80 All 80 (JSON)
- 2025Are Language Models Consequentialist or Deontological Moral Reasoners?cited by 12
- 2026Outcome Accuracy is Not Enough: Aligning the Reasoning Process of Reward Modelscited by 11
- 2025Hermes 4 Technical Reportcited by 8
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoningcited by 8
- 2025Escaping the Verifier: Learning to Reason via Demonstrationscited by 7
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligencecited by 5
- 2026EIBench: A Simulator-Based Benchmark and Turn-Credit RL for Emotion Managementcited by 3
- 2026Measuring and Mitigating Post-hoc Rationalization in Reverse Chain-of-Thought Generationcited by 2
- 2025Capturing Classic Authorial Style in Long-Form Story Generation with GRPO Fine-Tuningcited by 0
- 2026Can Large Language Models Simulate Human Cognition Beyond Behavioral Imitation?cited by 0
- 2026OPERA: Aligning Open-Ended Reasoning via Objective Perplexity-based Reinforcement Learningcited by 0
- 2026Rethinking Multi-Agent Collaboration: When More Is Lesscited by 0
12 most cited of 13 All 13 (JSON)
- 2026DART-ES: Difficulty-Aware Reweighting and Targeted Replay for Fine-Tuning LLMs with Evolution Strategies4 Oct 2026
- 2026Rethinking Multi-Agent Collaboration: When More Is Less17 Sep 2026
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence31 Aug 2026
- 2026OPERA: Aligning Open-Ended Reasoning via Objective Perplexity-based Reinforcement Learning24 Jun 2026
- 2026EIBench: A Simulator-Based Benchmark and Turn-Credit RL for Emotion Management14 Jun 2026
- 2026Can Large Language Models Simulate Human Cognition Beyond Behavioral Imitation?29 Mar 2026
- 2026Measuring and Mitigating Post-hoc Rationalization in Reverse Chain-of-Thought Generation16 Feb 2026
- 2026Outcome Accuracy is Not Enough: Aligning the Reasoning Process of Reward Models4 Feb 2026
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning1 Feb 2026
- 2025Capturing Classic Authorial Style in Long-Form Story Generation with GRPO Fine-Tuning5 Dec 2025
- 2025Escaping the Verifier: Learning to Reason via Demonstrations26 Nov 2025
- 2025Hermes 4 Technical Report25 Aug 2025
12 newest of 13 All 13 (JSON)
- 2024Self-Exploring Language Models: Active Preference Elicitation for Online Alignmentcited by 63
- 2024Reward-Robust RLHF in LLMscited by 32
- 2025Online Preference Alignment for Language Models via Count-based Explorationcited by 26
- 2025Beyond the Surface: Enhancing LLM-as-a-Judge Alignment with Human via Internal Representationscited by 15
- 2025Playpen: An Environment for Exploring Learning Through Conversational Interactioncited by 2
- 2026StoryAlign: Evaluating and Training Reward Models for Story Generationcited by 1
- 2026StoryAlign: Evaluating and Training Reward Models for Story Generation6 May 2026
- 2025Beyond the Surface: Enhancing LLM-as-a-Judge Alignment with Human via Internal Representations5 Aug 2025
- 2025Playpen: An Environment for Exploring Learning Through Conversational Interaction11 Apr 2025
- 2025Online Preference Alignment for Language Models via Count-based Exploration22 Jan 2025
- 2024Reward-Robust RLHF in LLMs18 Sep 2024
- 2024Self-Exploring Language Models: Active Preference Elicitation for Online Alignment29 May 2024
- 2024AgentInstruct: Toward Generative Teaching with Agentic Flowscited by 89
- 2025Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Modelscited by 21
- 2025Understanding DeepResearch via Reportscited by 7
- 2026ROMA: Recursive Open Meta-Agent Framework for Long-Horizon Multi-Agent Systemscited by 3
- 2025PRISM: A Personality-Driven Multi-Agent Framework for Social Media Simulationcited by 2
- 2026ROMA: Recursive Open Meta-Agent Framework for Long-Horizon Multi-Agent Systems2 Feb 2026
- 2025PRISM: A Personality-Driven Multi-Agent Framework for Social Media Simulation22 Dec 2025
- 2025Understanding DeepResearch via Reports9 Oct 2025
- 2025Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Models1 May 2025
- 2024AgentInstruct: Toward Generative Teaching with Agentic Flows3 Jul 2024
- 2025Reinforcement Learning with Rubric Anchorscited by 113
- 2026Focal Reward: Balanced Reinforcement Learning under Rubric-Based Rewardscited by 4
- 2026Focal Reward: Balanced Reinforcement Learning under Rubric-Based Rewards26 May 2026
- 2025Reinforcement Learning with Rubric Anchors18 Aug 2025
- 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 150
- 2026Ministral 3cited by 114
- 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 106
- 2025Jointly Reinforcing Diversity and Quality in Language Model Generationscited by 80
- 2024Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?cited by 61
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspectivecited by 25
- 2024Sloth: scaling laws for LLM skills to predict multi-benchmark performance across familiescited by 24
- 2025Compute as Teacher: Turning Inference Compute Into Reference-Free Supervisioncited by 18
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialoguecited by 13
- 2023The Good, The Bad, and Why: Unveiling Emotions in Generative AIcited by 10
- 2025Evaluating Text Creativity across Diverse Domains: A Dataset and Large Language Model Evaluatorcited by 10
- 2026StoryScope: Investigating idiosyncrasies in AI fictioncited by 9
12 most cited of 51 All 51 (JSON)
- 2026Gacha Decoding: Eliciting Diverse Generations Through Instruction Following1 Oct 2026
- 2026Large-scale factor analysis shows machine intelligence is only partially interpretable29 Sep 2026
- 2026On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics28 Sep 2026
- 2026RLVR2: Reinforcement Learning with Verifiable Rubric-based Ranking20 Sep 2026
- 2026On the Impact of Anonymization on the Performance of Large Language Models10 Sep 2026
- 2026PTEI: Integrating Personality Traits to Enhance Emotional Intelligence in Large Language Models11 Jul 2026
- 2026SPLIT: Cross-Lingual Empathy and Cultural Grounding in English and Ukrainian LLM Responses2 Jul 2026
- 2026SpeechEQ: Benchmarking Emotional Intelligence Quotient in Socially Aware Voice Conversational Models24 Jun 2026
- 2026Emotional intelligence in large language models is fragmented across perception, cognition, and interaction23 May 2026
- 2026AttuneBench: A Conversation-Based Benchmark for LLM Emotional Intelligence20 May 2026
- 2026Negation Neglect: When models fail to learn negations in training13 May 2026
- 2026Assessing the Creativity of Large Language Models: Testing, Limits, and New Frontiers13 May 2026
12 newest of 51 All 51 (JSON)