Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence
Not on the map. Why?
Abstract (arXiv)
Emotional Intelligence (EI), consisting of emotion perception, emotion cognition and emotion expression, plays the critical roles in improving user interaction experience for the current large language model (LLM) based conversational general AI assistants. Previous works mainly focus on raising the emotion perception ability of them via naive fine-tuning on EI-related classification or regression tasks. However, this leads to the incomplete enhancement of EI and catastrophic forgetting of the general intelligence (GI). To this end, we first introduce textscEiBench, a large-scale collection of EI-related tasks in the text-to-text formation with task instructions that covers all three aspects of EI, which lays a solid foundation for the comprehensive EI enhancement of LLMs. Then a novel underlineModular underlineEmotional underlineIntelligence enhancement method (MoEI), consisting of Modular Parameter Expansion and intra-inter modulation, is proposed to comprehensively enhance the EI of LLMs without compromise their GI. Extensive experiments on two representative LLM-based assistants, Flan-T5 and LLaMA-2-Chat, demonstrate the effectiveness of MoEI to improving EI while maintain GI.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 59 of its 118 references that are in the map. First posted on arXiv 15 Feb 2024.
Builds on
59 of 118 references.
References · 59
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
38 more
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2016Progressive Neural Networkscited by 1,332
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
- 2018Experience Replay for Continual Learningcited by 1,074
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
- 2023How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resourcescited by 405
- 2017PathNet: Evolution Channels Gradient Descent in Super Neural Networkscited by 362
- 2021Towards Emotional Support Dialog Systemscited by 294
- 2018Selective Experience Replay for Lifelong Learningcited by 239
- 2019Episodic Memory in Lifelong Language Learningcited by 188
- 2022Instruction Induction: From Few Examples to Natural Language Task Descriptionscited by 152
- 2023Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuningcited by 148
- 2024Continual Learning for Large Language Models: A Surveycited by 144
- 2023Large Language Models Understand and Can be Enhanced by Emotional Stimulicited by 143
- 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
- 2024LLaMA Pro: Progressive LLaMA with Block Expansioncited by 99
- 2020Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representationscited by 97
- 2020Position-Aware Tagging for Aspect Sentiment Triplet Extractioncited by 90
- 2023Exploring the Benefits of Training Expert Language Models over Instruction Tuningcited by 80
- 2019Seeing Things from a Different Angle: Discovering Diverse Perspectives about Claimscited by 73
- 2020Recognizing Emotion Cause in Conversationscited by 66
- 2023Lifelong Language Pretraining with Distribution-Specialized Expertscited by 64
- 2017A Large Self-Annotated Corpus for Sarcasmcited by 63
- 2023Building Emotional Support Chatbots in the Era of LLMscited by 62
- 2024EmoLLMs: A Series of Emotional Large Language Models and Annotation Tools for Comprehensive Affective Analysiscited by 62
- 2017The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrantscited by 55
- 2023Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBenchcited by 54
- 2022CICERO: A Dataset for Contextualized Commonsense Inference in Dialoguescited by 38
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 8; 2026: 1.
11 papers.
- 2025EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Modelscited by 32
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspectivecited by 24
- 2025Continual Multimodal Contrastive Learningcited by 19
- 2024A Survey on Human-Centric LLMscited by 13
- 2025AI with Emotions: Exploring Emotional Expressions in Large Language Modelscited by 10
- 2025Emotion-o1: Adaptive Long Reasoning for Emotion Understanding in LLMscited by 5
- 2025PersonaFuse: A Personality Activation-Driven Framework for Enhancing Human-LLM Interactionscited by 5
- 2025E3RG: Building Explicit Emotion-driven Empathetic Response Generation System with Multimodal Large Language Modelcited by 2
- 2025CHEER-Ekman: Fine-grained Embodied Emotion Classificationcited by 1
- 2025Enhancing Collective Intelligence in Large Language Models Through Emotional Integrationcited by 0
- 2026Chiaroscuro for Emotions: A Contrastive Emotion Benchmark Grounded in Appraisal Theorycited by 0
- 2026Chiaroscuro for Emotions: A Contrastive Emotion Benchmark Grounded in Appraisal Theory3 Sep 2026
- 2025PersonaFuse: A Personality Activation-Driven Framework for Enhancing Human-LLM Interactions9 Sep 2025
- 2025E3RG: Building Explicit Emotion-driven Empathetic Response Generation System with Multimodal Large Language Model18 Aug 2025
- 2025CHEER-Ekman: Fine-grained Embodied Emotion Classification1 Jun 2025
- 2025Emotion-o1: Adaptive Long Reasoning for Emotion Understanding in LLMs28 May 2025
- 2025AI with Emotions: Exploring Emotional Expressions in Large Language Models20 Apr 2025
- 2025Continual Multimodal Contrastive Learning19 Mar 2025
- 2025Enhancing Collective Intelligence in Large Language Models Through Emotional Integration5 Mar 2025
- 2025EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Models6 Feb 2025
- 2024A Survey on Human-Centric LLMs20 Nov 2024
- 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspective30 Jul 2024