mlsanityData to 7 Oct 2026

Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence

arXiv 2402.10073 ↗First posted 15 Feb 2024cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

Emotional Intelligence (EI), consisting of emotion perception, emotion cognition and emotion expression, plays the critical roles in improving user interaction experience for the current large language model (LLM) based conversational general AI assistants. Previous works mainly focus on raising the emotion perception ability of them via naive fine-tuning on EI-related classification or regression tasks. However, this leads to the incomplete enhancement of EI and catastrophic forgetting of the general intelligence (GI). To this end, we first introduce textscEiBench, a large-scale collection of EI-related tasks in the text-to-text formation with task instructions that covers all three aspects of EI, which lays a solid foundation for the comprehensive EI enhancement of LLMs. Then a novel underlineModular underlineEmotional underlineIntelligence enhancement method (MoEI), consisting of Modular Parameter Expansion and intra-inter modulation, is proposed to comprehensively enhance the EI of LLMs without compromise their GI. Extensive experiments on two representative LLM-based assistants, Flan-T5 and LLaMA-2-Chat, demonstrate the effectiveness of MoEI to improving EI while maintain GI.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 59 of its 118 references that are in the map. First posted on arXiv 15 Feb 2024.

Builds on

59 of 118 references.

References · 59

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  7. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  8. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  9. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  10. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  11. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  12. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
38 more
  1. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  2. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
  3. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  4. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  5. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
  6. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  7. 2016Progressive Neural Networkscited by 1,332
  8. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  9. 2018Experience Replay for Continual Learningcited by 1,074
  10. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
  11. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
  12. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
  13. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  14. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  15. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
  16. 2023How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resourcescited by 405
  17. 2017PathNet: Evolution Channels Gradient Descent in Super Neural Networkscited by 362
  18. 2021Towards Emotional Support Dialog Systemscited by 294
  19. 2018Selective Experience Replay for Lifelong Learningcited by 239
  20. 2019Episodic Memory in Lifelong Language Learningcited by 188
  21. 2022Instruction Induction: From Few Examples to Natural Language Task Descriptionscited by 152
  22. 2023Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuningcited by 148
  23. 2024Continual Learning for Large Language Models: A Surveycited by 144
  24. 2023Large Language Models Understand and Can be Enhanced by Emotional Stimulicited by 143
  25. 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
  26. 2024LLaMA Pro: Progressive LLaMA with Block Expansioncited by 99
  27. 2020Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representationscited by 97
  28. 2020Position-Aware Tagging for Aspect Sentiment Triplet Extractioncited by 90
  29. 2023Exploring the Benefits of Training Expert Language Models over Instruction Tuningcited by 80
  30. 2019Seeing Things from a Different Angle: Discovering Diverse Perspectives about Claimscited by 73
  31. 2020Recognizing Emotion Cause in Conversationscited by 66
  32. 2023Lifelong Language Pretraining with Distribution-Specialized Expertscited by 64
  33. 2017A Large Self-Annotated Corpus for Sarcasmcited by 63
  34. 2023Building Emotional Support Chatbots in the Era of LLMscited by 62
  35. 2024EmoLLMs: A Series of Emotional Large Language Models and Annotation Tools for Comprehensive Affective Analysiscited by 62
  36. 2017The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrantscited by 55
  37. 2023Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBenchcited by 54
  38. 2022CICERO: A Dataset for Contextualized Commonsense Inference in Dialoguescited by 38

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 8; 2026: 1.

11 papers.