mlsanityData to 7 Oct 2026

Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspective

arXiv 2408.04638 ↗First posted 30 Jul 2024cs.CL cs.CYcited by 24

Not on the map. Why?

Abstract (arXiv)

Affective Computing (AC) integrates computer science, psychology, and cognitive science to enable machines to recognize, interpret, and simulate human emotions across domains such as social media, finance, healthcare, and education. AC commonly centers on two task families: Affective Understanding (AU) and Affective Generation (AG). While fine-tuned pre-trained language models (PLMs) have achieved solid AU performance, they often generalize poorly across tasks and remain limited for AG, especially in producing diverse, emotionally appropriate responses. The advent of Large Language Models (LLMs) (e.g., ChatGPT and LLaMA) has catalyzed a paradigm shift by offering in-context learning, broader world knowledge, and stronger sequence generation. This survey presents an NLP-oriented overview of AC in the LLM era. We (i) consolidate traditional AC tasks and preliminary LLM-based studies; (ii) review adaptation techniques that improve AU/AG, including Instruction Tuning (full and parameter-efficient methods such as LoRA, P-/Prompt-Tuning), Prompt Engineering (zero/few-shot, chain-of-thought, agent-based prompting), and Reinforcement Learning. For the latter, we summarize RL from human preferences (RLHF), verifiable/programmatic rewards (RLVR), and AI feedback (RLAIF), which provide preference- or rule-grounded optimization signals that can help steer AU/AG toward empathy, safety, and planning, achieving finer-grained or multi-objective control. To assess progress, we compile benchmarks and evaluation practices for both AU and AG. We also discuss open challenges-from ethics, data quality, and safety to robust evaluation and resource efficiency-and outline research directions. We hope this survey clarifies the landscape and offers practical guidance for building affect-aware, reliable, and responsible LLM systems.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 118 of its 242 references that are in the map. First posted on arXiv 30 Jul 2024.

Builds on

118 of 242 references.

References · 118

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2017Proximal Policy Optimization Algorithmscited by 14,441
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  8. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  9. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  10. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  11. 2023Visual Instruction Tuningcited by 7,792
  12. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
38 more
  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  2. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  3. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  4. 2023A Survey of Large Language Modelscited by 2,537
  5. 2022Emergent Abilities of Large Language Modelscited by 2,483
  6. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  7. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  8. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  9. 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 915
  10. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
  11. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  12. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  13. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  14. 2023Instruction Tuning for Large Language Models: A Surveycited by 617
  15. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  16. 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 545
  17. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
  18. 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 337
  19. 2021Towards Emotional Support Dialog Systemscited by 294
  20. 2023VeRA: Vector-based Random Matrix Adaptationcited by 294
  21. 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 262
  22. 2023Secrets of RLHF in Large Language Models Part I: PPOcited by 226
  23. 2017A Survey on Dialogue Systems: Recent Advances and New Frontierscited by 162
  24. 2024MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Expertscited by 144
  25. 2020DFEW: A Large-Scale Database for Recognizing Dynamic Facial Expressions in the Wildcited by 128
  26. 2019Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advancescited by 118
  27. 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuningcited by 117
  28. 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
  29. 2023SoulChat: Improving LLMs' Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversationscited by 109
  30. 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
  31. 2021Aspect Sentiment Quad Prediction as Paraphrase Generationcited by 99
  32. 2023Is ChatGPT a Good Sentiment Analyzer? A Preliminary Studycited by 96
  33. 2019Emotion-Cause Pair Extraction: A New Task to Emotion Analysis in Textscited by 82
  34. 2023Reasoning Implicit Sentiment with Chain-of-Thought Promptingcited by 79
  35. 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 76
  36. 2023EQ-Bench: An Emotional Intelligence Benchmark for Large Language Modelscited by 75
  37. 2023Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Modelscited by 67
  38. 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMscited by 62

50 most cited of 118 All 118 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 10; 2026: 11.

24 papers.

Sort:

By area:

  1. 2024Recent Advances in Multimodal Affective Computing: An NLP Perspectivecited by 12
  2. 2024MEMO-Bench: A Multiple Benchmark for Text-to-Image and Multimodal Large Language Models on Human Emotion Analysiscited by 10
  3. 2025Decoding Emotion in the Deep: A Systematic Study of How LLMs Represent, Retain, and Express Emotioncited by 10
  4. 2025Large Language Models for Subjective Language Understanding: A Surveycited by 9
  5. 2025AI shares emotion with humans across languages and culturescited by 5
  6. 2024Minstrel: Structural Prompt Generation with Multi-Agents Coordination for Non-AI Expertscited by 4
  7. 2025Can Large Language Models Capture Video Game Engagement?cited by 2
  8. 2025When LLMs Team Up: The Emergence of Collaborative Affective Computingcited by 2
  9. 2025Fuzzy Reasoning Chain (FRC): An Innovative Reasoning Framework from Fuzziness to Claritycited by 2
  10. 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialoguecited by 2
  11. 2025Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Modelcited by 1
  12. 2025Evaluating Human-LLM Representation Alignment: A Case Study on Affective Sentence Generation for Augmentative and Alternative Communicationcited by 1
12 more
  1. 2025DinoCompanion: An Attachment-Theory Informed Multimodal Robot for Emotionally Responsive Child-AI Interactioncited by 1
  2. 2025Learning to Hear by Seeing: It's Time for Vision Language Models to Understand Artistic Emotion from Sight and Soundcited by 1
  3. 2026Do Vision Language Models Understand Human Engagement in Games?cited by 1
  4. 2026EmoScene: A Dual-space Dataset for Controllable Affective Image Generationcited by 1
  5. 2026Can LLMs Think Like Consumers? Benchmarking Crowd-Level Reaction Reconstruction with ConsumerSimBenchcited by 1
  6. 2026Mechanistic Decoding of Cognitive Constructs in Large Language Modelscited by 0
  7. 2026UKP_Psycontrol at SemEval-2026 Task 2: Modeling Valence and Arousal Dynamics from Textcited by 0
  8. 2026The Storyteller in the Model: Narrative Pattern Inheritance, Escalation Dynamics, and Alignment Governance in LLMscited by 0
  9. 2026NTDH: Complex Reasoning for Comprehensive Affective Analysiscited by 0
  10. 2026ProFocus: Interpreting Affective Experience in Artistic Images with Progressive Visual Focusingcited by 0
  11. 2026Controllable Affective Generation via Latent Vector Steeringcited by 0
  12. 2026Spook the Machine: Gamified Exploration of Human Imagination of Machine Fearcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Multimodal Large Language Models for End-to-End Affective Computing: Benchmarking and Boosting with Generative Knowledge Prompting
  2. 2025From Rational Answers to Emotional Resonance: The Role of Controllable Emotion Generation in Language Models
  3. 2024Generative Technology for Human Emotion Recognition: A Scope Review
  4. 2025Large language models show fragile cognitive reasoning about human emotions
  5. 2025Affective-CARA: A Knowledge Graph Driven Framework for Culturally Adaptive Emotional Intelligence in HCI
  6. 2026Evaluating Prompt Engineering Strategies for Sentiment Control in AI-Generated Texts
  7. 2025Leveraging Large Language Models for Predictive Analysis of Human Misery
  8. 2025Teleology-Driven Affective Computing: A Causal Framework for Sustained Well-Being