Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspective
Not on the map. Why?
Abstract (arXiv)
Affective Computing (AC) integrates computer science, psychology, and cognitive science to enable machines to recognize, interpret, and simulate human emotions across domains such as social media, finance, healthcare, and education. AC commonly centers on two task families: Affective Understanding (AU) and Affective Generation (AG). While fine-tuned pre-trained language models (PLMs) have achieved solid AU performance, they often generalize poorly across tasks and remain limited for AG, especially in producing diverse, emotionally appropriate responses. The advent of Large Language Models (LLMs) (e.g., ChatGPT and LLaMA) has catalyzed a paradigm shift by offering in-context learning, broader world knowledge, and stronger sequence generation. This survey presents an NLP-oriented overview of AC in the LLM era. We (i) consolidate traditional AC tasks and preliminary LLM-based studies; (ii) review adaptation techniques that improve AU/AG, including Instruction Tuning (full and parameter-efficient methods such as LoRA, P-/Prompt-Tuning), Prompt Engineering (zero/few-shot, chain-of-thought, agent-based prompting), and Reinforcement Learning. For the latter, we summarize RL from human preferences (RLHF), verifiable/programmatic rewards (RLVR), and AI feedback (RLAIF), which provide preference- or rule-grounded optimization signals that can help steer AU/AG toward empathy, safety, and planning, achieving finer-grained or multi-objective control. To assess progress, we compile benchmarks and evaluation practices for both AU and AG. We also discuss open challenges-from ethics, data quality, and safety to robust evaluation and resource efficiency-and outline research directions. We hope this survey clarifies the landscape and offers practical guidance for building affect-aware, reliable, and responsible LLM systems.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 118 of its 242 references that are in the map. First posted on arXiv 30 Jul 2024.
Builds on
118 of 242 references.
References · 118
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Visual Instruction Tuningcited by 7,792
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
38 more
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2023A Survey of Large Language Modelscited by 2,537
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 915
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2023Instruction Tuning for Large Language Models: A Surveycited by 617
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 545
- 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
- 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 337
- 2021Towards Emotional Support Dialog Systemscited by 294
- 2023VeRA: Vector-based Random Matrix Adaptationcited by 294
- 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 262
- 2023Secrets of RLHF in Large Language Models Part I: PPOcited by 226
- 2017A Survey on Dialogue Systems: Recent Advances and New Frontierscited by 162
- 2024MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Expertscited by 144
- 2020DFEW: A Large-Scale Database for Recognizing Dynamic Facial Expressions in the Wildcited by 128
- 2019Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advancescited by 118
- 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuningcited by 117
- 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
- 2023SoulChat: Improving LLMs' Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversationscited by 109
- 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
- 2021Aspect Sentiment Quad Prediction as Paraphrase Generationcited by 99
- 2023Is ChatGPT a Good Sentiment Analyzer? A Preliminary Studycited by 96
- 2019Emotion-Cause Pair Extraction: A New Task to Emotion Analysis in Textscited by 82
- 2023Reasoning Implicit Sentiment with Chain-of-Thought Promptingcited by 79
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 76
- 2023EQ-Bench: An Emotional Intelligence Benchmark for Large Language Modelscited by 75
- 2023Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Modelscited by 67
- 2023Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMscited by 62
50 most cited of 118 All 118 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 10; 2026: 11.
24 papers.
Sort:
By area:
- 2024Recent Advances in Multimodal Affective Computing: An NLP Perspectivecited by 12
- 2024MEMO-Bench: A Multiple Benchmark for Text-to-Image and Multimodal Large Language Models on Human Emotion Analysiscited by 10
- 2025Decoding Emotion in the Deep: A Systematic Study of How LLMs Represent, Retain, and Express Emotioncited by 10
- 2025Large Language Models for Subjective Language Understanding: A Surveycited by 9
- 2025AI shares emotion with humans across languages and culturescited by 5
- 2024Minstrel: Structural Prompt Generation with Multi-Agents Coordination for Non-AI Expertscited by 4
- 2025Can Large Language Models Capture Video Game Engagement?cited by 2
- 2025When LLMs Team Up: The Emergence of Collaborative Affective Computingcited by 2
- 2025Fuzzy Reasoning Chain (FRC): An Innovative Reasoning Framework from Fuzziness to Claritycited by 2
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialoguecited by 2
- 2025Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Modelcited by 1
- 2025Evaluating Human-LLM Representation Alignment: A Case Study on Affective Sentence Generation for Augmentative and Alternative Communicationcited by 1
12 more
- 2025DinoCompanion: An Attachment-Theory Informed Multimodal Robot for Emotionally Responsive Child-AI Interactioncited by 1
- 2025Learning to Hear by Seeing: It's Time for Vision Language Models to Understand Artistic Emotion from Sight and Soundcited by 1
- 2026Do Vision Language Models Understand Human Engagement in Games?cited by 1
- 2026EmoScene: A Dual-space Dataset for Controllable Affective Image Generationcited by 1
- 2026Can LLMs Think Like Consumers? Benchmarking Crowd-Level Reaction Reconstruction with ConsumerSimBenchcited by 1
- 2026Mechanistic Decoding of Cognitive Constructs in Large Language Modelscited by 0
- 2026UKP_Psycontrol at SemEval-2026 Task 2: Modeling Valence and Arousal Dynamics from Textcited by 0
- 2026The Storyteller in the Model: Narrative Pattern Inheritance, Escalation Dynamics, and Alignment Governance in LLMscited by 0
- 2026NTDH: Complex Reasoning for Comprehensive Affective Analysiscited by 0
- 2026ProFocus: Interpreting Affective Experience in Artistic Images with Progressive Visual Focusingcited by 0
- 2026Controllable Affective Generation via Latent Vector Steeringcited by 0
- 2026Spook the Machine: Gamified Exploration of Human Imagination of Machine Fearcited by 0
- 2026Spook the Machine: Gamified Exploration of Human Imagination of Machine Fear14 Sep 2026
- 2026Controllable Affective Generation via Latent Vector Steering26 Aug 2026
- 2026ProFocus: Interpreting Affective Experience in Artistic Images with Progressive Visual Focusing14 Aug 2026
- 2026NTDH: Complex Reasoning for Comprehensive Affective Analysis5 Aug 2026
- 2026Can LLMs Think Like Consumers? Benchmarking Crowd-Level Reaction Reconstruction with ConsumerSimBench16 May 2026
- 2026The Storyteller in the Model: Narrative Pattern Inheritance, Escalation Dynamics, and Alignment Governance in LLMs13 May 2026
- 2026UKP_Psycontrol at SemEval-2026 Task 2: Modeling Valence and Arousal Dynamics from Text23 Apr 2026
- 2026Mechanistic Decoding of Cognitive Constructs in Large Language Models16 Apr 2026
- 2026EmoScene: A Dual-space Dataset for Controllable Affective Image Generation1 Apr 2026
- 2026Do Vision Language Models Understand Human Engagement in Games?19 Mar 2026
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialogue6 Mar 2026
- 2025Learning to Hear by Seeing: It's Time for Vision Language Models to Understand Artistic Emotion from Sight and Sound15 Nov 2025
12 more
- 2025Decoding Emotion in the Deep: A Systematic Study of How LLMs Represent, Retain, and Express Emotion5 Oct 2025
- 2025Fuzzy Reasoning Chain (FRC): An Innovative Reasoning Framework from Fuzziness to Clarity26 Sep 2025
- 2025Large Language Models for Subjective Language Understanding: A Survey11 Aug 2025
- 2025DinoCompanion: An Attachment-Theory Informed Multimodal Robot for Emotionally Responsive Child-AI Interaction14 Jun 2025
- 2025AI shares emotion with humans across languages and cultures11 Jun 2025
- 2025When LLMs Team Up: The Emergence of Collaborative Affective Computing2 Jun 2025
- 2025Evaluating Human-LLM Representation Alignment: A Case Study on Affective Sentence Generation for Augmentative and Alternative Communication14 Mar 2025
- 2025Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Model6 Mar 2025
- 2025Can Large Language Models Capture Video Game Engagement?5 Feb 2025
- 2024MEMO-Bench: A Multiple Benchmark for Text-to-Image and Multimodal Large Language Models on Human Emotion Analysis18 Nov 2024
- 2024Minstrel: Structural Prompt Generation with Multi-Agents Coordination for Non-AI Experts20 Sep 2024
- 2024Recent Advances in Multimodal Affective Computing: An NLP Perspective11 Sep 2024
- 2024MEMO-Bench: A Multiple Benchmark for Text-to-Image and Multimodal Large Language Models on Human Emotion Analysiscited by 10
- 2025Learning to Hear by Seeing: It's Time for Vision Language Models to Understand Artistic Emotion from Sight and Soundcited by 1
- 2026Do Vision Language Models Understand Human Engagement in Games?cited by 1
- 2026Do Vision Language Models Understand Human Engagement in Games?19 Mar 2026
- 2025Learning to Hear by Seeing: It's Time for Vision Language Models to Understand Artistic Emotion from Sight and Sound15 Nov 2025
- 2024MEMO-Bench: A Multiple Benchmark for Text-to-Image and Multimodal Large Language Models on Human Emotion Analysis18 Nov 2024
- 2024Recent Advances in Multimodal Affective Computing: An NLP Perspectivecited by 12
- 2025Decoding Emotion in the Deep: A Systematic Study of How LLMs Represent, Retain, and Express Emotioncited by 10
- 2025Large Language Models for Subjective Language Understanding: A Surveycited by 9
- 2025AI shares emotion with humans across languages and culturescited by 5
- 2025Can Large Language Models Capture Video Game Engagement?cited by 2
- 2025When LLMs Team Up: The Emergence of Collaborative Affective Computingcited by 2
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialoguecited by 2
- 2025Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Modelcited by 1
- 2025Evaluating Human-LLM Representation Alignment: A Case Study on Affective Sentence Generation for Augmentative and Alternative Communicationcited by 1
- 2025DinoCompanion: An Attachment-Theory Informed Multimodal Robot for Emotionally Responsive Child-AI Interactioncited by 1
- 2026Mechanistic Decoding of Cognitive Constructs in Large Language Modelscited by 0
- 2026UKP_Psycontrol at SemEval-2026 Task 2: Modeling Valence and Arousal Dynamics from Textcited by 0
12 most cited of 17 All 17 (JSON)
- 2026Spook the Machine: Gamified Exploration of Human Imagination of Machine Fear14 Sep 2026
- 2026Controllable Affective Generation via Latent Vector Steering26 Aug 2026
- 2026ProFocus: Interpreting Affective Experience in Artistic Images with Progressive Visual Focusing14 Aug 2026
- 2026NTDH: Complex Reasoning for Comprehensive Affective Analysis5 Aug 2026
- 2026The Storyteller in the Model: Narrative Pattern Inheritance, Escalation Dynamics, and Alignment Governance in LLMs13 May 2026
- 2026UKP_Psycontrol at SemEval-2026 Task 2: Modeling Valence and Arousal Dynamics from Text23 Apr 2026
- 2026Mechanistic Decoding of Cognitive Constructs in Large Language Models16 Apr 2026
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialogue6 Mar 2026
- 2025Decoding Emotion in the Deep: A Systematic Study of How LLMs Represent, Retain, and Express Emotion5 Oct 2025
- 2025Large Language Models for Subjective Language Understanding: A Survey11 Aug 2025
- 2025DinoCompanion: An Attachment-Theory Informed Multimodal Robot for Emotionally Responsive Child-AI Interaction14 Jun 2025
- 2025AI shares emotion with humans across languages and cultures11 Jun 2025
12 newest of 17 All 17 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Multimodal Large Language Models for End-to-End Affective Computing: Benchmarking and Boosting with Generative Knowledge Prompting
- 2025From Rational Answers to Emotional Resonance: The Role of Controllable Emotion Generation in Language Models
- 2024Generative Technology for Human Emotion Recognition: A Scope Review
- 2025Large language models show fragile cognitive reasoning about human emotions
- 2025Affective-CARA: A Knowledge Graph Driven Framework for Culturally Adaptive Emotional Intelligence in HCI
- 2026Evaluating Prompt Engineering Strategies for Sentiment Control in AI-Generated Texts
- 2025Leveraging Large Language Models for Predictive Analysis of Human Misery
- 2025Teleology-Driven Affective Computing: A Causal Framework for Sustained Well-Being