Refashioning Emotion Recognition Modelling: The Advent of Generalised Large Models
Not on the map. Why?
Abstract (arXiv)
After the inception of emotion recognition or affective computing, it has increasingly become an active research topic due to its broad applications. Over the past couple of decades, emotion recognition models have gradually migrated from statistically shallow models to neural network-based deep models, which can significantly boost the performance of emotion recognition models and consistently achieve the best results on different benchmarks. Therefore, in recent years, deep models have always been considered the first option for emotion recognition. However, the debut of large language models (LLMs), such as ChatGPT, has remarkably astonished the world due to their emerged capabilities of zero/few-shot learning, in-context learning, chain-of-thought, and others that are never shown in previous deep models. In the present paper, we comprehensively investigate how the LLMs perform in emotion recognition in terms of diverse aspects, including in-context learning, few-short learning, accuracy, generalisation, and explanation. Moreover, we offer some insights and pose other potential challenges, hoping to ignite broader discussions about enhancing emotion recognition in the new era of advanced and generalised large models.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 45 of its 83 references that are in the map. First posted on arXiv 21 Aug 2023.
Builds on
45 of 83 references.
References · 45
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023A Survey of Large Language Modelscited by 2,576
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
33 more
- 2021Scaling Vision Transformerscited by 999
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 815
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
- 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 265
- 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 231
- 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 218
- 2023ChatGPT: Jack of all trades, master of nonecited by 204
- 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 186
- 2020Self-supervised ECG Representation Learning for Emotion Recognitioncited by 99
- 2018EmotionLines: An Emotion Corpus of Multi-Party Conversationscited by 80
- 2020Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networkscited by 77
- 2019SEWA DB: A Rich Database for Audio-Visual Emotion and Sentiment Research in the Wildcited by 62
- 2022A Systematic Review on Affective Computing: Emotion Models, Databases, and Recent Advancescited by 59
- 2020Pre-Training Transformers as Energy-Based Cloze Modelscited by 52
- 2022M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Databasecited by 50
- 2020A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysiscited by 46
- 2019Exploiting multi-CNN features in CNN-RNN based Dimensional Emotion Recognition on the OMG in-the-wild Datasetcited by 39
- 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
- 2022COGMEN: COntextualized GNN based Multimodal Emotion recognitioNcited by 29
- 2019Utilizing Deep Learning Towards Multi-modal Bio-sensing and Vision-based Affective Computingcited by 22
- 2022Transformer-Based Self-Supervised Learning for Emotion Recognitioncited by 16
- 2018Multi-task dialog act and sentiment recognition on Mastodoncited by 15
- 2022You Are What You Write: Preserving Privacy in the Era of Large Language Modelscited by 12
- 2022Multitask Learning from Augmented Auxiliary Data for Improving Speech Emotion Recognitioncited by 11
- 2022DARER: Dual-task Temporal Relational Recurrent Reasoning Network for Joint Dialog Sentiment Classification and Act Recognitioncited by 9
- 2019EmoBed: Strengthening Monomodal Emotion Recognition via Training with Crossmodal Emotion Embeddingscited by 8
- 2018Seq2Seq2Sentiment: Multimodal Sequence to Sequence Models for Sentiment Analysiscited by 6
- 2022Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysiscited by 6
- 2020Exploiting Unsupervised Data for Emotion Recognition in Conversationscited by 5
- 2022Knowledge Transfer For On-Device Speech Emotion Recognition with Neural Structured Learningcited by 4
- 2021Back-Translated Task Adaptive Pretraining: Improving Accuracy and Robustness on Text Classificationcited by 3
- 2020Language Models as Emotional Classifiers for Textual Conversationscited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 7; 2025: 5; 2026: 2.
16 papers.
Sort:
By area:
- 2025EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Modelcited by 26
- 2024Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Surveycited by 16
- 2026Valence-Arousal Subspace in LLMs: Circular Emotion Geometry and Multi-Behavioral Controlcited by 16
- 2024From Text to Emotion: Unveiling the Emotion Annotation Capabilities of LLMscited by 13
- 2023Leveraging Speech PTM, Text LLM, and Emotional TTS for Speech Emotion Recognitioncited by 12
- 2024Recent Advancement of Emotion Cognition in Large Language Modelscited by 9
- 2025Large Language Models for Subjective Language Understanding: A Surveycited by 9
- 2023Customising General Large Language Models for Specialised Emotion Recognition Taskscited by 7
- 2024Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challengescited by 5
- 2024Revise, Reason, and Recognize: LLM-Based Emotion Recognition via Emotion-Specific Prompts and ASR Error Correctioncited by 5
- 2024Negation Blindness in Large Language Models: Unveiling the NO Syndrome in Image Generationcited by 4
- 2025Leveraging Large Language Models for Sarcastic Speech Annotation in Sarcasm Detectioncited by 4
4 more
- 2024Strategic Prompting for Conversational Tasks: A Comparative Analysis of Large Language Models Across Diverse Conversational Taskscited by 3
- 2025Large Language Models for Depression Recognition in Spoken Language Integrating Psychological Knowledgecited by 3
- 2025Emotional Cognitive Modeling Framework with Desire-Driven Objective Optimization for LLM-empowered Agent in Social Simulationcited by 0
- 2026Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoringcited by 0
- 2026Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring11 Sep 2026
- 2026Valence-Arousal Subspace in LLMs: Circular Emotion Geometry and Multi-Behavioral Control3 Apr 2026
- 2025Emotional Cognitive Modeling Framework with Desire-Driven Objective Optimization for LLM-empowered Agent in Social Simulation15 Oct 2025
- 2025Large Language Models for Subjective Language Understanding: A Survey11 Aug 2025
- 2025Leveraging Large Language Models for Sarcastic Speech Annotation in Sarcasm Detection1 Jun 2025
- 2025Large Language Models for Depression Recognition in Spoken Language Integrating Psychological Knowledge28 May 2025
- 2025EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Model10 Jan 2025
- 2024Strategic Prompting for Conversational Tasks: A Comparative Analysis of Large Language Models Across Diverse Conversational Tasks26 Nov 2024
- 2024Revise, Reason, and Recognize: LLM-Based Emotion Recognition via Emotion-Specific Prompts and ASR Error Correction23 Sep 2024
- 2024Recent Advancement of Emotion Cognition in Large Language Models20 Sep 2024
- 2024From Text to Emotion: Unveiling the Emotion Annotation Capabilities of LLMs30 Aug 2024
- 2024Negation Blindness in Large Language Models: Unveiling the NO Syndrome in Image Generation27 Aug 2024
4 more
- 2024Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey12 Jun 2024
- 2024Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challenges17 May 2024
- 2023Customising General Large Language Models for Specialised Emotion Recognition Tasks22 Oct 2023
- 2023Leveraging Speech PTM, Text LLM, and Emotional TTS for Speech Emotion Recognition19 Sep 2023
- 2025EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Modelcited by 26
- 2024Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Surveycited by 16
- 2026Valence-Arousal Subspace in LLMs: Circular Emotion Geometry and Multi-Behavioral Controlcited by 16
- 2024From Text to Emotion: Unveiling the Emotion Annotation Capabilities of LLMscited by 13
- 2023Leveraging Speech PTM, Text LLM, and Emotional TTS for Speech Emotion Recognitioncited by 12
- 2024Recent Advancement of Emotion Cognition in Large Language Modelscited by 9
- 2025Large Language Models for Subjective Language Understanding: A Surveycited by 9
- 2023Customising General Large Language Models for Specialised Emotion Recognition Taskscited by 7
- 2024Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challengescited by 5
- 2024Negation Blindness in Large Language Models: Unveiling the NO Syndrome in Image Generationcited by 4
- 2025Leveraging Large Language Models for Sarcastic Speech Annotation in Sarcasm Detectioncited by 4
- 2024Strategic Prompting for Conversational Tasks: A Comparative Analysis of Large Language Models Across Diverse Conversational Taskscited by 3
12 most cited of 14 All 14 (JSON)
- 2026Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring11 Sep 2026
- 2026Valence-Arousal Subspace in LLMs: Circular Emotion Geometry and Multi-Behavioral Control3 Apr 2026
- 2025Large Language Models for Subjective Language Understanding: A Survey11 Aug 2025
- 2025Leveraging Large Language Models for Sarcastic Speech Annotation in Sarcasm Detection1 Jun 2025
- 2025Large Language Models for Depression Recognition in Spoken Language Integrating Psychological Knowledge28 May 2025
- 2025EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Model10 Jan 2025
- 2024Strategic Prompting for Conversational Tasks: A Comparative Analysis of Large Language Models Across Diverse Conversational Tasks26 Nov 2024
- 2024Recent Advancement of Emotion Cognition in Large Language Models20 Sep 2024
- 2024From Text to Emotion: Unveiling the Emotion Annotation Capabilities of LLMs30 Aug 2024
- 2024Negation Blindness in Large Language Models: Unveiling the NO Syndrome in Image Generation27 Aug 2024
- 2024Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey12 Jun 2024
- 2024Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challenges17 May 2024
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Models
- 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Survey
- 2024Evaluating the Capabilities of Large Language Models for Multi-label Emotion Understanding
- 2025Evaluating Vision-Language Models for Emotion Recognition
- 2025MMAFFBen: A Multilingual and Multimodal Affective Analysis Benchmark for Evaluating LLMs and VLMs
- 2024Contextual Emotion Recognition using Large Vision Language Models
- 2025EmoPrefer: Can Large Language Models Understand Human Emotion Preferences?
- 2025Pioneering Multimodal Emotion Recognition in the Era of Large Models: From Closed Sets to Open Vocabularies