mlsanityData to 14 Oct 2026

Refashioning Emotion Recognition Modelling: The Advent of Generalised Large Models

arXiv 2308.11578 ↗First posted 21 Aug 2023cs.CL cs.AI cs.LGcited by 16

Not on the map. Why?

Abstract (arXiv)

After the inception of emotion recognition or affective computing, it has increasingly become an active research topic due to its broad applications. Over the past couple of decades, emotion recognition models have gradually migrated from statistically shallow models to neural network-based deep models, which can significantly boost the performance of emotion recognition models and consistently achieve the best results on different benchmarks. Therefore, in recent years, deep models have always been considered the first option for emotion recognition. However, the debut of large language models (LLMs), such as ChatGPT, has remarkably astonished the world due to their emerged capabilities of zero/few-shot learning, in-context learning, chain-of-thought, and others that are never shown in previous deep models. In the present paper, we comprehensively investigate how the LLMs perform in emotion recognition in terms of diverse aspects, including in-context learning, few-short learning, accuracy, generalisation, and explanation. Moreover, we offer some insights and pose other potential challenges, hoping to ignite broader discussions about enhancing emotion recognition in the new era of advanced and generalised large models.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 45 of its 83 references that are in the map. First posted on arXiv 21 Aug 2023.

Builds on

45 of 83 references.

References · 45

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  7. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  8. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  9. 2023A Survey of Large Language Modelscited by 2,576
  10. 2022Emergent Abilities of Large Language Modelscited by 2,512
  11. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  12. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
33 more
  1. 2021Scaling Vision Transformerscited by 999
  2. 2023A Survey on Multimodal Large Language Modelscited by 909
  3. 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 815
  4. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
  5. 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 265
  6. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 231
  7. 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 218
  8. 2023ChatGPT: Jack of all trades, master of nonecited by 204
  9. 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 186
  10. 2020Self-supervised ECG Representation Learning for Emotion Recognitioncited by 99
  11. 2018EmotionLines: An Emotion Corpus of Multi-Party Conversationscited by 80
  12. 2020Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networkscited by 77
  13. 2019SEWA DB: A Rich Database for Audio-Visual Emotion and Sentiment Research in the Wildcited by 62
  14. 2022A Systematic Review on Affective Computing: Emotion Models, Databases, and Recent Advancescited by 59
  15. 2020Pre-Training Transformers as Energy-Based Cloze Modelscited by 52
  16. 2022M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Databasecited by 50
  17. 2020A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysiscited by 46
  18. 2019Exploiting multi-CNN features in CNN-RNN based Dimensional Emotion Recognition on the OMG in-the-wild Datasetcited by 39
  19. 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
  20. 2022COGMEN: COntextualized GNN based Multimodal Emotion recognitioNcited by 29
  21. 2019Utilizing Deep Learning Towards Multi-modal Bio-sensing and Vision-based Affective Computingcited by 22
  22. 2022Transformer-Based Self-Supervised Learning for Emotion Recognitioncited by 16
  23. 2018Multi-task dialog act and sentiment recognition on Mastodoncited by 15
  24. 2022You Are What You Write: Preserving Privacy in the Era of Large Language Modelscited by 12
  25. 2022Multitask Learning from Augmented Auxiliary Data for Improving Speech Emotion Recognitioncited by 11
  26. 2022DARER: Dual-task Temporal Relational Recurrent Reasoning Network for Joint Dialog Sentiment Classification and Act Recognitioncited by 9
  27. 2019EmoBed: Strengthening Monomodal Emotion Recognition via Training with Crossmodal Emotion Embeddingscited by 8
  28. 2018Seq2Seq2Sentiment: Multimodal Sequence to Sequence Models for Sentiment Analysiscited by 6
  29. 2022Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysiscited by 6
  30. 2020Exploiting Unsupervised Data for Emotion Recognition in Conversationscited by 5
  31. 2022Knowledge Transfer For On-Device Speech Emotion Recognition with Neural Structured Learningcited by 4
  32. 2021Back-Translated Task Adaptive Pretraining: Improving Accuracy and Robustness on Text Classificationcited by 3
  33. 2020Language Models as Emotional Classifiers for Textual Conversationscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 7; 2025: 5; 2026: 2.

16 papers.

Sort:

By area:

  1. 2025EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Modelcited by 26
  2. 2024Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Surveycited by 16
  3. 2026Valence-Arousal Subspace in LLMs: Circular Emotion Geometry and Multi-Behavioral Controlcited by 16
  4. 2024From Text to Emotion: Unveiling the Emotion Annotation Capabilities of LLMscited by 13
  5. 2023Leveraging Speech PTM, Text LLM, and Emotional TTS for Speech Emotion Recognitioncited by 12
  6. 2024Recent Advancement of Emotion Cognition in Large Language Modelscited by 9
  7. 2025Large Language Models for Subjective Language Understanding: A Surveycited by 9
  8. 2023Customising General Large Language Models for Specialised Emotion Recognition Taskscited by 7
  9. 2024Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challengescited by 5
  10. 2024Revise, Reason, and Recognize: LLM-Based Emotion Recognition via Emotion-Specific Prompts and ASR Error Correctioncited by 5
  11. 2024Negation Blindness in Large Language Models: Unveiling the NO Syndrome in Image Generationcited by 4
  12. 2025Leveraging Large Language Models for Sarcastic Speech Annotation in Sarcasm Detectioncited by 4
4 more
  1. 2024Strategic Prompting for Conversational Tasks: A Comparative Analysis of Large Language Models Across Diverse Conversational Taskscited by 3
  2. 2025Large Language Models for Depression Recognition in Spoken Language Integrating Psychological Knowledgecited by 3
  3. 2025Emotional Cognitive Modeling Framework with Desire-Driven Objective Optimization for LLM-empowered Agent in Social Simulationcited by 0
  4. 2026Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoringcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Models
  2. 2025Multimodal Large Language Models Meet Multimodal Emotion Recognition and Reasoning: A Survey
  3. 2024Evaluating the Capabilities of Large Language Models for Multi-label Emotion Understanding
  4. 2025Evaluating Vision-Language Models for Emotion Recognition
  5. 2025MMAFFBen: A Multilingual and Multimodal Affective Analysis Benchmark for Evaluating LLMs and VLMs
  6. 2024Contextual Emotion Recognition using Large Vision Language Models
  7. 2025EmoPrefer: Can Large Language Models Understand Human Emotion Preferences?
  8. 2025Pioneering Multimodal Emotion Recognition in the Era of Large Models: From Closed Sets to Open Vocabularies