BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation
Not on the map. Why?
Abstract (arXiv)
Previous works on emotion recognition in conversation (ERC) follow a two-step paradigm, which can be summarized as first producing context-independent features via fine-tuning pretrained language models (PLMs) and then analyzing contextual information and dialogue structure information among the extracted features. However, we discover that this paradigm has several limitations. Accordingly, we propose a novel paradigm, i.e., exploring contextual information and dialogue structure information in the fine-tuning step, and adapting the PLM to the ERC task in terms of input text, classification structure, and training strategy. Furthermore, we develop our model BERT-ERC according to the proposed paradigm, which improves ERC performance in three aspects, namely suggestive text, fine-grained classification module, and two-stage training. Compared to existing methods, BERT-ERC achieves substantial improvement on four datasets, indicating its effectiveness and generalization capability. Besides, we also set up the limited resources scenario and the online prediction scenario to approximate real-world scenarios. Extensive experiments demonstrate that the proposed paradigm significantly outperforms the previous one and can be adapted to various scenes.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 31 of its 38 references that are in the map. First posted on arXiv 17 Jan 2023.
Builds on
31 of 38 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
19 more
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 303
- 2018The Natural Language Decathlon: Multitask Learning as Question Answeringcited by 235
- 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 216
- 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 184
- 2020COSMIC: COmmonSense knowledge for eMotion Identification in Conversationscited by 135
- 2019Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advancescited by 118
- 2015Ask Me Anything: Dynamic Memory Networks for Natural Language Processingcited by 116
- 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
- 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
- 2019Knowledge-Enriched Transformer for Emotion Detection in Textual Conversationscited by 92
- 2020DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognitioncited by 78
- 2021EmoBERTa: Speaker-Aware Emotion Recognition in Conversation with RoBERTacited by 59
- 2019HiGRU: Hierarchical Gated Recurrent Units for Utterance-level Emotion Recognitioncited by 43
- 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
- 2021Graph Based Network with Contextualized Representations of Turns in Dialoguecited by 26
- 2021Towards an Online Empathetic Chatbot with Emotion Causescited by 16
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 4; 2026: 2.
9 papers.
- 2024LARA: Linguistic-Adaptive Retrieval-Augmentation for Multi-Turn Intent Classificationcited by 10
- 2024Emotion-Aware Embedding Fusion in LLMs (Flan-T5, LLAMA 2, DeepSeek-R1, and ChatGPT 4) for Intelligent Response Generationcited by 2
- 2025Long-Short Distance Graph Neural Networks and Improved Curriculum Learning for Emotion Recognition in Conversationcited by 2
- 2026What You Feel Is Not What They See: On Predicting Self-Reported Emotion from Third-Party Observer Labelscited by 2
- 2023REDAffectiveLM: Leveraging Affect Enriched Embedding and Transformer-based Neural Language Model for Readers' Emotion Detectioncited by 0
- 2025Continuous Adversarial Text Representation Learning for Affective Recognitioncited by 0
- 2025DRKF: Decoupled Representations with Knowledge Fusion for Multimodal Emotion Recognitioncited by 0
- 2025A Cloud-Based Cross-Modal Transformer for Emotion Recognition and Adaptive Human-Computer Interactioncited by 0
- 2026SELF-EMO: Emotional Self-Evolution from Recognition to Consistent Expressioncited by 0
- 2026SELF-EMO: Emotional Self-Evolution from Recognition to Consistent Expression20 Apr 2026
- 2026What You Feel Is Not What They See: On Predicting Self-Reported Emotion from Third-Party Observer Labels29 Jan 2026
- 2025A Cloud-Based Cross-Modal Transformer for Emotion Recognition and Adaptive Human-Computer Interaction21 Nov 2025
- 2025DRKF: Decoupled Representations with Knowledge Fusion for Multimodal Emotion Recognition3 Aug 2025
- 2025Long-Short Distance Graph Neural Networks and Improved Curriculum Learning for Emotion Recognition in Conversation21 Jul 2025
- 2025Continuous Adversarial Text Representation Learning for Affective Recognition28 Feb 2025
- 2024Emotion-Aware Embedding Fusion in LLMs (Flan-T5, LLAMA 2, DeepSeek-R1, and ChatGPT 4) for Intelligent Response Generation2 Oct 2024
- 2024LARA: Linguistic-Adaptive Retrieval-Augmentation for Multi-Turn Intent Classification25 Mar 2024
- 2023REDAffectiveLM: Leveraging Affect Enriched Embedding and Transformer-based Neural Language Model for Readers' Emotion Detection21 Jan 2023