mlsanityData to 7 Oct 2026

BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation

arXiv 2301.06745 ↗First posted 17 Jan 2023cs.CL cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

Previous works on emotion recognition in conversation (ERC) follow a two-step paradigm, which can be summarized as first producing context-independent features via fine-tuning pretrained language models (PLMs) and then analyzing contextual information and dialogue structure information among the extracted features. However, we discover that this paradigm has several limitations. Accordingly, we propose a novel paradigm, i.e., exploring contextual information and dialogue structure information in the fine-tuning step, and adapting the PLM to the ERC task in terms of input text, classification structure, and training strategy. Furthermore, we develop our model BERT-ERC according to the proposed paradigm, which improves ERC performance in three aspects, namely suggestive text, fine-grained classification module, and two-stage training. Compared to existing methods, BERT-ERC achieves substantial improvement on four datasets, indicating its effectiveness and generalization capability. Besides, we also set up the limited resources scenario and the online prediction scenario to approximate real-world scenarios. Extensive experiments demonstrate that the proposed paradigm significantly outperforms the previous one and can be adapted to various scenes.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 31 of its 38 references that are in the map. First posted on arXiv 17 Jan 2023.

Builds on

31 of 38 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  8. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  9. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  10. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  11. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  12. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
19 more
  1. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  2. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  3. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  4. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 303
  5. 2018The Natural Language Decathlon: Multitask Learning as Question Answeringcited by 235
  6. 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 216
  7. 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 184
  8. 2020COSMIC: COmmonSense knowledge for eMotion Identification in Conversationscited by 135
  9. 2019Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advancescited by 118
  10. 2015Ask Me Anything: Dynamic Memory Networks for Natural Language Processingcited by 116
  11. 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
  12. 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
  13. 2019Knowledge-Enriched Transformer for Emotion Detection in Textual Conversationscited by 92
  14. 2020DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognitioncited by 78
  15. 2021EmoBERTa: Speaker-Aware Emotion Recognition in Conversation with RoBERTacited by 59
  16. 2019HiGRU: Hierarchical Gated Recurrent Units for Utterance-level Emotion Recognitioncited by 43
  17. 2021CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversationcited by 35
  18. 2021Graph Based Network with Contextualized Representations of Turns in Dialoguecited by 26
  19. 2021Towards an Online Empathetic Chatbot with Emotion Causescited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 4; 2026: 2.

9 papers.