mlsanityData to 14 Oct 2026

InstructERC: Reforming Emotion Recognition in Conversation with Multi-task Retrieval-Augmented Large Language Models

arXiv 2309.11911 ↗First posted 21 Sep 2023cs.CLcited by 11

On the map: Retrieval-augmented generation → Conversational and speech RAG

Abstract (arXiv)

The field of emotion recognition of conversation (ERC) has been focusing on separating sentence feature encoding and context modeling, lacking exploration in generative paradigms based on unified designs. In this study, we propose a novel approach, InstructERC, to reformulate the ERC task from a discriminative framework to a generative framework based on Large Language Models (LLMs). InstructERC makes three significant contributions: (1) it introduces a simple yet effective retrieval template module, which helps the model explicitly integrate multi-granularity dialogue supervision information. (2) We introduce two additional emotion alignment tasks, namely speaker identification and emotion prediction tasks, to implicitly model the dialogue role relationships and future emotional tendencies in conversations. (3) Pioneeringly, we unify emotion labels across benchmarks through the feeling wheel to fit real application scenarios. InstructERC still perform impressively on this unified dataset. Our LLM-based plugin framework significantly outperforms all previous models and achieves comprehensive SOTA on three commonly used ERC datasets. Extensive analysis of parameter-efficient and data-scaling experiments provides empirical guidance for applying it in practical scenarios.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Conversational and speech RAG, one of 15 directions in Retrieval-augmented generation. Builds on 23 of its 46 references that are in the map. First posted on arXiv 21 Sep 2023.

Builds on

23 of 46 references.

References · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  7. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  8. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  9. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
  10. 2022Unified Structure Generation for Universal Information Extractioncited by 221
  11. 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 218
  12. 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 186
11 more
  1. 2017Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networkscited by 102
  2. 2021Directed Acyclic Graph Network for Conversational Emotion Recognitioncited by 97
  3. 2023Making Language Models Better Tool Learners with Execution Feedbackcited by 70
  4. 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
  5. 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
  6. 2022GraphCFC: A Directed Graph Based Cross-Modal Feature Complementation Approach for Multimodal Conversational Emotion Recognitioncited by 20
  7. 2023Supervised Adversarial Contrastive Learning for Emotion Recognition in Conversationscited by 19
  8. 2020Multi-Task Learning with Auxiliary Speaker Identification for Conversational Emotion Recognitioncited by 12
  9. 2023EmotionIC: emotional inertia and contagion-driven dependency modeling for emotion recognition in conversationcited by 7
  10. 2023Hierarchical Dialogue Understanding with Special Tokens and Turn-level Attentioncited by 6
  11. 2023Mimicking the Thinking Process for Emotion Recognition in Conversation with Prompts and Paraphrasingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 7; 2026: 3.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Mixture-of-Experts Model for Multimodal Emotion Recognition in Conversations
  2. 2022Emotion Recognition in Conversation using Probabilistic Soft Logic
  3. 2026When to Call an LLM: A Confidence-Gated Hybrid for Cost-Effective Emotion Recognition in Conversational AI
  4. 2023A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in Conversations
  5. 2026Acoustic and Semantic Modeling of Emotion in Spoken Language ↗
  6. 2025Beyond Classification: Towards Speech Emotion Reasoning with Multitask AudioLLMs
  7. 2026EmoLASP: Emotion Recognition with Language Models and Answer Set Programming
  8. 2026VISAFF: Speaker-Centered Visual Affective Feature Learning for Emotion Recognition in Conversation