EmoBERTa: Speaker-Aware Emotion Recognition in Conversation with RoBERTa
Not on the map. Why?
Abstract (arXiv)
We present EmoBERTa: Speaker-Aware Emotion Recognition in Conversation with RoBERTa, a simple yet expressive scheme of solving the ERC (emotion recognition in conversation) task. By simply prepending speaker names to utterances and inserting separation tokens between the utterances in a dialogue, EmoBERTa can learn intra- and inter- speaker states and context to predict the emotion of a current speaker, in an end-to-end manner. Our experiments show that we reach a new state of the art on the two popular ERC datasets using a basic and straight-forward approach. We've open sourced our code and models at https://github.com/tae898/erc.
Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). Builds on 18 of its 31 references that are in the map. First posted on arXiv 26 Aug 2021.
Builds on
18 of 31 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,479
- 2017Mixed Precision Trainingcited by 1,135
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 184
6 more
- 2020COSMIC: COmmonSense knowledge for eMotion Identification in Conversationscited by 135
- 2019Knowledge-Enriched Transformer for Emotion Detection in Textual Conversationscited by 92
- 2020DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognitioncited by 78
- 2019Real-Time Emotion Recognition via Attention Gated Hierarchical Memory Networkcited by 38
- 2020BiERU: Bidirectional Emotional Recurrent Unit for Conversational Sentiment Analysiscited by 28
- 2020Multi-Task Learning with Auxiliary Speaker Identification for Conversational Emotion Recognitioncited by 12
Built on by
Citing papers per year: 2022: 8; 2023: 15; 2024: 15; 2025: 8; 2026: 13.
59 papers.
Sort:
By area:
- 2024EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesiscited by 79
- 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
- 2023Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversationscited by 47
- 2024Revisiting Multi-modal Emotion Learning with Broad State Space Models and Probability-guidance Fusioncited by 33
- 2024Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrumcited by 33
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
- 2022COGMEN: COntextualized GNN based Multimodal Emotion recognitioNcited by 29
- 2023FT2TF: First-Person Statement Text-To-Talking Face Generationcited by 26
- 2022CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AIcited by 25
- 2023DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognitioncited by 23
- 2024Efficient Long-distance Latent Relation-aware Graph Neural Network for Multi-modal Emotion Recognition in Conversationscited by 23
- 2022FADO: Feedback-Aware Double COntrolling Network for Emotional Support Conversationcited by 18
38 more
- 2023It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformerscited by 18
- 2023UniSA: Unified Generative Framework for Sentiment Analysiscited by 17
- 2023Cluster-Level Contrastive Learning for Emotion Recognition in Conversationscited by 14
- 2024TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversationcited by 12
- 2024SemEval-2024 Task 3: Multimodal Emotion Cause Analysis in Conversationscited by 11
- 2024BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Taskscited by 11
- 2022Bias and Fairness on Multimodal Emotion Detection Algorithmscited by 10
- 2023BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversationcited by 9
- 2022Interpretability for Multimodal Emotion Recognition using Concept Activation Vectorscited by 8
- 2022Learning Speech Emotion Representations in the Quaternion Domaincited by 7
- 2024Affective-NLI: Towards Accurate and Interpretable Personality Recognition in Conversationcited by 7
- 2023CAB: Empathetic Dialogue Generation with Cognition, Affection and Behaviorcited by 6
- 2025Akan Cinematic Emotions (ACE): A Multimodal Multi-party Dataset for Emotion Recognition in Movie Dialoguescited by 6
- 2025Evaluating Behavioral Alignment in Conflict Dialogue: A Multi-Dimensional Comparison of LLM Agents and Humanscited by 6
- 2023Efficient Cross-Task Prompt Tuning for Few-Shot Conversational Emotion Recognitioncited by 5
- 2025PC-Talk: Precise Facial Animation Control for Audio-Driven Talking Face Generationcited by 5
- 2025EDTalk++: Full Disentanglement for Controllable Talking Head Synthesiscited by 5
- 2023Mixed-Distil-BERT: Code-mixed Language Modeling for Bangla, English, and Hindicited by 4
- 2023From Chatter to Matter: Addressing Critical Steps of Emotion Recognition Learning in Task-oriented Dialoguecited by 3
- 2023Language Models (Mostly) Do Not Consider Emotion Triggers When Predicting Emotioncited by 3
- 2024Mamba-Enhanced Text-Audio-Video Alignment Network for Emotion Recognition in Conversationscited by 3
- 2024Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversationcited by 3
- 2026VowelPrompt: Hearing Speech Emotions from Text via Vowel-level Prosodic Augmentationcited by 3
- 2024Samsung Research China-Beijing at SemEval-2024 Task 3: A multi-stage framework for Emotion-Cause Pair Extraction in Conversationscited by 2
- 2024EmoMix-3L: A Code-Mixed Dataset for Bangla-English-Hindi Emotion Detectioncited by 2
- 2026Dual-branch Graph Domain Adaptation for Cross-scenario Multi-modal Emotion Recognitioncited by 2
- 2026SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversationscited by 2
- 2023SI-LSTM: Speaker Hybrid Long-short Term Memory and Cross Modal Attention for Emotion Recognition in Conversationcited by 1
- 2023LineConGraphs: Line Conversation Graphs for Effective Emotion Recognition using Graph Neural Networkscited by 1
- 2023SSLCL: An Efficient Model-Agnostic Supervised Contrastive Learning Framework for Emotion Recognition in Conversationscited by 0
- 2024MasonTigers at SemEval-2024 Task 10: Emotion Discovery and Flip Reasoning in Conversation with Ensemble of Transformers and Promptingcited by 0
- 2024ContextIQ: A Multimodal Expert-Based Video Retrieval System for Contextual Advertisingcited by 0
- 2024CMATH: Cross-Modality Augmented Transformer with Hierarchical Variational Distillation for Multimodal Emotion Recognition in Conversationcited by 0
- 2025TED: Turn Emphasis with Dialogue Feature Attention for Emotion Recognition in Conversationcited by 0
- 2025AIMA at SemEval-2024 Task 3: Simple Yet Powerful Emotion Cause Pair Analysiscited by 0
- 2025DyFuLM: An Advanced Multimodal Framework for Sentiment Analysiscited by 0
- 2025Emotion-Driven Personalized Recommendation for AI-Generated Content Using Multi-Modal Sentiment and Intent Analysiscited by 0
- 2026Expert-Guided Multimodal Fusion for Unified Emotion and Sentiment Analysiscited by 0
50 most cited of 59 All 59 (JSON)
- 2026When to Call an LLM: A Confidence-Gated Hybrid for Cost-Effective Emotion Recognition in Conversational AI16 Sep 2026
- 2026ER-EDF: A Psychology-Grounded Emotion Regulation Framework for Speech Empathetic Dialogue Generation in Large Audio-Language Models14 Sep 2026
- 2026Cross-Modal Emotion Understanding: A Transformer-GAT Approach for Dialogue Emotion Recognition2 Sep 2026
- 2026HUG-VIS: A Multimodal Benchmark for Human-centered Understanding and Generation in Visual Intelligence27 Aug 2026
- 2026AtmosERC: Modeling Dialogue-Level Affective Atmosphere for Emotion Recognition in Conversation29 Jul 2026
- 2026VISAFF: Speaker-Centered Visual Affective Feature Learning for Emotion Recognition in Conversation18 May 2026
- 2026SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations13 May 2026
- 2026Dual-branch Graph Domain Adaptation for Cross-scenario Multi-modal Emotion Recognition27 Mar 2026
- 2026Dynamic Fusion-Aware Graph Convolutional Neural Network for Multimodal Emotion Recognition in Conversations22 Mar 2026
- 2026CMHL: Contrastive Multi-Head Learning for Emotionally Consistent Text Classification14 Mar 2026
- 2026IDRL: An Individual-Aware Multimodal Depression-Related Representation Learning Framework for Depression Diagnosis12 Mar 2026
- 2026VowelPrompt: Hearing Speech Emotions from Text via Vowel-level Prosodic Augmentation6 Feb 2026
38 more
- 2026Expert-Guided Multimodal Fusion for Unified Emotion and Sentiment Analysis12 Jan 2026
- 2025DyFuLM: An Advanced Multimodal Framework for Sentiment Analysis1 Dec 2025
- 2025Emotion-Driven Personalized Recommendation for AI-Generated Content Using Multi-Modal Sentiment and Intent Analysis25 Nov 2025
- 2025Evaluating Behavioral Alignment in Conflict Dialogue: A Multi-Dimensional Comparison of LLM Agents and Humans19 Sep 2025
- 2025EDTalk++: Full Disentanglement for Controllable Talking Head Synthesis19 Aug 2025
- 2025PC-Talk: Precise Facial Animation Control for Audio-Driven Talking Face Generation18 Mar 2025
- 2025Akan Cinematic Emotions (ACE): A Multimodal Multi-party Dataset for Emotion Recognition in Movie Dialogues16 Feb 2025
- 2025AIMA at SemEval-2024 Task 3: Simple Yet Powerful Emotion Cause Pair Analysis19 Jan 2025
- 2025TED: Turn Emphasis with Dialogue Feature Attention for Emotion Recognition in Conversation2 Jan 2025
- 2024Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversation4 Dec 2024
- 2024CMATH: Cross-Modality Augmented Transformer with Hierarchical Variational Distillation for Multimodal Emotion Recognition in Conversation15 Nov 2024
- 2024ContextIQ: A Multimodal Expert-Based Video Retrieval System for Contextual Advertising29 Oct 2024
- 2024Mamba-Enhanced Text-Audio-Video Alignment Network for Emotion Recognition in Conversations8 Sep 2024
- 2024BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks5 Jul 2024
- 2024MasonTigers at SemEval-2024 Task 10: Emotion Discovery and Flip Reasoning in Conversation with Ensemble of Transformers and Prompting30 Jun 2024
- 2024Efficient Long-distance Latent Relation-aware Graph Neural Network for Multi-modal Emotion Recognition in Conversations27 Jun 2024
- 2024SemEval-2024 Task 3: Multimodal Emotion Cause Analysis in Conversations19 May 2024
- 2024EmoMix-3L: A Code-Mixed Dataset for Bangla-English-Hindi Emotion Detection11 May 2024
- 2024Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrum27 Apr 2024
- 2024Revisiting Multi-modal Emotion Learning with Broad State Space Models and Probability-guidance Fusion27 Apr 2024
- 2024Samsung Research China-Beijing at SemEval-2024 Task 3: A multi-stage framework for Emotion-Cause Pair Extraction in Conversations25 Apr 2024
- 2024Affective-NLI: Towards Accurate and Interpretable Personality Recognition in Conversation3 Apr 2024
- 2024EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesis2 Apr 2024
- 2024TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversation16 Jan 2024
- 2023DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognition17 Dec 2023
- 2023Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversations11 Dec 2023
- 2023FT2TF: First-Person Statement Text-To-Talking Face Generation9 Dec 2023
- 2023LineConGraphs: Line Conversation Graphs for Effective Emotion Recognition using Graph Neural Networks4 Dec 2023
- 2023Language Models (Mostly) Do Not Consider Emotion Triggers When Predicting Emotion16 Nov 2023
- 2023SSLCL: An Efficient Model-Agnostic Supervised Contrastive Learning Framework for Emotion Recognition in Conversations25 Oct 2023
- 2023Efficient Cross-Task Prompt Tuning for Few-Shot Conversational Emotion Recognition23 Oct 2023
- 2023Mixed-Distil-BERT: Code-mixed Language Modeling for Bangla, English, and Hindi19 Sep 2023
- 2023UniSA: Unified Generative Framework for Sentiment Analysis4 Sep 2023
- 2023From Chatter to Matter: Addressing Critical Steps of Emotion Recognition Learning in Task-oriented Dialogue24 Aug 2023
- 2023SI-LSTM: Speaker Hybrid Long-short Term Memory and Cross Modal Attention for Emotion Recognition in Conversation4 May 2023
- 2023Cluster-Level Contrastive Learning for Emotion Recognition in Conversations7 Feb 2023
- 2023CAB: Empathetic Dialogue Generation with Cognition, Affection and Behavior3 Feb 2023
- 2023BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation17 Jan 2023
50 newest of 59 All 59 (JSON)
- 2024EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesiscited by 79
- 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
- 2023Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversationscited by 47
- 2024Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrumcited by 33
- 2022Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversationcited by 31
- 2022COGMEN: COntextualized GNN based Multimodal Emotion recognitioNcited by 29
- 2023FT2TF: First-Person Statement Text-To-Talking Face Generationcited by 26
- 2022CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AIcited by 25
- 2023DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognitioncited by 23
- 2024Efficient Long-distance Latent Relation-aware Graph Neural Network for Multi-modal Emotion Recognition in Conversationscited by 23
- 2022FADO: Feedback-Aware Double COntrolling Network for Emotional Support Conversationcited by 18
- 2023It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformerscited by 18
12 most cited of 56 All 56 (JSON)
- 2026When to Call an LLM: A Confidence-Gated Hybrid for Cost-Effective Emotion Recognition in Conversational AI16 Sep 2026
- 2026ER-EDF: A Psychology-Grounded Emotion Regulation Framework for Speech Empathetic Dialogue Generation in Large Audio-Language Models14 Sep 2026
- 2026Cross-Modal Emotion Understanding: A Transformer-GAT Approach for Dialogue Emotion Recognition2 Sep 2026
- 2026HUG-VIS: A Multimodal Benchmark for Human-centered Understanding and Generation in Visual Intelligence27 Aug 2026
- 2026AtmosERC: Modeling Dialogue-Level Affective Atmosphere for Emotion Recognition in Conversation29 Jul 2026
- 2026VISAFF: Speaker-Centered Visual Affective Feature Learning for Emotion Recognition in Conversation18 May 2026
- 2026SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations13 May 2026
- 2026Dual-branch Graph Domain Adaptation for Cross-scenario Multi-modal Emotion Recognition27 Mar 2026
- 2026Dynamic Fusion-Aware Graph Convolutional Neural Network for Multimodal Emotion Recognition in Conversations22 Mar 2026
- 2026CMHL: Contrastive Multi-Head Learning for Emotionally Consistent Text Classification14 Mar 2026
- 2026IDRL: An Individual-Aware Multimodal Depression-Related Representation Learning Framework for Depression Diagnosis12 Mar 2026
- 2026VowelPrompt: Hearing Speech Emotions from Text via Vowel-level Prosodic Augmentation6 Feb 2026
12 newest of 56 All 56 (JSON)