EII-SCL: Harnessing Emotional Inertia for Multimodal Emotion Recognition in Conversation
Not on the map. Why?
Abstract (arXiv)
Multimodal emotion recognition in conversation (MERC) achieves accurate predictions by integrating multimodal and contextual information in dialogues. While current MERC approaches focus on modeling complex contextual dependencies in conversation, they often overlook the impact of contextual emotional inertia in emotion shift, leading to sub-optimal performance. To address this issue, we propose a novel Emotional Inertia-Informed Supervised Contrastive Learning module (EII-SCL) that informs the contrastive objective by constructing inertia-affected samples within temporal windows, effectively leveraging emotional inertia as a prior while enabling seamless integration with existing MERC models without requiring additional data. Extensive experiments on IEMOCAP and MELD show that our approach consistently outperforms state-of-the-art methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 19 Jul 2026.
Builds on
16 of 29 references.
References · 16
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
- 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 184
- 2019Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advancescited by 118
- 2021MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversationcited by 99
- 2022MM-DFN: Multimodal Dynamic Fusion Network for Emotion Recognition in Conversationscited by 52
- 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
- 2023A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in Conversationscited by 37
- 2021Hybrid Curriculum Learning for Emotion Recognition in Conversationcited by 25
- 2022COLD Fusion: Calibrated and Ordinal Latent Distribution Fusion for Uncertainty-Aware Multimodal Emotion Recognitioncited by 22
4 more
- 2023CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognitioncited by 14
- 2024Curriculum Learning Meets Directed Acyclic Graph for Multimodal Emotion Recognitioncited by 5
- 2022The Emotion is Not One-hot Encoding: Learning with Grayscale Label for Emotion Recognition in Conversationcited by 4
- 2026UNet-Based Fusion and Exponential Moving Average Adaptation for Noise-Robust Speaker Recognitioncited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.