mlsanityData to 7 Oct 2026

EII-SCL: Harnessing Emotional Inertia for Multimodal Emotion Recognition in Conversation

arXiv 2607.17366 ↗First posted 19 Jul 2026cs.MM cs.CL cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

Multimodal emotion recognition in conversation (MERC) achieves accurate predictions by integrating multimodal and contextual information in dialogues. While current MERC approaches focus on modeling complex contextual dependencies in conversation, they often overlook the impact of contextual emotional inertia in emotion shift, leading to sub-optimal performance. To address this issue, we propose a novel Emotional Inertia-Informed Supervised Contrastive Learning module (EII-SCL) that informs the contrastive objective by constructing inertia-affected samples within temporal windows, effectively leveraging emotional inertia as a prior while enabling seamless integration with existing MERC models without requiring additional data. Extensive experiments on IEMOCAP and MELD show that our approach consistently outperforms state-of-the-art methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 19 Jul 2026.

Builds on

16 of 29 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  4. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  5. 2019DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversationcited by 184
  6. 2019Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advancescited by 118
  7. 2021MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversationcited by 99
  8. 2022MM-DFN: Multimodal Dynamic Fusion Network for Emotion Recognition in Conversationscited by 52
  9. 2022M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversationcited by 47
  10. 2023A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in Conversationscited by 37
  11. 2021Hybrid Curriculum Learning for Emotion Recognition in Conversationcited by 25
  12. 2022COLD Fusion: Calibrated and Ordinal Latent Distribution Fusion for Uncertainty-Aware Multimodal Emotion Recognitioncited by 22
4 more
  1. 2023CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognitioncited by 14
  2. 2024Curriculum Learning Meets Directed Acyclic Graph for Multimodal Emotion Recognitioncited by 5
  3. 2022The Emotion is Not One-hot Encoding: Learning with Grayscale Label for Emotion Recognition in Conversationcited by 4
  4. 2026UNet-Based Fusion and Exponential Moving Average Adaptation for Noise-Robust Speaker Recognitioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.