mlsanityData to 7 Oct 2026

Learning Robust Pair Confidence for Multimodal Emotion-Cause Pair Extraction

arXiv 2606.18893 ↗First posted 17 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Multimodal emotion-cause pair extraction (MECPE) requires reliable pair confidence over candidate pairs. Existing pair scorers commonly use pair-level cross entropy over valid candidates, which treats links mostly independently. This leaves the relative confidence geometry among competing causes under-constrained, allowing gold pairs to stay close to hard negatives or rely on incidental non-gold context. We study this vulnerability as pair-confidence brittleness and propose RPCL (Robust Pair Confidence Learning), a training-only framework for pair-confidence learning. RPCL encourages pair confidence to be both discriminative and stable: gold pairs are separated from row-wise hard negatives through a confidence-difference margin constraint, and clean pair predictions are aligned with predictions from a corrupted view where non-gold contextual utterance representations are partially corrupted. The original clean pair scorer and decoding pipeline are used unchanged at inference time. On ECF, MECAD, and MEC4, RPCL improves the three-seed mean Pair F1 over a matched base model by 2.58 to 2.83 percentage points in the full text-audio-video setting, and improves mean Pair AUPRC on all three datasets. Diagnostic analysis further shows larger gold-negative confidence gaps and lower margin-violation severity. These results suggest that explicitly shaping pair confidence is an effective training strategy for MECPE.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 32 references that are in the map. First posted on arXiv 17 Jun 2026.

Builds on

11 of 32 references.

References · 11

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  4. 2019Emotion-Cause Pair Extraction: A New Task to Emotion Analysis in Textscited by 82
  5. 2021Multimodal Emotion-Cause Pair Extraction in Conversationscited by 30
  6. 2024SemEval-2024 Task 3: Multimodal Emotion Cause Analysis in Conversationscited by 11
  7. 2024MIPS at SemEval-2024 Task 3: Multimodal Emotion-Cause Pair Extraction in Conversations with Multimodal Language Modelscited by 9
  8. 2024UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion Causecited by 8
  9. 2024NUS-Emo at SemEval-2024 Task 3: Instruction-Tuning LLM for Multimodal Emotion-Cause Analysis in Conversationscited by 5
  10. 2025SupCLAP: Controlling Optimization Trajectory Drift in Audio-Text Contrastive Learning with Support Vector Regularizationcited by 3
  11. 2025M3HG: Multimodal, Multi-scale, and Multi-type Node Heterogeneous Graph for Emotion Cause Triplet Extraction in Conversationscited by 2

Built on by

Not cited yet.