BiCFlow-MER: Orchestrating Discriminative and Generative Multimodal Emotion Recognition via Conditional Transport
Not on the map. Why?
Abstract (arXiv)
In multimodal emotion recognition (MER), human affective states are inferred by integrating complementary cues from multiple modalities. In audio-text MER, affective cues are often entangled with speaker style and lexical content, while cross-modal disagreement further complicates how the evidence should be integrated. Under conventional discriminative fusion, multimodal evidence is compressed into a terminal prediction, with modality-specific cues and conflict information insufficiently preserved. In large generative affective models, by contrast, affective reasoning is typically embedded in language decoding, leaving emotion evidence implicit and difficult to verify in a structured space. To address these limitations, BiCFlow-MER (Bidirectional Conditional Flow for Multimodal Emotion Recognition) is proposed as a conditional-flow framework in which audio-text MER is formulated as generative evidence transport within a structured emotion space. Within BiCFlow-MER, emotion-oriented evidence is disentangled from speaker-style and lexical-content factors to construct a conflict-aware affective condition. Guided by this condition, each utterance is transported to an explicit emotion-space endpoint through a bidirectional rectified flow. Candidate emotions are jointly verified through adaptive prototype-cloud scoring of the transported endpoint and backward class-to-condition consistency with the original multimodal condition, enabling conflict-aware recognition. BiCFlow-MER is shown to outperform all compared methods across IEMOCAP, MELD, and the zero-shot CASE benchmark. By orchestrating discriminative recognition and generative evidence modeling through conditional transport, BiCFlow-MER defines a new MER paradigm.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 28 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
16 of 28 references.
References · 16
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
- 2020CLUB: A Contrastive Log-ratio Upper Bound of Mutual Informationcited by 235
- 2021Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysiscited by 180
- 2024Enriching Multimodal Sentiment Analysis through Textual Emotional Descriptions of Visual-Audio Contentcited by 25
- 2024Enhancing Multimodal Emotion Recognition through Multi-Granularity Cross-Modal Alignmentcited by 5
- 2025Emotion-Coherent Reasoning for Multimodal LLMs via Emotional Rationale Verifiercited by 4
- 2026When Tone and Words Disagree: Towards Robust Speech Emotion Recognition under Acoustic-Semantic Conflictcited by 4
4 more
- 2026AmbER2: Dual Ambiguity-Aware Emotion Recognition Applied to Speech and Textcited by 4
- 2025Cross-modal Prompting for Balanced Incomplete Multi-modal Emotion Recognitioncited by 3
- 2025Do LLMs Feel? Teaching Emotion Recognition with Prompts, Retrieval, and Curriculum Learningcited by 2
- 2025FINE: Factorized multimodal sentiment analysis via mutual INformation Estimationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026To Fuse or to Drop? Dual-Path Learning for Resolving Modality Conflicts in Multimodal Emotion Recognition
- 2026Follow the Clues, Frame the Truth: Hybrid-evidential Deductive Reasoning in Open-Vocabulary Multimodal Emotion Recognition
- 2026MER 2026: From Discriminative Emotion Recognition to Generative Emotion Understanding
- 2025Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoning
- 2025AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Models
- 2026Decoupled Hierarchical Distillation for Multimodal Emotion Recognition
- 2026Decoding Affective Nuances: Enhancing MLLMs via Hierarchical Emotion Reasoning and Contrastive Discriminative Pruning
- 2026Navigating the Emotion Tree: Hierarchical Hyperbolic RAG for Multimodal Emotion Recognition