More Is Better: A MoE-Based Emotion Recognition Framework with Human Preference Alignment
On the map: LLM alignment / RLHF / preference optimisation → Medical LLM alignment
also in 1 more
Abstract (arXiv)
In this paper, we present our solution for the semi-supervised learning track (MER-SEMI) in MER2025. We propose a comprehensive framework, grounded in the principle that "more is better," to construct a robust Mixture of Experts (MoE) emotion recognition system. Our approach integrates a diverse range of input modalities as independent experts, including novel signals such as knowledge from large Vision-Language Models (VLMs) and temporal Action Unit (AU) information. To effectively utilize unlabeled data, we introduce a consensus-based pseudo-labeling strategy, generating high-quality labels from the agreement between a baseline model and Gemini, which are then used in a two-stage training paradigm. Finally, we employ a multi-expert voting ensemble combined with a rule-based re-ranking process to correct prediction bias and better align the outputs with human preferences. Evaluated on the MER2025-SEMI challenge dataset, our method achieves an F1-score of 0.8772 on the test set, ranking 2nd in the track. Our code is available at https://github.com/zhuyjan/MER2025-MRAC25.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Medical LLM alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 14 of its 30 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
14 of 30 references.
References · 14
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2023Baichuan 2: Open Large-scale Language Modelscited by 670
- 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuningcited by 121
- 2025FG-CLIP: Fine-Grained Visual and Textual Alignmentcited by 81
- 2023MER 2023: Multi-label Learning, Modality Robustness, and Semi-Supervised Learningcited by 33
- 2024MER 2024: Semi-Supervised Learning, Noise Robustness, and Open-Vocabulary Multimodal Emotion Recognitioncited by 23
- 2024Multimodal Emotion Recognition with Vision-language Prompting and Modality Dropoutcited by 7
- 2024Leveraging Contrastive Learning and Self-Training for Multimodal Emotion Recognition with Limited Labeled Samplescited by 5
- 2024Improving Multimodal Emotion Recognition by Leveraging Acoustic Adaptation and Visual Alignmentcited by 3
- 2024Audio-Guided Fusion Techniques for Multimodal Emotion Analysiscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Massively Multimodal Foundation Models: A Framework for Capturing Interactions with Specialized Mixture-of-Expertscited by 4
- 2026VDE Bench: Evaluating The Capability of Image Editing Models to Modify Visual Documentscited by 2
- 2026SeaVIS: Sound-Enhanced Association for Online Audio-Visual Instance Segmentationcited by 1
- 2026Omni IIE Bench: Benchmarking the Practical Capabilities of Image Editing Modelscited by 0
- 2026Omni IIE Bench: Benchmarking the Practical Capabilities of Image Editing Models16 Mar 2026
- 2026SeaVIS: Sound-Enhanced Association for Online Audio-Visual Instance Segmentation2 Mar 2026
- 2026VDE Bench: Evaluating The Capability of Image Editing Models to Modify Visual Documents27 Jan 2026
- 2025Massively Multimodal Foundation Models: A Framework for Capturing Interactions with Specialized Mixture-of-Experts30 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025ExpressNet-MoE: A Hybrid Deep Neural Network for Emotion Recognition
- 2026Learning to Prefer Reliably: Error-Augmented Emotion Preference Optimization with Calibrated Fusion
- 2026C2MOE: Consistency and Complementarity-guided Mixture of Experts for Incomplete Multimodal Emotion Learning
- 2025Multimodal Mixture of Low-Rank Experts for Sentiment Analysis and Emotion Recognition
- 2026A Mixture-of-Experts Model for Multimodal Emotion Recognition in Conversations
- 2026"I'm Not Mad, Just Focused'': Understanding Human Emotions in Human-Robot Collaboration ↗
- 2025EmoPrefer: Can Large Language Models Understand Human Emotion Preferences?
- 2026Nuanced Emotion Recognition Based on a Segment-based MLLM Framework Leveraging Qwen3-Omni for AH Detection