mlsanityData to 14 Oct 2026

More Is Better: A MoE-Based Emotion Recognition Framework with Human Preference Alignment

arXiv 2508.06036 ↗First posted 8 Aug 2025cs.CVcited by 4

On the map: LLM alignment / RLHF / preference optimisation → Medical LLM alignment

also in 1 more
Abstract (arXiv)

In this paper, we present our solution for the semi-supervised learning track (MER-SEMI) in MER2025. We propose a comprehensive framework, grounded in the principle that "more is better," to construct a robust Mixture of Experts (MoE) emotion recognition system. Our approach integrates a diverse range of input modalities as independent experts, including novel signals such as knowledge from large Vision-Language Models (VLMs) and temporal Action Unit (AU) information. To effectively utilize unlabeled data, we introduce a consensus-based pseudo-labeling strategy, generating high-quality labels from the agreement between a baseline model and Gemini, which are then used in a two-stage training paradigm. Finally, we employ a multi-expert voting ensemble combined with a rule-based re-ranking process to correct prediction bias and better align the outputs with human preferences. Evaluated on the MER2025-SEMI challenge dataset, our method achieves an F1-score of 0.8772 on the test set, ranking 2nd in the track. Our code is available at https://github.com/zhuyjan/MER2025-MRAC25.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Medical LLM alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 14 of its 30 references that are in the map. First posted on arXiv 8 Aug 2025.

Builds on

14 of 30 references.

References · 14

  1. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  2. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  3. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  4. 2023Baichuan 2: Open Large-scale Language Modelscited by 670
  5. 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuningcited by 121
  6. 2025FG-CLIP: Fine-Grained Visual and Textual Alignmentcited by 81
  7. 2023MER 2023: Multi-label Learning, Modality Robustness, and Semi-Supervised Learningcited by 33
  8. 2024MER 2024: Semi-Supervised Learning, Noise Robustness, and Open-Vocabulary Multimodal Emotion Recognitioncited by 23
  9. 2024Multimodal Emotion Recognition with Vision-language Prompting and Modality Dropoutcited by 7
  10. 2024Leveraging Contrastive Learning and Self-Training for Multimodal Emotion Recognition with Limited Labeled Samplescited by 5
  11. 2024Improving Multimodal Emotion Recognition by Leveraging Acoustic Adaptation and Visual Alignmentcited by 3
  12. 2024Audio-Guided Fusion Techniques for Multimodal Emotion Analysiscited by 1
2 more
  1. 2024Early Joint Learning of Emotion Information Makes MultiModal Model Understand You Bettercited by 1
  2. 2025Four Eyes Are Better Than Two: Harnessing the Collaborative Potential of Large Models via Differentiated Thinking and Complementary Ensemblescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ExpressNet-MoE: A Hybrid Deep Neural Network for Emotion Recognition
  2. 2026Learning to Prefer Reliably: Error-Augmented Emotion Preference Optimization with Calibrated Fusion
  3. 2026C2MOE: Consistency and Complementarity-guided Mixture of Experts for Incomplete Multimodal Emotion Learning
  4. 2025Multimodal Mixture of Low-Rank Experts for Sentiment Analysis and Emotion Recognition
  5. 2026A Mixture-of-Experts Model for Multimodal Emotion Recognition in Conversations
  6. 2026"I'm Not Mad, Just Focused'': Understanding Human Emotions in Human-Robot Collaboration ↗
  7. 2025EmoPrefer: Can Large Language Models Understand Human Emotion Preferences?
  8. 2026Nuanced Emotion Recognition Based on a Segment-based MLLM Framework Leveraging Qwen3-Omni for AH Detection