mlsanityData to 7 Oct 2026

QA-MoE: Towards a Continuous Reliability Spectrum with Quality-Aware Mixture of Experts for Robust Multimodal Sentiment Analysis

arXiv 2604.05704 ↗First posted 7 Apr 2026cs.AIcited by 0

On the map: Mixture-of-experts → Multimodal MoE models

Abstract (arXiv)

Multimodal Sentiment Analysis (MSA) aims to infer human sentiment from textual, acoustic, and visual signals. In real-world scenarios, however, multimodal inputs are often compromised by dynamic noise or modality missingness. Existing methods typically treat these imperfections as discrete cases or assume fixed corruption ratios, which limits their adaptability to continuously varying reliability conditions. To address this, we first introduce a Continuous Reliability Spectrum to unify missingness and quality degradation into a single framework. Building on this, we propose QA-MoE, a Quality-Aware Mixture-of-Experts framework that quantifies modality reliability via self-supervised aleatoric uncertainty. This mechanism explicitly guides expert routing, enabling the model to suppress error propagation from unreliable signals while preserving task-relevant information. Extensive experiments indicate that QA-MoE achieves competitive or state-of-the-art performance across diverse degradation scenarios and exhibits a promising One-Checkpoint-for-All property in practice.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal MoE models, one of 12 directions in Mixture-of-experts. Builds on 16 of its 38 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

16 of 38 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  3. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
  4. 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 429
  5. 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 366
  6. 2018Efficient Low-rank Multimodal Fusion with Modality-Specific Factorscited by 268
  7. 2020MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysiscited by 262
  8. 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 243
  9. 2018Found in Translation: Learning Robust Joint Representations by Cyclic Translations Between Modalitiescited by 149
  10. 2023Meta-Transformer: A Unified Framework for Multimodal Learningcited by 136
  11. 2021Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysiscited by 130
  12. 2022GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversationcited by 86
4 more
  1. 2022Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representationscited by 48
  2. 2022MIntRec: A New Dataset for Multimodal Intent Recognitioncited by 41
  3. 2024Towards Robust Multimodal Sentiment Analysis with Incomplete Datacited by 26
  4. 2025Hierarchical MoE: Continuous Multimodal Emotion Recognition with Incomplete and Asynchronous Inputscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026QASA: Quality-Aware Semantic Augmentation for Robust Multimodal Sentiment Analysis
  2. 2026Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy Correction
  3. 2026C2MOE: Consistency and Complementarity-guided Mixture of Experts for Incomplete Multimodal Emotion Learning
  4. 2025BTW: A Non-Parametric Variance Stabilization Framework for Multimodal Model Integration
  5. 2025Towards Explainable Fusion and Balanced Learning in Multimodal Sentiment Analysis
  6. 2025Uncertainty-Aware Collaborative System of Large and Small Models for Multimodal Sentiment Analysis
  7. 2026Multimodal Adaptive Expert Selection with Text Routing and Ordinal Prototype Optimization for Sentiment Analysis
  8. 2026AlignMamba-2: Enhancing Multimodal Fusion and Sentiment Analysis with Modality-Aware Mamba