Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy Correction
Not on the map. Why?
Abstract (arXiv)
Multimodal sentiment analysis aims to infer affective states by integrating language, visual, and acoustic cues. However, real-world multimodal inputs are often incomplete or corrupted, which can weaken cross-modal complementarity and introduce misleading information into downstream fusion. Existing proxy-based methods for incomplete MSA commonly rely on one-shot proxy construction to compensate for degraded language information, but the generated proxy may be coarse or unreliable at initialization. Prematurely injecting such a proxy into multimodal reasoning can propagate initial errors and compromise sentiment prediction. To address this limitation, we propose an iterative proxy correction framework for robust incomplete MSA. Our method constructs a language-oriented proxy from non-language modalities and progressively refines it under multimodal context through gated residual correction. The corrected proxy is then adaptively fused with the observed language representation according to an estimated language reliability score, allowing the model to balance proxy-based compensation and trustworthy linguistic evidence. In addition, we introduce a stage-wise latent correction objective that uses the complete language representation as a training-time semantic anchor to stabilize the proxy refinement trajectory. Extensive experiments on MOSI, MOSEI, and SIMS under diverse missing-modality settings demonstrate that the proposed framework consistently outperforms competitive baselines and achieves robust sentiment prediction under incomplete inputs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 23 references that are in the map. First posted on arXiv 20 Aug 2026.
Builds on
9 of 23 references.
References · 9
- 2020MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysiscited by 262
- 2021Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysiscited by 179
- 2021Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysiscited by 130
- 2017VIGAN: Missing View Imputation with Generative Adversarial Networkscited by 33
- 2023Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysiscited by 27
- 2024Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognitioncited by 26
- 2024Towards Robust Multimodal Sentiment Analysis with Incomplete Datacited by 26
- 20263D Smoke Scene Reconstruction Guided by Vision Priors from Multimodal Large Language Modelscited by 7
- 2025TACTIC: Translation Agents with Cognitive-Theoretic Interactive Collaborationcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026QA-MoE: Towards a Continuous Reliability Spectrum with Quality-Aware Mixture of Experts for Robust Multimodal Sentiment Analysis
- 2026Semantic-Aligned Structural Abstraction for Multimodal Sentiment Analysis
- 2024Multimodal Sentiment Analysis Based on Causal Reasoning
- 2026Explicit Representation Alignment for Multimodal Sentiment Analysis
- 2026MVFA: A Multi-View Text-Guided Multimodal Fusion LLM Adapter for Sentiment Analysis and Emotion Recognition
- 2026QASA: Quality-Aware Semantic Augmentation for Robust Multimodal Sentiment Analysis
- 2024WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledge
- 2026AlignMamba-2: Enhancing Multimodal Fusion and Sentiment Analysis with Modality-Aware Mamba