MIDAS: Mutual Information Disentanglement with Uncertainty-Aware Fusion for Incomplete Multimodal Sentiment Analysis
Not on the map. Why?
Abstract (arXiv)
Most existing multimodal sentiment analysis approaches assume access to complete multimodal inputs. However, real-world applications frequently encounter incomplete or corrupted modalities, posing a critical challenge. Although several methods have been proposed to tackle this issue, they mainly rely on data imputation and heuristic coordination constraints, which fail to effectively extract and leverage task-relevant information from the incomplete multimodal data. To address this challenge, we propose a unified framework termed Mutual Information Disentanglement with uncertainty-Aware fuSion (MIDAS), which effectively restructures multimodal representations under incomplete conditions. MIDAS adopts a variational modeling strategy to represent each modality with multivariate Gaussian latent variables and further decomposes them into shared and exclusive factors. To obtain reliable representations, we design a minimax objective that minimizes the mutual information between shared and exclusive spaces for stable disentanglement, while maximizing the mutual information among shared spaces across modalities to enhance semantic alignment. In addition, an uncertainty-aware fusion mechanism is introduced, where posterior variance is leveraged as a reliability indicator to adaptively weight latent features during fusion, ensuring robust integration even when modalities are incomplete. Extensive experiments on three widely used datasets show that MIDAS achieves strong and consistent performance gains over competitive baselines across a wide range of incomplete settings, demonstrating its effectiveness and robustness for incomplete data scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 72 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
37 of 72 references.
References · 37
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2022Generative Adversarial Networkscited by 5,603
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2016Deep Variational Information Bottleneckcited by 915
- 2015Deep Learning and the Information Bottleneck Principlecited by 793
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
25 more
- 2018MINE: Mutual Information Neural Estimationcited by 680
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2019On Mutual Information Maximization for Representation Learningcited by 315
- 2020MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysiscited by 262
- 2020CLUB: A Contrastive Log-ratio Upper Bound of Mutual Informationcited by 233
- 2021Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysiscited by 179
- 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 167
- 2021Probabilistic Embeddings for Cross-Modal Retrievalcited by 150
- 2021Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysiscited by 130
- 2022Disentangled Representation Learningcited by 111
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 89
- 2022GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversationcited by 86
- 2022Uncertainty-aware Contrastive Distillation for Incremental Semantic Segmentationcited by 37
- 2024Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalitiescited by 32
- 2023Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysiscited by 27
- 2024Towards Robust Multimodal Sentiment Analysis with Incomplete Datacited by 26
- 2020Variational Interaction Information Maximization for Cross-domain Disentanglementcited by 23
- 2022COLD Fusion: Calibrated and Ordinal Latent Distribution Fusion for Uncertainty-Aware Multimodal Emotion Recognitioncited by 22
- 2022M-SENA: An Integrated Platform for Multimodal Sentiment Analysiscited by 21
- 2022Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysiscited by 20
- 2024Robust Multimodal Learning via Representation Decouplingcited by 17
- 2025Uncertainty-Aware Graph Neural Networks: A Multi-Hop Evidence Fusion Approachcited by 14
- 2023FedDCSR: Federated Cross-domain Sequential Recommendation via Disentangled Representation Learningcited by 6
- 2022Multimodal Representations Learning Based on Mutual Information Maximization and Minimization and Identity Embedding for Multimodal Sentiment Analysiscited by 2
- 2025DashFusion: Dual-stream Alignment with Hierarchical Bottleneck Fusion for Multimodal Sentiment Analysiscited by 1
Built on by
Not cited yet.