Tri-Subspaces Disentanglement for Multimodal Sentiment Analysis
Not on the map. Why?
Abstract (arXiv)
Multimodal Sentiment Analysis (MSA) integrates language, visual, and acoustic modalities to infer human sentiment. Most existing methods either focus on globally shared representations or modality-specific features, while overlooking signals that are shared only by certain modality pairs. This limits the expressiveness and discriminative power of multimodal representations. To address this limitation, we propose a Tri-Subspace Disentanglement (TSD) framework that explicitly factorizes features into three complementary subspaces: a common subspace capturing global consistency, submodally-shared subspaces modeling pairwise cross-modal synergies, and private subspaces preserving modality-specific cues. To keep these subspaces pure and independent, we introduce a decoupling supervisor together with structured regularization losses. We further design a Subspace-Aware Cross-Attention (SACA) fusion module that adaptively models and integrates information from the three subspaces to obtain richer and more robust representations. Experiments on CMU-MOSI and CMU-MOSEI demonstrate that TSD achieves state-of-the-art performance across all key metrics, reaching 0.691 MAE on CMU-MOSI and 54.9% ACC-7 on CMU-MOSEI, and also transfers well to multimodal intent recognition tasks. Ablation studies confirm that tri-subspace disentanglement and SACA jointly enhance the modeling of multi-granular cross-modal sentiment cues.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 19 of its 31 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
19 of 31 references.
References · 19
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
- 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 433
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 286
- 2018Efficient Low-rank Multimodal Fusion with Modality-Specific Factorscited by 270
- 2020MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysiscited by 265
- 2021Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysiscited by 180
- 2023Decoupled Multimodal Distilling for Emotion Recognitioncited by 76
- 2022MIntRec: A New Dataset for Multimodal Intent Recognitioncited by 41
- 2024Classifier-guided Gradient Modulation for Enhanced Multimodal Learningcited by 35
- 2023Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysiscited by 29
- 2024DLF: Disentangled-Language-Focused Multimodal Sentiment Analysiscited by 27
7 more
- 2024Enriching Multimodal Sentiment Analysis through Textual Emotional Descriptions of Visual-Audio Contentcited by 25
- 2023Fine-grained Disentangled Representation Learning for Multimodal Emotion Recognitioncited by 11
- 2024Semi-IIN: Semi-supervised Intra-inter modal Interaction Learning Network for Multimodal Sentiment Analysiscited by 5
- 2025Multimodal Transformers are Hierarchical Modal-wise Heterogeneous Graphscited by 5
- 2024CTA-Net: A CNN-Transformer Aggregation Network for Improving Multi-Scale Feature Extractioncited by 4
- 2024MInD: Improving Multimodal Sentiment Analysis via Multimodal Information Disentanglementcited by 3
- 2026Temporal-Spatial Decouple before Act: Disentangled Representation Learning for Multimodal Sentiment Analysiscited by 3
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Predictioncited by 3
- 2026Group Cognition Learning: Making Everything Better Through Governed Two-Stage Agents Collaborationcited by 3
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentationcited by 1
- 2026AuEmoChat: Authentic Emotion Understanding and Rendering for Conversational Speech Synthesiscited by 1
- 2026Hierarchical Contrastive Learning for Multimodal Datacited by 0
- 2026Adapting Vision Foundation Models with Cascaded Semanticscited by 0
- 2026Adapting Vision Foundation Models with Cascaded Semantics5 Aug 2026
- 2026AuEmoChat: Authentic Emotion Understanding and Rendering for Conversational Speech Synthesis17 Jul 2026
- 2026An Open-Source Benchmark and Baseline for Multi-temporal Referring Segmentation31 May 2026
- 2026Group Cognition Learning: Making Everything Better Through Governed Two-Stage Agents Collaboration1 May 2026
- 2026FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Prediction15 Apr 2026
- 2026Hierarchical Contrastive Learning for Multimodal Data7 Apr 2026