Group Cognition Learning: Making Everything Better Through Governed Two-Stage Agents Collaboration
Not on the map. Why?
Abstract (arXiv)
Centralized multimodal learning commonly compresses language, acoustic, and visual signals into a single fused representation for prediction. While effective, this paradigm suffers from two limitations: modality dominance, where optimization gravitates towards the path of least resistance, ignoring weaker but informative modalities, and spurious modality coupling, where models overfit to incidental cross-modal correlations. To address these, we propose Group Cognition Learning (GCL), a governed collaboration paradigm that applies a two-stage protocol after modality-specific encoding. In Stage 1 (Selective Interaction), a Routing Agent proposes directed interaction routes, and an Auditing Agent assigns sample-wise gates to emphasize exchanges that yield positive marginal predictive gain while suppressing redundant coupling. In Stage 2 (Consensus Formation), a Public-Factor Agent maintains an explicit shared factor, and an Aggregation Agent produces the final prediction through contribution-aware weighting while keeping each modality representation as a specialization channel. Extensive experiments on CMU-MOSI, CMU-MOSEI, and MIntRec demonstrate that GCL mitigates dominance and coupling, establishing state-of-the-art results across both regression and classification benchmarks. Analysis experiments further demonstrate the effectiveness of the design.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 17 of its 28 references that are in the map. First posted on arXiv 1 May 2026.
Builds on
17 of 28 references.
References · 17
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
- 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 429
- 2018Efficient Low-rank Multimodal Fusion with Modality-Specific Factorscited by 268
- 2021Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysiscited by 179
- 2022MIntRec: A New Dataset for Multimodal Intent Recognitioncited by 41
- 2024Classifier-guided Gradient Modulation for Enhanced Multimodal Learningcited by 34
- 2024DLF: Disentangled-Language-Focused Multimodal Sentiment Analysiscited by 27
- 2024Towards Multimodal Sentiment Analysis Debiasing via Bias Purificationcited by 26
- 2024Enriching Multimodal Sentiment Analysis through Textual Emotional Descriptions of Visual-Audio Contentcited by 25
- 2025Boosting Multimodal Learning via Disentangled Gradient Learningcited by 15
- 2023Fine-grained Disentangled Representation Learning for Multimodal Emotion Recognitioncited by 11
- 2025Multimodal Transformers are Hierarchical Modal-wise Heterogeneous Graphscited by 5
5 more
- 2026Tri-Subspaces Disentanglement for Multimodal Sentiment Analysiscited by 5
- 2026CLCR: Cross-Level Semantic Collaborative Representation for Multimodal Learningcited by 5
- 2024MInD: Improving Multimodal Sentiment Analysis via Multimodal Information Disentanglementcited by 3
- 2026Temporal-Spatial Decouple before Act: Disentangled Representation Learning for Multimodal Sentiment Analysiscited by 3
- 2026Mitigating Shared-Private Branch Imbalance via Dual-Branch Rebalancing for Multimodal Sentiment Analysiscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Rethinking Modality Reliability in Multimodal Sentiment Analysis with Incomplete Observationscited by 0
- 2026CM2: Multimodal Cultural Reasoning via an Integrated Multi-Agent Frameworkcited by 0
- 2026SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigationcited by 0
- 2026SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigation15 Sep 2026
- 2026CM2: Multimodal Cultural Reasoning via an Integrated Multi-Agent Framework31 Aug 2026
- 2026Rethinking Modality Reliability in Multimodal Sentiment Analysis with Incomplete Observations4 Aug 2026