mlsanityData to 7 Oct 2026

Group Cognition Learning: Making Everything Better Through Governed Two-Stage Agents Collaboration

arXiv 2605.00370 ↗First posted 1 May 2026cs.LG cs.CY cs.MMcited by 3

Not on the map. Why?

Abstract (arXiv)

Centralized multimodal learning commonly compresses language, acoustic, and visual signals into a single fused representation for prediction. While effective, this paradigm suffers from two limitations: modality dominance, where optimization gravitates towards the path of least resistance, ignoring weaker but informative modalities, and spurious modality coupling, where models overfit to incidental cross-modal correlations. To address these, we propose Group Cognition Learning (GCL), a governed collaboration paradigm that applies a two-stage protocol after modality-specific encoding. In Stage 1 (Selective Interaction), a Routing Agent proposes directed interaction routes, and an Auditing Agent assigns sample-wise gates to emphasize exchanges that yield positive marginal predictive gain while suppressing redundant coupling. In Stage 2 (Consensus Formation), a Public-Factor Agent maintains an explicit shared factor, and an Aggregation Agent produces the final prediction through contribution-aware weighting while keeping each modality representation as a specialization channel. Extensive experiments on CMU-MOSI, CMU-MOSEI, and MIntRec demonstrate that GCL mitigates dominance and coupling, establishing state-of-the-art results across both regression and classification benchmarks. Analysis experiments further demonstrate the effectiveness of the design.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 17 of its 28 references that are in the map. First posted on arXiv 1 May 2026.

Builds on

17 of 28 references.

References · 17

  1. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 637
  2. 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 429
  3. 2018Efficient Low-rank Multimodal Fusion with Modality-Specific Factorscited by 268
  4. 2021Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysiscited by 179
  5. 2022MIntRec: A New Dataset for Multimodal Intent Recognitioncited by 41
  6. 2024Classifier-guided Gradient Modulation for Enhanced Multimodal Learningcited by 34
  7. 2024DLF: Disentangled-Language-Focused Multimodal Sentiment Analysiscited by 27
  8. 2024Towards Multimodal Sentiment Analysis Debiasing via Bias Purificationcited by 26
  9. 2024Enriching Multimodal Sentiment Analysis through Textual Emotional Descriptions of Visual-Audio Contentcited by 25
  10. 2025Boosting Multimodal Learning via Disentangled Gradient Learningcited by 15
  11. 2023Fine-grained Disentangled Representation Learning for Multimodal Emotion Recognitioncited by 11
  12. 2025Multimodal Transformers are Hierarchical Modal-wise Heterogeneous Graphscited by 5
5 more
  1. 2026Tri-Subspaces Disentanglement for Multimodal Sentiment Analysiscited by 5
  2. 2026CLCR: Cross-Level Semantic Collaborative Representation for Multimodal Learningcited by 5
  3. 2024MInD: Improving Multimodal Sentiment Analysis via Multimodal Information Disentanglementcited by 3
  4. 2026Temporal-Spatial Decouple before Act: Disentangled Representation Learning for Multimodal Sentiment Analysiscited by 3
  5. 2026Mitigating Shared-Private Branch Imbalance via Dual-Branch Rebalancing for Multimodal Sentiment Analysiscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.