mlsanityData to 7 Oct 2026

CAMMSR: Category-Guided Attentive Mixture of Experts for Multimodal Sequential Recommendation

arXiv 2603.04320 ↗First posted 4 Mar 2026cs.IR cs.MMcited by 0

On the map: Mixture-of-experts → MoE for recommender systems

Abstract (arXiv)

The explosion of multimedia data in information-rich environments has intensified the challenges of personalized content discovery, positioning recommendation systems as an essential form of passive data management. Multimodal sequential recommendation, which leverages diverse item information such as text and images, has shown great promise in enriching item representations and deepening the understanding of user interests. However, most existing models rely on heuristic fusion strategies that fail to capture the dynamic and context-sensitive nature of user-modal interactions. In real-world scenarios, user preferences for modalities vary not only across individuals but also within the same user across different items or categories. Moreover, the synergistic effects between modalities-where combined signals trigger user interest in ways isolated modalities cannot-remain largely underexplored. To this end, we propose CAMMSR, a Category-guided Attentive Mixture of Experts model for Multimodal Sequential Recommendation. At its core, CAMMSR introduces a category-guided attentive mixture of experts (CAMoE) module, which learns specialized item representations from multiple perspectives and explicitly models inter-modal synergies. This component dynamically allocates modality weights guided by an auxiliary category prediction task, enabling adaptive fusion of multimodal signals. Additionally, we design a modality swap contrastive learning task to enhance cross-modal representation alignment through sequence-level augmentation. Extensive experiments on four public datasets demonstrate that CAMMSR consistently outperforms state-of-the-art baselines, validating its effectiveness in achieving adaptive, synergistic, and user-centric multimodal sequential recommendation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE for recommender systems, one of 12 directions in Mixture-of-experts. Builds on 46 of its 65 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

46 of 65 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Hierarchical Time-Aware Mixture of Experts for Multi-Modal Sequential Recommendation24 Jan
  2. 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework29 Apr
  3. 2024Sequence-level Semantic Representation Fusion for Recommender Systems28 Feb

Other references · 43

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2018Self-Attentive Sequential Recommendationcited by 1,169
  7. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  8. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  9. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  10. 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 517
  11. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  12. 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
31 more
  1. 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 137
  2. 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
  3. 2022Towards Universal Sequence Representation Learning for Recommender Systemscited by 120
  4. 2025Transformers without Normalizationcited by 69
  5. 2022A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendationcited by 53
  6. 2023Frequency Enhanced Hybrid Attention Network for Sequential Recommendationcited by 52
  7. 2023Multi-Modal Self-Supervised Learning for Recommendationcited by 44
  8. 2023A Content-Driven Micro-Video Recommendation Dataset at Scalecited by 43
  9. 2024What to align in multimodal contrastive learning?cited by 41
  10. 2021Non-invasive Self-attention for Side Information Fusion in Sequential Recommendationcited by 39
  11. 2023LGMRec: Local and Global Graph Learning for Multimodal Recommendationcited by 37
  12. 2024Harnessing Multimodal Large Language Models for Multimodal Sequential Recommendationcited by 33
  13. 2023Linear Recurrent Units for Sequential Recommendationcited by 32
  14. 2022Decoupled Side Information Fusion for Sequential Recommendationcited by 30
  15. 2023MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendationcited by 30
  16. 2024IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFTcited by 26
  17. 2020MEANTIME: Mixture of Attention Mechanisms with Multi-temporal Embeddings for Sequential Recommendationcited by 17
  18. 2023MMRec: Simplifying Multimodal Recommendationcited by 17
  19. 2023Adaptive Multi-Modalities Fusion in Sequential Recommendation Systemscited by 13
  20. 2024AlignGroup: Learning and Aligning Group Consensus with Member Preferences for Group Recommendationcited by 13
  21. 2023Online Distillation-enhanced Multi-modal Transformer for Sequential Recommendationcited by 9
  22. 2025COHESION: Composite Graph Convolutional Network with Dual-Stage Fusion for Multimodal Recommendationcited by 9
  23. 2023Ensemble Modeling with Contrastive Knowledge Distillation for Sequential Recommendationcited by 6
  24. 2025A Survey on Multimodal Recommender Systems: Recent Advances and Future Directionscited by 4
  25. 2025FindRec: Stein-Guided Entropic Flow for Multi-Modal Sequential Recommendationcited by 4
  26. 2025Squeeze and Excitation: A Weighted Graph Contrastive Learning for Collaborative Filteringcited by 3
  27. 2025The Best is Yet to Come: Graph Convolution in the Testing Phase for Multimodal Recommendationcited by 3
  28. 2024Don't Lose Yourself: Boosting Multimodal Recommendation via Reducing Node-neighbor Discrepancy in Graph Convolutional Networkcited by 2
  29. 2025Hypercomplex Prompt-aware Multimodal Recommendationcited by 2
  30. 2025VI-MMRec: Similarity-Aware Training Cost-free Virtual User-Item Interactions for Multimodal Recommendationcited by 2
  31. 2025NLGCL: Naturally Existing Neighbor Layers Graph Contrastive Learning for Recommendationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DMESR: Dual-view MLLM-based Enhancing Framework for Multimodal Sequential Recommendation ↗
  2. 2024Multimodal Pretraining, Adaptation, and Generation for Recommendation: A Survey
  3. 2025An item is worth one token in Multimodal Large Language Models-based Sequential Recommendation
  4. 2024Molar: Multimodal LLMs with Collaborative Filtering Alignment for Enhanced Sequential Recommendation
  5. 2025MMSRARec: Summarization and Retrieval Augumented Sequential Recommendation Based on Multimodal Large Language Model
  6. 2025Learning Item Representations Directly from Multimodal Features for Effective Recommendation
  7. 2025Bridging Domain Gaps between Pretrained Multimodal Models and Recommendations
  8. 2025Do Recommender Systems Really Leverage Multimodal Content? A Comprehensive Analysis on Multimodal Representations for Recommendation