Efficient Multimodal Streaming Recommendation via Expandable Side Mixture-of-Experts
On the map: Mixture-of-experts → MoE for recommender systems
Abstract (arXiv)
Streaming recommender systems (SRSs) are widely deployed in real-world applications, where user interests shift and new items arrive over time. As a result, effectively capturing users' latest preferences is challenging, as interactions reflecting recent interests are limited and new items often lack sufficient feedback. A common solution is to enrich item representations using multimodal encoders (e.g., BERT or ViT) to extract visual and textual features. However, these encoders are pretrained on general-purpose tasks: they are not tailored to user preference modeling, and they overlook the fact that user tastes toward modality-specific features such as visual styles and textual tones can also drift over time. This presents two key challenges in streaming scenarios: the high cost of fine-tuning large multimodal encoders, and the risk of forgetting long-term user preferences due to continuous model updates. To tackle these challenges, we propose Expandable Side Mixture-of-Experts (XSMoE), a memory-efficient framework for multimodal streaming recommendation. XSMoE attaches lightweight side-tuning modules consisting of expandable expert networks to frozen pretrained encoders and incrementally expands them in response to evolving user feedback. A gating router dynamically combines expert and backbone outputs, while a utilization-based pruning strategy maintains model compactness. By learning new patterns through expandable experts without overwriting previously acquired knowledge, XSMoE effectively captures both cold start and shifting preferences in multimodal features. Experiments on three real-world datasets demonstrate that XSMoE outperforms state-of-the-art baselines in both recommendation quality and computational efficiency.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in MoE for recommender systems, one of 12 directions in Mixture-of-experts. Builds on 42 of its 74 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
42 of 74 references.
References · 42
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 681
- 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 521
- 2017Variational Continual Learningcited by 339
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
- 2022LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learningcited by 230
- 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
- 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
30 more
- 2019Uncertainty-based Continual Learning with Adaptive Regularizationcited by 146
- 2020A Neural Dirichlet Process Mixture Model for Task-Free Continual Learningcited by 134
- 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
- 2023A Content-Driven Micro-Video Recommendation Dataset at Scalecited by 45
- 2020How to Retrain Recommender System? A Sequential Meta-Learning Methodcited by 42
- 2020GraphSAIL: Graph Structure Aware Incremental Learning for Recommender Systemscited by 42
- 2023LGMRec: Local and Global Graph Learning for Multimodal Recommendationcited by 38
- 2023Multimodal Recommender Systems: A Surveycited by 37
- 2024IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFTcited by 26
- 2023Interaction-level Membership Inference Attack Against Federated Recommender Systemscited by 25
- 2020ADER: Adaptively Distilled Exemplar Replay Towards Continual Learning for Session-based Recommendationcited by 22
- 2023DTL: Disentangled Transfer Learning for Visual Recognitioncited by 22
- 2022Comprehensive Privacy Analysis on Federated Recommender System against Attribute Inference Attackscited by 21
- 2020A Practical Incremental Method to Train Deep CTR Modelscited by 10
- 2020Memory Augmented Neural Model for Incremental Session-based Recommendationcited by 9
- 2023A Survey on Incremental Update for Neural Recommender Systemscited by 8
- 2023Continuous Input Embedding Size Search For Recommender Systemscited by 7
- 2024ATLAS: Adapter-Based Multi-Modal Continual Learning with a Two-Stage Learning Strategycited by 7
- 2021CausalRec: Causal Inference for Visual Debiasing in Visually-Aware Recommendationcited by 6
- 2022Meta-Learning for Online Update of Recommender Systemscited by 6
- 2023Budgeted Embedding Table For Recommender Systemscited by 6
- 2017And That's A Fact: Distinguishing Factual and Emotional Argumentation in Online Dialoguecited by 5
- 2021Learning an Adaptive Meta Model-Generator for Incrementally Updating Recommender Systemscited by 5
- 2024QAGCF: Graph Collaborative Filtering for Q&A Recommendationcited by 5
- 2025Test-Time Alignment for Tracking User Interest Shifts in Sequential Recommendationcited by 5
- 2018Visually-Aware Personalized Recommendation using Interpretable Image Representationscited by 4
- 2019Visually-aware Recommendation with Aesthetic Featurescited by 4
- 2024Modeling Domain and Feedback Transitions for Cross-Domain Sequential Recommendationcited by 3
- 2024Sparser Training for On-Device Recommendation Systemscited by 3
- 2024Scalable Dynamic Embedding Size Search for Streaming Recommendationcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Do Recommender Systems Really Leverage Multimodal Content? A Comprehensive Analysis on Multimodal Representations for Recommendation
- 2025Describe What You See with Multimodal Large Language Models to Enhance Video Recommendations
- 2020Double-Wing Mixture of Experts for Streaming Recommendations
- 2025Short-Form Video Recommendations with Multimodal Embeddings: Addressing Cold-Start and Bias Challenges
- 2024Multimodal Pretraining, Adaptation, and Generation for Recommendation: A Survey
- 2026VLM4Rec: Multimodal Semantic Representation for Recommendation with Large Vision-Language Models
- 2024NoteLLM-2: Multimodal Large Representation Models for Recommendation
- 2024X-Reflect: Cross-Reflection Prompting for Multimodal Recommendation