Beyond Modality Harmony: Orthogonal Purification and Topology-Guided MoE for Conflict-Aware Multimodal Recommendation
On the map: Mixture-of-experts → MoE for recommender systems
Abstract (arXiv)
Multimodal Recommender Systems (MRSs) typically rely on a flawed "modality harmony" assumption, presuming that multimodal features are inherently beneficial and strictly aligned with users' collaborative interaction patterns. However, modality-topology conflicts are ubiquitous in real-world scenarios due to deceptive visual clickbaits and mismatched semantics. Blindly integrating these noisy modalities inevitably pollutes the pristine collaborative space, causing severe representation distortion. To address this, we propose Orthogonal purification and topology-guided MoE for conflict-aware multimodal Recommendation (OrthoRec). At its core, OrthoRec introduces Collaborative-Guided Orthogonal Purification (CGOP), which geometrically decouples multimodal features into directions parallel and orthogonal to a pure collaborative anchor. By adaptively truncating the orthogonal noise with an energy-preserving normalization, CGOP rectifies deceptive semantic directions while preserving the modality's intrinsic representation capacity. Furthermore, we design a Topology-Aware Routing Mixture-of-Experts (TAR-MoE). Guided by the collaborative topology, TAR-MoE employs decoupled sigmoid gating to break the zero-sum bottleneck of traditional softmax attention, autonomously determining the injection scale for each purified modality. Finally, a safe-SSL objective is introduced to dynamically penalize the forced contrastive alignment of contradictory pairs. Experiments on three real-world Amazon datasets show that OrthoRec consistently outperforms competitive recent baselines and exhibits improved robustness under modality noise and item sparsity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MoE for recommender systems, one of 12 directions in Mixture-of-experts. Builds on 22 of its 39 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
22 of 39 references.
References · 22
- 2017Attention Is All You Needcited by 60,361
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2015Image-based Recommendations on Styles and Substitutescited by 706
- 2020Contrastive Learning with Hard Negative Samplescited by 628
- 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 264
- 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
- 2015VBPR: Visual Bayesian Personalized Ranking from Implicit Feedbackcited by 151
- 2019Learning Disentangled Representations for Recommendationcited by 110
- 2021Mining Latent Structures for Multimedia Recommendationcited by 79
10 more
- 2021GRCN: Graph-Refined Convolutional Network for Multimedia Recommendation with Implicit Feedbackcited by 58
- 2022Bootstrap Latent Representations for Multi-modal Recommendationcited by 55
- 2022A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendationcited by 54
- 2023Debiased Contrastive Learning for Sequential Recommendationcited by 38
- 2023LGMRec: Local and Global Graph Learning for Multimodal Recommendationcited by 38
- 2024DiffMM: Multi-Modal Diffusion Model for Recommendationcited by 22
- 2024MENTOR: Multi-level Self-supervised Learning for Multimodal Recommendationcited by 21
- 2024Improving Multi-modal Recommender Systems by Denoising and Aligning Multi-modal Content and User Feedbackcited by 12
- 2020Cold-start Sequential Recommendation via Meta Learnercited by 11
- 2022Layer-refined Graph Convolutional Networks for Recommendationcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MURAL: Multimodal Uncertainty-aware Recommendation via Adaptive edge Learning
- 2026AdaM-Rec: Adaptive Modality Routing for Multimodal Recommendation ↗
- 2025Structural and Disentangled Adaptation of Large Vision Language Models for Multimodal Recommendation
- 2026VLM2Rec: Resolving Modality Collapse in Vision-Language Model Embedders for Multimodal Sequential Recommendation
- 2026VLM4Rec: Multimodal Semantic Representation for Recommendation with Large Vision-Language Models
- 2026Hi-SAM: A Hierarchical Structure-Aware Multi-modal Framework for Large-Scale Recommendation
- 2025MLLMRec: A Preference Reasoning Paradigm with Graph Refinement for Multimodal Recommendation
- 2024Molar: Multimodal LLMs with Collaborative Filtering Alignment for Enhanced Sequential Recommendation