mlsanityData to 14 Oct 2026

MDE: Modality Discrimination Enhancement for Multi-modal Recommendation

arXiv 2502.18481 ↗First posted 8 Feb 2025cs.IR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-modal recommendation systems aim to enhance performance by integrating an item's content features across various modalities with user behavior data. Effective utilization of features from different modalities requires addressing two challenges: preserving semantic commonality across modalities (modality-shared) and capturing unique characteristics for each modality (modality-specific). Most existing approaches focus on aligning feature spaces across modalities, which helps represent modality-shared features. However, modality-specific distinctions are often neglected, especially when there are significant semantic variations between modalities. To address this, we propose a Modality Distinctiveness Enhancement (MDE) framework that prioritizes extracting modality-specific information to improve recommendation accuracy while maintaining shared features. MDE enhances differences across modalities through a novel multi-modal fusion module and introduces a node-level trade-off mechanism to balance cross-modal alignment and differentiation. Extensive experiments on three public datasets show that our approach significantly outperforms other state-of-the-art methods, demonstrating the effectiveness of jointly considering modality-shared and modality-specific features.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 24 references that are in the map. First posted on arXiv 8 Feb 2025.

Builds on

14 of 24 references.

References · 14

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Inductive Representation Learning on Large Graphscited by 6,320
  4. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
  5. 2015Image-based Recommendations on Styles and Substitutescited by 706
  6. 2020A Survey on Contrastive Self-supervised Learningcited by 554
  7. 2021Mining Latent Structures for Multimedia Recommendationcited by 79
  8. 2022Bootstrap Latent Representations for Multi-modal Recommendationcited by 55
  9. 2023LGMRec: Local and Global Graph Learning for Multimodal Recommendationcited by 38
  10. 2023Multi-View Graph Convolutional Network for Multimedia Recommendationcited by 32
  11. 2024Multimodal Pretraining, Adaptation, and Generation for Recommendation: A Surveycited by 25
  12. 2023A Comprehensive Survey on Multimodal Recommender Systems: Taxonomy, Evaluation, and Future Directionscited by 17
2 more
  1. 2023Enhancing Dyadic Relations with Homogeneous Graphs for Multimodal Recommendationcited by 15
  2. 2023Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognitioncited by 13

Built on by

Not cited yet.