mlsanityData to 14 Oct 2026

ID Embedding as Subtle Features of Content and Structure for Multimodal Recommendation

arXiv 2311.05956 ↗First posted 10 Nov 2023cs.IR cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Multimodal recommendation aims to model user and item representations comprehensively with the involvement of multimedia content for effective recommendations. Existing research has shown that it is beneficial for recommendation performance to combine (user- and item-) ID embeddings with multimodal salient features, indicating the value of IDs. However, there is a lack of a thorough analysis of the ID embeddings in terms of feature semantics in the literature. In this paper, we revisit the value of ID embeddings for multimodal recommendation and conduct a thorough study regarding its semantics, which we recognize as subtle features of content and structure. Based on our findings, we propose a novel recommendation model by incorporating ID embeddings to enhance the salient features of both content and structure. Specifically, we put forward a hierarchical attention mechanism to incorporate ID embeddings in modality fusing, coupled with contrastive learning, to enhance content representations. Meanwhile, we propose a lightweight graph convolution network for each modality to amalgamate neighborhood and ID embeddings for improving structural representations. Finally, the content and structure representations are combined to form the ultimate item embedding for recommendation. Extensive experiments on three real-world datasets (Baby, Sports, and Clothing) demonstrate the superiority of our method over state-of-the-art multimodal recommendation methods and the effectiveness of fine-grained ID embeddings. Our code is available at https://anonymous.4open.science/r/IDSF-code/.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 49 references that are in the map. First posted on arXiv 10 Nov 2023.

Builds on

23 of 49 references.

References · 23

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
  4. 2018Self-Attentive Sequential Recommendationcited by 1,184
  5. 2017Neural Collaborative Filteringcited by 1,111
  6. 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
  7. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  8. 2015Image-based Recommendations on Styles and Substitutescited by 706
  9. 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
  10. 2019Neural Graph Collaborative Filteringcited by 661
  11. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  12. 2020Self-supervised Graph Learning for Recommendationcited by 305
11 more
  1. 2018Learning Factorized Multimodal Representationscited by 171
  2. 2015VBPR: Visual Bayesian Personalized Ranking from Implicit Feedbackcited by 151
  3. 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
  4. 2019Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferencescited by 87
  5. 2021UltraGCN: Ultra Simplification of Graph Convolutional Networks for Recommendationcited by 87
  6. 2021Mining Latent Structures for Multimedia Recommendationcited by 79
  7. 2021GRCN: Graph-Refined Convolutional Network for Multimedia Recommendation with Implicit Feedbackcited by 58
  8. 2022Bootstrap Latent Representations for Multi-modal Recommendationcited by 55
  9. 2022A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendationcited by 54
  10. 2018Adversarial Personalized Ranking for Recommendationcited by 49
  11. 2022Uniform Sequence Better: Time Interval Aware Data Augmentation for Sequential Recommendationcited by 16

Built on by

Cited by year

Citing papers per year: 2024: 3.

3 papers.