ID Embedding as Subtle Features of Content and Structure for Multimodal Recommendation
Not on the map. Why?
Abstract (arXiv)
Multimodal recommendation aims to model user and item representations comprehensively with the involvement of multimedia content for effective recommendations. Existing research has shown that it is beneficial for recommendation performance to combine (user- and item-) ID embeddings with multimodal salient features, indicating the value of IDs. However, there is a lack of a thorough analysis of the ID embeddings in terms of feature semantics in the literature. In this paper, we revisit the value of ID embeddings for multimodal recommendation and conduct a thorough study regarding its semantics, which we recognize as subtle features of content and structure. Based on our findings, we propose a novel recommendation model by incorporating ID embeddings to enhance the salient features of both content and structure. Specifically, we put forward a hierarchical attention mechanism to incorporate ID embeddings in modality fusing, coupled with contrastive learning, to enhance content representations. Meanwhile, we propose a lightweight graph convolution network for each modality to amalgamate neighborhood and ID embeddings for improving structural representations. Finally, the content and structure representations are combined to form the ultimate item embedding for recommendation. Extensive experiments on three real-world datasets (Baby, Sports, and Clothing) demonstrate the superiority of our method over state-of-the-art multimodal recommendation methods and the effectiveness of fine-grained ID embeddings. Our code is available at https://anonymous.4open.science/r/IDSF-code/.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 49 references that are in the map. First posted on arXiv 10 Nov 2023.
Builds on
23 of 49 references.
References · 23
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2017Neural Collaborative Filteringcited by 1,111
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2015Image-based Recommendations on Styles and Substitutescited by 706
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
- 2019Neural Graph Collaborative Filteringcited by 661
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
- 2020Self-supervised Graph Learning for Recommendationcited by 305
11 more
- 2018Learning Factorized Multimodal Representationscited by 171
- 2015VBPR: Visual Bayesian Personalized Ranking from Implicit Feedbackcited by 151
- 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
- 2019Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferencescited by 87
- 2021UltraGCN: Ultra Simplification of Graph Convolutional Networks for Recommendationcited by 87
- 2021Mining Latent Structures for Multimedia Recommendationcited by 79
- 2021GRCN: Graph-Refined Convolutional Network for Multimedia Recommendation with Implicit Feedbackcited by 58
- 2022Bootstrap Latent Representations for Multi-modal Recommendationcited by 55
- 2022A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendationcited by 54
- 2018Adversarial Personalized Ranking for Recommendationcited by 49
- 2022Uniform Sequence Better: Time Interval Aware Data Augmentation for Sequential Recommendationcited by 16
Built on by
Citing papers per year: 2024: 3.
3 papers.
- 2024IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFTcited by 26
- 2024CoRA: Collaborative Information Perception by Large Language Model's Weights for Recommendationcited by 7
- 2024Towards Unified Modeling for Positive and Negative Preferences in Sign-Aware Recommendationcited by 1
- 2024CoRA: Collaborative Information Perception by Large Language Model's Weights for Recommendation20 Aug 2024
- 2024IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFT2 Apr 2024
- 2024Towards Unified Modeling for Positive and Negative Preferences in Sign-Aware Recommendation13 Mar 2024