mlsanityData to 14 Oct 2026

Enhancing ID and Text Fusion via Alternative Training in Session-based Recommendation

arXiv 2402.08921 ↗First posted 14 Feb 2024cs.IR cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Session-based recommendation has gained increasing attention in recent years, with its aim to offer tailored suggestions based on users' historical behaviors within sessions. To advance this field, a variety of methods have been developed, with ID-based approaches typically demonstrating promising performance. However, these methods often face challenges with long-tail items and overlook other rich forms of information, notably valuable textual semantic information. To integrate text information, various methods have been introduced, mostly following a naive fusion framework. Surprisingly, we observe that fusing these two modalities does not consistently outperform the best single modality by following the naive fusion framework. Further investigation reveals an potential imbalance issue in naive fusion, where the ID dominates and text modality is undertrained. This suggests that the unexpected observation may stem from naive fusion's failure to effectively balance the two modalities, often over-relying on the stronger ID modality. This insight suggests that naive fusion might not be as effective in combining ID and text as previously expected. To address this, we propose a novel alternative training strategy AlterRec. It separates the training of ID and text, thereby avoiding the imbalance issue seen in naive fusion. Additionally, AlterRec designs a novel strategy to facilitate the interaction between the two modalities, enabling them to mutually learn from each other and integrate the text more effectively. Comprehensive experiments demonstrate the effectiveness of AlterRec in session-based recommendation. The implementation is available at https://github.com/Juanhui28/AlterRec.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 35 references that are in the map. First posted on arXiv 14 Feb 2024.

Builds on

23 of 35 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2018Self-Attentive Sequential Recommendationcited by 1,184
  6. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  7. 2019What Makes Training Multi-Modal Classification Networks Hard?cited by 344
  8. 2018Session-based Recommendation with Graph Neural Networkscited by 312
  9. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  10. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 264
  11. 2017Neural Attentive Session-based Recommendationcited by 237
  12. 2023LLMRec: Large Language Models with Graph Augmentation for Recommendationcited by 172
11 more
  1. 2023Representation Learning with Large Language Models for Recommendationcited by 155
  2. 2021MultiBench: Multiscale Benchmarks for Multimodal Representation Learningcited by 146
  3. 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
  4. 2022Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably)cited by 122
  5. 2023Leveraging Large Language Models for Sequential Recommendationcited by 78
  6. 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusioncited by 74
  7. 2023On Uni-Modal Feature Learning in Supervised Multi-Modal Learningcited by 53
  8. 2023Exploring the Upper Limits of Text-Based Collaborative Filtering Using Large Language Models: Discoveries and Insightscited by 38
  9. 2022CORE: Simple and Effective Session-based Recommendation within Consistent Representation Spacecited by 37
  10. 2023Multimodal Recommender Systems: A Surveycited by 37
  11. 2023An Attentive Inductive Bias for Sequential Recommendation beyond the Self-Attentioncited by 28

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.