Self Contrastive Learning for Session-based Recommendation
Not on the map. Why?
Abstract (arXiv)
Session-based recommendation, which aims to predict the next item of users' interest as per an existing sequence interaction of items, has attracted growing applications of Contrastive Learning (CL) with improved user and item representations. However, these contrastive objectives: (1) serve a similar role as the cross-entropy loss while ignoring the item representation space optimisation; and (2) commonly require complicated modelling, including complex positive/negative sample constructions and extra data augmentation. In this work, we introduce Self-Contrastive Learning (SCL), which simplifies the application of CL and enhances the performance of state-of-the-art CL-based recommendation techniques. Specifically, SCL is formulated as an objective function that directly promotes a uniform distribution among item representations and efficiently replaces all the existing contrastive objective components of state-of-the-art models. Unlike previous works, SCL eliminates the need for any positive/negative sample construction or data augmentation, leading to enhanced interpretability of the item representation space and facilitating its extensibility to existing recommender systems. Through experiments on three benchmark datasets, we demonstrate that SCL consistently improves the performance of state-of-the-art models with statistical significance. Notably, our experiments show that SCL improves the performance of two best-performing models by 8.2% and 9.5% in P@10 (Precision) and 9.9% and 11.2% in MRR@10 (Mean Reciprocal Rank) on average across different benchmarks. Additionally, our analysis elucidates the improvement in terms of alignment and uniformity of representations, as well as the effectiveness of SCL with a low computational cost.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 48 of its 69 references that are in the map. First posted on arXiv 2 Jun 2023.
Builds on
48 of 69 references.
References · 48
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2018Session-based Recommendation with Graph Neural Networkscited by 312
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
36 more
- 2017Neural Attentive Session-based Recommendationcited by 237
- 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
- 2021Contrastive Learning for Representation Degeneration Problem in Sequential Recommendationcited by 121
- 2021Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendationcited by 101
- 2021Global Context Enhanced Graph Neural Networks for Session-based Recommendationcited by 81
- 2021Contrastive Learning for Cold-Start Recommendationcited by 79
- 2019Session-based Social Recommendation via Dynamic Graph Attention Networkscited by 76
- 2020Self-Supervised Hypergraph Convolutional Networks for Session-based Recommendationcited by 75
- 2022StepGame: A New Benchmark for Robust Multi-Hop Spatial Reasoning in Textscited by 68
- 2021Contrastive Self-supervised Sequential Recommendation with Robust Augmentationcited by 56
- 2019Rethinking the Item Order in Session-based Recommendation with Graph Neural Networkscited by 43
- 2021Self-Supervised Graph Co-Training for Session-based Recommendationcited by 43
- 2021Socially-Aware Self-Supervised Tri-Training for Recommendationcited by 32
- 2022Learning to Execute Actions or Ask Clarification Questionscited by 30
- 2021Extending CLIP for Category-to-image Retrieval in E-commercecited by 24
- 2023Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learnercited by 23
- 2014Sequential Click Prediction for Sponsored Search with Recurrent Neural Networkscited by 21
- 2020Beyond Clicks: Modeling Multi-Relational Item Graph for Session-Based Target Behavior Predictioncited by 21
- 2013Using Temporal Data for Making Recommendationscited by 20
- 2018The Music Streaming Sessions Datasetcited by 18
- 2023Rethinking Semi-supervised Learning with Language Modelscited by 17
- 2021SelfCF: A Simple Framework for Self-supervised Collaborative Filteringcited by 15
- 2020Contrastive Learning for Sequential Recommendationcited by 13
- 2022Experiments on Generalizability of User-Oriented Fairness in Recommender Systemscited by 13
- 2020Joint Geographical and Temporal Modeling based on Matrix Factorization for Point-of-Interest Recommendationcited by 11
- 2020Self-supervised Learning for Large-scale Item Recommendationscited by 11
- 2022Explanation Guided Contrastive Learning for Sequential Recommendationcited by 11
- 2019Category-Aware Location Embedding for Point-of-Interest Recommendationcited by 8
- 2020Analyzing and Predicting Purchase Intent in E-commerce: Anonymous vs. Identified Customerscited by 7
- 2021Leveraging Review Properties for Effective Recommendationcited by 7
- 2021Self-Contrastive Learning: Single-viewed Supervised Contrastive Framework using Sub-networkcited by 5
- 2023When and What to Ask Through World States and Text Instructions: IGLU NLP Challenge Solutioncited by 5
- 2020Negative Confidence-Aware Weakly Supervised Binary Classification for Effective Review Helpfulness Classificationcited by 2
- 2021MIC: Model-agnostic Integrated Cross-channel Recommenderscited by 2
- 2022Supervised Contrastive Learning Approach for Contextual Rankingcited by 2
- 2022Multi-granularity Item-based Contrastive Recommendationcited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 1.
3 papers.