Contrastive Self-supervised Sequential Recommendation with Robust Augmentation
Not on the map. Why?
Abstract (arXiv)
Sequential Recommendationdescribes a set of techniques to model dynamic user behavior in order to predict future interactions in sequential user data. At their core, such approaches model transition probabilities between items in a sequence, whether through Markov chains, recurrent networks, or more recently, Transformers. However both old and new issues remain, including data-sparsity and noisy data; such issues can impair the performance, especially in complex, parameter-hungry models. In this paper, we investigate the application of contrastive Self-Supervised Learning (SSL) to the sequential recommendation, as a way to alleviate some of these issues. Contrastive SSL constructs augmentations from unlabelled instances, where agreements among positive pairs are maximized. It is challenging to devise a contrastive SSL framework for a sequential recommendation, due to its discrete nature, correlations among items, and skewness of length distributions. To this end, we propose a novel framework, Contrastive Self-supervised Learning for sequential Recommendation (CoSeRec). We introduce two informative augmentation operators leveraging item correlations to create high-quality views for contrastive learning. Experimental results on three real-world datasets demonstrate the effectiveness of the proposed method on improving model performance and the robustness against sparse and noisy data. Our implementation is available online at urlhttps://github.com/YChen1993/CoSeRec
Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). Builds on 39 of its 52 references that are in the map. First posted on arXiv 14 Aug 2021.
Builds on
39 of 52 references.
References · 39
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2018Deep Graph Infomaxcited by 1,101
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2020What Makes for Good Views for Contrastive Learning?cited by 843
27 more
- 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
- 2015Image-based Recommendations on Styles and Substitutescited by 702
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
- 2019Neural Graph Collaborative Filteringcited by 660
- 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
- 2020Self-supervised Graph Learning for Recommendationcited by 305
- 2020DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representationscited by 249
- 2020What Should Not Be Contrastive in Contrastive Learningcited by 224
- 2020CLEAR: Contrastive Learning for Sentence Representationcited by 186
- 2020CERT: Contrastive Self-supervised Learning for Language Understandingcited by 169
- 2016Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendationcited by 152
- 2020Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learningcited by 90
- 2017Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networkscited by 84
- 2020Denoising Implicit Feedback for Recommendationcited by 80
- 2013Empirical Analysis of Predictive Algorithms for Collaborative Filteringcited by 47
- 2021Augmenting Sequential Recommendation with Pseudo-Prior Items via Reversely Pre-training Transformercited by 45
- 2020Try This Instead: Personalized and Interpretable Substitute Recommendationcited by 34
- 2021Modeling Sequences as Distributions with Uncertainty for Sequential Recommendationcited by 22
- 2020BasConv: Aggregating Heterogeneous Interactions for Basket Recommendation with Graph Convolutional Neural Networkcited by 16
- 2020D'ej`a vu: A Contextualized Temporal Attention Mechanism for Sequential Recommendationcited by 14
- 2020Contrastive Learning for Sequential Recommendationcited by 13
- 2020Self-supervised Learning for Large-scale Item Recommendationscited by 11
- 2019JSCN: Joint Spectral Convolutional Network for Cross Domain Recommendationcited by 8
Built on by
Citing papers per year: 2021: 3; 2022: 12; 2023: 11; 2024: 16; 2025: 5; 2026: 9.
56 papers.
Sort:
By area:
- 2022Intent Contrastive Learning for Sequential Recommendationcited by 90
- 2022Knowledge Graph Contrastive Learning for Recommendationcited by 69
- 2021Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuningcited by 46
- 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendationcited by 35
- 2023Turning Dross Into Gold Loss: is BERT4Rec really better than SASRec?cited by 30
- 2022A Systematic Review and Replicability Study of BERT4Rec for Sequential Recommendationcited by 22
- 2022ContrastVAE: Contrastive Variational AutoEncoder for Sequential Recommendationcited by 19
- 2023Graph Masked Autoencoder for Sequential Recommendationcited by 19
- 2023Embedding in Recommender Systems: A Surveycited by 19
- 2024Exploring User Retrieval Integration towards Large Language Models for Cross-Domain Sequential Recommendationcited by 19
- 2022Uniform Sequence Better: Time Interval Aware Data Augmentation for Sequential Recommendationcited by 16
- 2024Scalable Cross-Entropy Loss for Sequential Recommendations with Large Item Catalogscited by 15
38 more
- 2021Pre-training Graph Neural Network for Cross Domain Recommendationcited by 14
- 2023Multi-behavior Self-supervised Learning for Recommendationcited by 11
- 2023MAP: A Model-agnostic Pretraining Framework for Click-through Rate Predictioncited by 10
- 2024End-to-end Learnable Clustering for Intent Learning in Recommendationcited by 10
- 2024Diffusion-based Contrastive Learning for Sequential Recommendationcited by 9
- 2022Determinantal Point Process Likelihoods for Sequential Recommendationcited by 7
- 2024Scaling Sequential Recommendation Models with Transformerscited by 7
- 2021Modeling Dynamic Attributes for Next Basket Recommendationcited by 6
- 2024CrossVideo: Self-supervised Cross-modal Contrastive Learning for Point Cloud Video Understandingcited by 6
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendationcited by 6
- 2025Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendationcited by 6
- 2022Improving Contrastive Learning with Model Augmentationcited by 5
- 2023On the Effectiveness of Unlearning in Session-Based Recommendationcited by 4
- 2024UniRec: A Dual Enhancement of Uniformity and Frequency in Sequential Recommendationscited by 4
- 2022ELECRec: Training Sequential Recommenders as Discriminatorscited by 3
- 2022Generating Negative Samples for Sequential Recommendationcited by 3
- 2023Mutual Wasserstein Discrepancy Minimization for Sequential Recommendationcited by 3
- 2023Self Contrastive Learning for Session-based Recommendationcited by 3
- 2024Temporal Linear Item-Item Model for Sequential Recommendationcited by 3
- 2024RaSeRec: Retrieval-Augmented Sequential Recommendationcited by 3
- 2023Deep Stable Multi-Interest Learning for Out-of-distribution Sequential Recommendationcited by 2
- 2023RUEL: Retrieval-Augmented User Representation with Edge Browser Logs for Sequential Recommendationcited by 2
- 2023AdaptSSR: Pre-training User Model with Augmentation-Adaptive Self-Supervised Rankingcited by 2
- 2024Leave No One Behind: Online Self-Supervised Self-Distillation for Sequential Recommendationcited by 2
- 2025Sequential Data Augmentation for Generative Recommendationcited by 2
- 2025Quantifying the Potential to Escape Filter Bubbles: A Behavior-Aware Measure via Contrastive Simulationcited by 2
- 2022Learnable Model Augmentation Self-Supervised Learning for Sequential Recommendationcited by 1
- 2024Adapting Job Recommendations to User Preference Drift with Behavioral-Semantic Fusion Learningcited by 1
- 2025Warmer for Less: A Cost-Efficient Strategy for Cold-Start Recommendations at Pinterestcited by 1
- 2026Generative Archetype-Grounded Item Representations for Sequential Recommendationcited by 1
- 2022Improving Multi-Interest Network with Stable Learningcited by 0
- 2022FELRec: Efficient Handling of Item Cold-Start With Dynamic Representation Learning in Recommender Systemscited by 0
- 2024Contrastive Learning Method for Sequential Recommendation based on Multi-Intention Disentanglementcited by 0
- 2024A Survey of Latent Factor Models in Recommender Systemscited by 0
- 2024Multi-intent Aware Contrastive Learning for Sequential Recommendationcited by 0
- 2025SimDiffRec: Semantic Similarity-Guided Diffusion for Contrastive Sequential Recommendationcited by 0
- 2026Retrieve-then-Adapt: Retrieval-Augmented Test-Time Adaptation for Sequential Recommendationcited by 0
- 2026ID and Graph View Contrastive Learning with Multi-View Attention Fusion for Sequential Recommendationcited by 0
50 most cited of 56 All 56 (JSON)
- 2026Cross-Country Code-Mixing for Generative Recommendation24 Sep 2026
- 2026User Representation via Cross Multi-source Behavior Pre-training for Mobile Games1 Sep 2026
- 2026GOD: Enhancing Generalization via Deep Grafting for Sequential Recommendation17 Aug 2026
- 2026TSPORec: Token Selection via Preference Optimization for LLM-Based Sequential Recommendation10 Aug 2026
- 2026SAERec: Constructing Fine-grained Interpretable Intents Priors via Sparse Autoencoders for Recommendation17 Jun 2026
- 2026Generative Archetype-Grounded Item Representations for Sequential Recommendation9 Jun 2026
- 2026Rethinking Convolutional Networks for Attribute-Aware Sequential Recommendation6 May 2026
- 2026ID and Graph View Contrastive Learning with Multi-View Attention Fusion for Sequential Recommendation15 Apr 2026
- 2026Retrieve-then-Adapt: Retrieval-Augmented Test-Time Adaptation for Sequential Recommendation7 Apr 2026
- 2025Warmer for Less: A Cost-Efficient Strategy for Cold-Start Recommendations at Pinterest19 Dec 2025
- 2025Quantifying the Potential to Escape Filter Bubbles: A Behavior-Aware Measure via Contrastive Simulation27 Nov 2025
- 2025Sequential Data Augmentation for Generative Recommendation17 Sep 2025
38 more
- 2025SimDiffRec: Semantic Similarity-Guided Diffusion for Contrastive Sequential Recommendation16 Jul 2025
- 2025Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendation6 Mar 2025
- 2024RaSeRec: Retrieval-Augmented Sequential Recommendation24 Dec 2024
- 2024Scaling Sequential Recommendation Models with Transformers10 Dec 2024
- 2024Temporal Linear Item-Item Model for Sequential Recommendation10 Dec 2024
- 2024Scalable Cross-Entropy Loss for Sequential Recommendations with Large Item Catalogs27 Sep 2024
- 2024Multi-intent Aware Contrastive Learning for Sequential Recommendation13 Sep 2024
- 2024UniRec: A Dual Enhancement of Uniformity and Frequency in Sequential Recommendations26 Jun 2024
- 2024Adapting Job Recommendations to User Preference Drift with Behavioral-Semantic Fusion Learning24 Jun 2024
- 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendation15 Jun 2024
- 2024Exploring User Retrieval Integration towards Large Language Models for Cross-Domain Sequential Recommendation5 Jun 2024
- 2024A Survey of Latent Factor Models in Recommender Systems28 May 2024
- 2024Diffusion-based Contrastive Learning for Sequential Recommendation15 May 2024
- 2024Contrastive Learning Method for Sequential Recommendation based on Multi-Intention Disentanglement28 Apr 2024
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendation4 Apr 2024
- 2024Leave No One Behind: Online Self-Supervised Self-Distillation for Sequential Recommendation22 Mar 2024
- 2024CrossVideo: Self-supervised Cross-modal Contrastive Learning for Point Cloud Video Understanding17 Jan 2024
- 2024End-to-end Learnable Clustering for Intent Learning in Recommendation11 Jan 2024
- 2023On the Effectiveness of Unlearning in Session-Based Recommendation22 Dec 2023
- 2023Embedding in Recommender Systems: A Survey28 Oct 2023
- 2023AdaptSSR: Pre-training User Model with Augmentation-Adaptive Self-Supervised Ranking15 Oct 2023
- 2023RUEL: Retrieval-Augmented User Representation with Edge Browser Logs for Sequential Recommendation19 Sep 2023
- 2023Turning Dross Into Gold Loss: is BERT4Rec really better than SASRec?14 Sep 2023
- 2023MAP: A Model-agnostic Pretraining Framework for Click-through Rate Prediction3 Aug 2023
- 2023Self Contrastive Learning for Session-based Recommendation2 Jun 2023
- 2023Multi-behavior Self-supervised Learning for Recommendation22 May 2023
- 2023Graph Masked Autoencoder for Sequential Recommendation8 May 2023
- 2023Deep Stable Multi-Interest Learning for Out-of-distribution Sequential Recommendation12 Apr 2023
- 2023Mutual Wasserstein Discrepancy Minimization for Sequential Recommendation28 Jan 2023
- 2022Uniform Sequence Better: Time Interval Aware Data Augmentation for Sequential Recommendation16 Dec 2022
- 2022FELRec: Efficient Handling of Item Cold-Start With Dynamic Representation Learning in Recommender Systems30 Oct 2022
- 2022ContrastVAE: Contrastive Variational AutoEncoder for Sequential Recommendation27 Aug 2022
- 2022Generating Negative Samples for Sequential Recommendation7 Aug 2022
- 2022A Systematic Review and Replicability Study of BERT4Rec for Sequential Recommendation15 Jul 2022
- 2022Improving Multi-Interest Network with Stable Learning14 Jul 2022
- 2022Knowledge Graph Contrastive Learning for Recommendation2 May 2022
- 2022Determinantal Point Process Likelihoods for Sequential Recommendation25 Apr 2022
- 2022Learnable Model Augmentation Self-Supervised Learning for Sequential Recommendation21 Apr 2022
50 newest of 56 All 56 (JSON)
- 2025Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendationcited by 6
- 2024RaSeRec: Retrieval-Augmented Sequential Recommendationcited by 3
- 2023RUEL: Retrieval-Augmented User Representation with Edge Browser Logs for Sequential Recommendationcited by 2
- 2026Retrieve-then-Adapt: Retrieval-Augmented Test-Time Adaptation for Sequential Recommendationcited by 0
- 2026Retrieve-then-Adapt: Retrieval-Augmented Test-Time Adaptation for Sequential Recommendation7 Apr 2026
- 2025Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendation6 Mar 2025
- 2024RaSeRec: Retrieval-Augmented Sequential Recommendation24 Dec 2024
- 2023RUEL: Retrieval-Augmented User Representation with Edge Browser Logs for Sequential Recommendation19 Sep 2023
- 2022Intent Contrastive Learning for Sequential Recommendationcited by 90
- 2022Knowledge Graph Contrastive Learning for Recommendationcited by 69
- 2021Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuningcited by 46
- 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendationcited by 35
- 2023Turning Dross Into Gold Loss: is BERT4Rec really better than SASRec?cited by 30
- 2022A Systematic Review and Replicability Study of BERT4Rec for Sequential Recommendationcited by 22
- 2022ContrastVAE: Contrastive Variational AutoEncoder for Sequential Recommendationcited by 19
- 2023Graph Masked Autoencoder for Sequential Recommendationcited by 19
- 2023Embedding in Recommender Systems: A Surveycited by 19
- 2024Exploring User Retrieval Integration towards Large Language Models for Cross-Domain Sequential Recommendationcited by 19
- 2022Uniform Sequence Better: Time Interval Aware Data Augmentation for Sequential Recommendationcited by 16
- 2024Scalable Cross-Entropy Loss for Sequential Recommendations with Large Item Catalogscited by 15
12 most cited of 49 All 49 (JSON)
- 2026Cross-Country Code-Mixing for Generative Recommendation24 Sep 2026
- 2026User Representation via Cross Multi-source Behavior Pre-training for Mobile Games1 Sep 2026
- 2026GOD: Enhancing Generalization via Deep Grafting for Sequential Recommendation17 Aug 2026
- 2026SAERec: Constructing Fine-grained Interpretable Intents Priors via Sparse Autoencoders for Recommendation17 Jun 2026
- 2026Generative Archetype-Grounded Item Representations for Sequential Recommendation9 Jun 2026
- 2026Rethinking Convolutional Networks for Attribute-Aware Sequential Recommendation6 May 2026
- 2026ID and Graph View Contrastive Learning with Multi-View Attention Fusion for Sequential Recommendation15 Apr 2026
- 2025Warmer for Less: A Cost-Efficient Strategy for Cold-Start Recommendations at Pinterest19 Dec 2025
- 2025Quantifying the Potential to Escape Filter Bubbles: A Behavior-Aware Measure via Contrastive Simulation27 Nov 2025
- 2025Sequential Data Augmentation for Generative Recommendation17 Sep 2025
- 2024Scaling Sequential Recommendation Models with Transformers10 Dec 2024
- 2024Temporal Linear Item-Item Model for Sequential Recommendation10 Dec 2024
12 newest of 49 All 49 (JSON)