mlsanityData to 7 Oct 2026

Contrastive Self-supervised Sequential Recommendation with Robust Augmentation

arXiv 2108.06479 ↗First posted 14 Aug 2021cs.IR cs.AIcited by 56

Not on the map. Why?

Abstract (arXiv)

Sequential Recommendationdescribes a set of techniques to model dynamic user behavior in order to predict future interactions in sequential user data. At their core, such approaches model transition probabilities between items in a sequence, whether through Markov chains, recurrent networks, or more recently, Transformers. However both old and new issues remain, including data-sparsity and noisy data; such issues can impair the performance, especially in complex, parameter-hungry models. In this paper, we investigate the application of contrastive Self-Supervised Learning (SSL) to the sequential recommendation, as a way to alleviate some of these issues. Contrastive SSL constructs augmentations from unlabelled instances, where agreements among positive pairs are maximized. It is challenging to devise a contrastive SSL framework for a sequential recommendation, due to its discrete nature, correlations among items, and skewness of length distributions. To this end, we propose a novel framework, Contrastive Self-supervised Learning for sequential Recommendation (CoSeRec). We introduce two informative augmentation operators leveraging item correlations to create high-quality views for contrastive learning. Experimental results on three real-world datasets demonstrate the effectiveness of the proposed method on improving model performance and the robustness against sparse and noisy data. Our implementation is available online at urlhttps://github.com/YChen1993/CoSeRec

Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). Builds on 39 of its 52 references that are in the map. First posted on arXiv 14 Aug 2021.

Builds on

39 of 52 references.

References · 39

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  7. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  8. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  9. 2018Self-Attentive Sequential Recommendationcited by 1,169
  10. 2018Deep Graph Infomaxcited by 1,101
  11. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  12. 2020What Makes for Good Views for Contrastive Learning?cited by 843
27 more
  1. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
  2. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
  3. 2015Image-based Recommendations on Styles and Substitutescited by 702
  4. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  5. 2019Neural Graph Collaborative Filteringcited by 660
  6. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  7. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  8. 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
  9. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  10. 2020Self-supervised Graph Learning for Recommendationcited by 305
  11. 2020DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representationscited by 249
  12. 2020What Should Not Be Contrastive in Contrastive Learningcited by 224
  13. 2020CLEAR: Contrastive Learning for Sentence Representationcited by 186
  14. 2020CERT: Contrastive Self-supervised Learning for Language Understandingcited by 169
  15. 2016Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendationcited by 152
  16. 2020Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learningcited by 90
  17. 2017Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networkscited by 84
  18. 2020Denoising Implicit Feedback for Recommendationcited by 80
  19. 2013Empirical Analysis of Predictive Algorithms for Collaborative Filteringcited by 47
  20. 2021Augmenting Sequential Recommendation with Pseudo-Prior Items via Reversely Pre-training Transformercited by 45
  21. 2020Try This Instead: Personalized and Interpretable Substitute Recommendationcited by 34
  22. 2021Modeling Sequences as Distributions with Uncertainty for Sequential Recommendationcited by 22
  23. 2020BasConv: Aggregating Heterogeneous Interactions for Basket Recommendation with Graph Convolutional Neural Networkcited by 16
  24. 2020D'ej`a vu: A Contextualized Temporal Attention Mechanism for Sequential Recommendationcited by 14
  25. 2020Contrastive Learning for Sequential Recommendationcited by 13
  26. 2020Self-supervised Learning for Large-scale Item Recommendationscited by 11
  27. 2019JSCN: Joint Spectral Convolutional Network for Cross Domain Recommendationcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 12; 2023: 11; 2024: 16; 2025: 5; 2026: 9.

56 papers.

Sort:

By area:

  1. 2022Intent Contrastive Learning for Sequential Recommendationcited by 90
  2. 2022Knowledge Graph Contrastive Learning for Recommendationcited by 69
  3. 2021Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuningcited by 46
  4. 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendationcited by 35
  5. 2023Turning Dross Into Gold Loss: is BERT4Rec really better than SASRec?cited by 30
  6. 2022A Systematic Review and Replicability Study of BERT4Rec for Sequential Recommendationcited by 22
  7. 2022ContrastVAE: Contrastive Variational AutoEncoder for Sequential Recommendationcited by 19
  8. 2023Graph Masked Autoencoder for Sequential Recommendationcited by 19
  9. 2023Embedding in Recommender Systems: A Surveycited by 19
  10. 2024Exploring User Retrieval Integration towards Large Language Models for Cross-Domain Sequential Recommendationcited by 19
  11. 2022Uniform Sequence Better: Time Interval Aware Data Augmentation for Sequential Recommendationcited by 16
  12. 2024Scalable Cross-Entropy Loss for Sequential Recommendations with Large Item Catalogscited by 15
38 more
  1. 2021Pre-training Graph Neural Network for Cross Domain Recommendationcited by 14
  2. 2023Multi-behavior Self-supervised Learning for Recommendationcited by 11
  3. 2023MAP: A Model-agnostic Pretraining Framework for Click-through Rate Predictioncited by 10
  4. 2024End-to-end Learnable Clustering for Intent Learning in Recommendationcited by 10
  5. 2024Diffusion-based Contrastive Learning for Sequential Recommendationcited by 9
  6. 2022Determinantal Point Process Likelihoods for Sequential Recommendationcited by 7
  7. 2024Scaling Sequential Recommendation Models with Transformerscited by 7
  8. 2021Modeling Dynamic Attributes for Next Basket Recommendationcited by 6
  9. 2024CrossVideo: Self-supervised Cross-modal Contrastive Learning for Point Cloud Video Understandingcited by 6
  10. 2024A Comprehensive Survey on Self-Supervised Learning for Recommendationcited by 6
  11. 2025Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendationcited by 6
  12. 2022Improving Contrastive Learning with Model Augmentationcited by 5
  13. 2023On the Effectiveness of Unlearning in Session-Based Recommendationcited by 4
  14. 2024UniRec: A Dual Enhancement of Uniformity and Frequency in Sequential Recommendationscited by 4
  15. 2022ELECRec: Training Sequential Recommenders as Discriminatorscited by 3
  16. 2022Generating Negative Samples for Sequential Recommendationcited by 3
  17. 2023Mutual Wasserstein Discrepancy Minimization for Sequential Recommendationcited by 3
  18. 2023Self Contrastive Learning for Session-based Recommendationcited by 3
  19. 2024Temporal Linear Item-Item Model for Sequential Recommendationcited by 3
  20. 2024RaSeRec: Retrieval-Augmented Sequential Recommendationcited by 3
  21. 2023Deep Stable Multi-Interest Learning for Out-of-distribution Sequential Recommendationcited by 2
  22. 2023RUEL: Retrieval-Augmented User Representation with Edge Browser Logs for Sequential Recommendationcited by 2
  23. 2023AdaptSSR: Pre-training User Model with Augmentation-Adaptive Self-Supervised Rankingcited by 2
  24. 2024Leave No One Behind: Online Self-Supervised Self-Distillation for Sequential Recommendationcited by 2
  25. 2025Sequential Data Augmentation for Generative Recommendationcited by 2
  26. 2025Quantifying the Potential to Escape Filter Bubbles: A Behavior-Aware Measure via Contrastive Simulationcited by 2
  27. 2022Learnable Model Augmentation Self-Supervised Learning for Sequential Recommendationcited by 1
  28. 2024Adapting Job Recommendations to User Preference Drift with Behavioral-Semantic Fusion Learningcited by 1
  29. 2025Warmer for Less: A Cost-Efficient Strategy for Cold-Start Recommendations at Pinterestcited by 1
  30. 2026Generative Archetype-Grounded Item Representations for Sequential Recommendationcited by 1
  31. 2022Improving Multi-Interest Network with Stable Learningcited by 0
  32. 2022FELRec: Efficient Handling of Item Cold-Start With Dynamic Representation Learning in Recommender Systemscited by 0
  33. 2024Contrastive Learning Method for Sequential Recommendation based on Multi-Intention Disentanglementcited by 0
  34. 2024A Survey of Latent Factor Models in Recommender Systemscited by 0
  35. 2024Multi-intent Aware Contrastive Learning for Sequential Recommendationcited by 0
  36. 2025SimDiffRec: Semantic Similarity-Guided Diffusion for Contrastive Sequential Recommendationcited by 0
  37. 2026Retrieve-then-Adapt: Retrieval-Augmented Test-Time Adaptation for Sequential Recommendationcited by 0
  38. 2026ID and Graph View Contrastive Learning with Multi-View Attention Fusion for Sequential Recommendationcited by 0

50 most cited of 56 All 56 (JSON)