mlsanityData to 7 Oct 2026

Diffusion-based Contrastive Learning for Sequential Recommendation

arXiv 2405.09369 ↗First posted 15 May 2024cs.IRcited by 9

On the map: Diffusion models → Diffusion recommenders

Abstract (arXiv)

Contrastive learning has been effectively utilized to enhance the training of sequential recommendation models by leveraging informative self-supervised signals. Most existing approaches generate augmented views of the same user sequence through random augmentation and subsequently maximize their agreement in the representation space. However, these methods often neglect the rationality of the augmented samples. Due to significant uncertainty, random augmentation can disrupt the semantic information and interest evolution patterns inherent in the original user sequences. Moreover, pulling semantically inconsistent sequences closer in the representation space can render the user sequence embeddings insensitive to variations in user preferences, which contradicts the primary objective of sequential recommendation. To address these limitations, we propose the Context-aware Diffusion-based Contrastive Learning for Sequential Recommendation, named CaDiRec. The core idea is to leverage context information to generate more reasonable augmented views. Specifically, CaDiRec employs a context-aware diffusion model to generate alternative items for the given positions within a sequence. These generated items are aligned with their respective context information and can effectively replace the corresponding original items, thereby generating a positive view of the original sequence. By considering two different augmentations of the same user sequence, we can construct a pair of positive samples for contrastive learning. To ensure representation cohesion, we train the entire framework in an end-to-end manner, with shared item embeddings between the diffusion model and the recommendation model. Extensive experiments on five benchmark datasets demonstrate the advantages of our proposed method over existing baselines.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Diffusion recommenders, one of 14 directions in Diffusion models. Builds on 34 of its 44 references that are in the map. First posted on arXiv 15 May 2024.

Builds on

34 of 44 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusion31 Oct
  2. 2023Conditional Denoising Diffusion for Sequential Recommendation22 Apr
  3. 2023DiffuRec: A Diffusion Model for Sequential Recommendation3 Apr

Other references · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  6. 2018Self-Attentive Sequential Recommendationcited by 1,169
  7. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  8. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  9. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  10. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  11. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  12. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 439
19 more
  1. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  2. 2020Self-supervised Graph Learning for Recommendationcited by 305
  3. 2021ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfercited by 231
  4. 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
  5. 2017Recurrent Neural Networks with Top-k Gains for Session-based Recommendationscited by 165
  6. 2016Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendationcited by 152
  7. 2021Contrastive Learning for Representation Degeneration Problem in Sequential Recommendationcited by 121
  8. 2022Intent Contrastive Learning for Sequential Recommendationcited by 90
  9. 2021AutoGCL: Automated Graph Contrastive Learning via Learnable View Generatorscited by 73
  10. 2021Dynamic Graph Neural Networks for Sequential Recommendationcited by 57
  11. 2021Contrastive Self-supervised Sequential Recommendation with Robust Augmentationcited by 56
  12. 2023Debiased Contrastive Learning for Sequential Recommendationcited by 38
  13. 2023Automated Self-Supervised Learning for Recommendationcited by 37
  14. 2023Dynamically Expandable Graph Convolution for Streaming Recommendationcited by 26
  15. 2022Multi-Behavior Sequential Recommendation with Temporal Graph Transformercited by 20
  16. 2022Equivariant Contrastive Learning for Sequential Recommendationcited by 13
  17. 2023Meta-optimized Contrastive Learning for Sequential Recommendationcited by 10
  18. 2023Dynamic Embedding Size Search with Minimum Regret for Streaming Recommender Systemcited by 7
  19. 2022Improving Contrastive Learning with Model Augmentationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 2.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Intent-aware Diffusion with Contrastive Learning for Sequential Recommendation
  2. 2023Diffusion Augmentation for Sequential Recommendation
  3. 2025Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendation
  4. 2024Dual Conditional Diffusion Models for Sequential Recommendation
  5. 2025Unlocking the Power of Diffusion Models in Sequential Recommendation: A Simple and Effective Approach
  6. 2024Generate and Instantiate What You Prefer: Text-Guided Diffusion for Sequential Recommendation
  7. 2025Diffusion-augmented Graph Contrastive Learning for Collaborative Filter
  8. 2025Distinguished Quantized Guidance for Diffusion-based Sequence Recommendation