mlsanityData to 7 Oct 2026

Generate and Instantiate What You Prefer: Text-Guided Diffusion for Sequential Recommendation

arXiv 2410.13428 ↗First posted 17 Oct 2024cs.IRcited by 6

On the map: Diffusion models → Diffusion recommenders

Abstract (arXiv)

Recent advancements in generative recommendation systems, particularly in the realm of sequential recommendation tasks, have shown promise in enhancing generalization to new items. Among these approaches, diffusion-based generative recommendation has emerged as an effective tool, leveraging its ability to capture data distributions and generate high-quality samples. Despite effectiveness, two primary challenges have been identified: 1) the lack of consistent modeling of data distribution for oracle items; and 2) the difficulty in scaling to more informative control signals beyond historical interactions. These issues stem from the uninformative nature of ID embeddings, which necessitate random initialization and limit the incorporation of additional control signals. To address these limitations, we propose iDreamRec to involve more concrete prior knowledge to establish item embeddings, particularly through detailed item text descriptions and advanced Text Embedding Models (TEM). More importantly, by converting item descriptions into embeddings aligned with TEM, we enable the integration of intention instructions as control signals to guide the generation of oracle items. Experimental results on four datasets demonstrate that iDreamRec not only outperforms existing diffusion-based generative recommenders but also facilitates the incorporation of intention instructions for more precise and effective recommendation generation.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Diffusion recommenders, one of 14 directions in Diffusion models. Builds on 41 of its 60 references that are in the map. First posted on arXiv 17 Oct 2024.

Builds on

41 of 60 references.

Closest ancestors · 6

Same direction, newest first

  1. 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusion31 Oct
  2. 2023LD4MRec: Simplifying and Powering Diffusion Model for Multimedia Recommendation27 Sep
  3. 2023RecFusion: A Binomial Diffusion Process for 1D Data for Recommendation15 Jun
  4. 2023Conditional Denoising Diffusion for Sequential Recommendation22 Apr
  5. 2023A Diffusion model for POI recommendation14 Apr
  6. 2023DiffuRec: A Diffusion Model for Sequential Recommendation3 Apr

Other references · 35

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  9. 2020Longformer: The Long-Document Transformercited by 3,362
  10. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  11. 2018Self-Attentive Sequential Recommendationcited by 1,169
  12. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
23 more
  1. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  2. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
  3. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  4. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  5. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
  6. 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
  7. 2022Text and Code Embeddings by Contrastive Pre-Trainingcited by 358
  8. 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
  9. 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 336
  10. 2024Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoderscited by 213
  11. 2021Whitening Sentence Representations for Better Semantics and Faster Retrievalcited by 198
  12. 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 184
  13. 2023LLMRec: Large Language Models with Graph Augmentation for Recommendationcited by 171
  14. 2023Representation Learning with Large Language Models for Recommendationcited by 155
  15. 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
  16. 2019BIVA: A Very Deep Hierarchy of Latent Variables for Generative Modelingcited by 109
  17. 2023Diffusion Recommender Modelcited by 87
  18. 2023Dirichlet Diffusion Score Model for Biological Sequence Generationcited by 73
  19. 2023A Bi-Step Grounding Paradigm for Large Language Models in Recommendation Systemscited by 73
  20. 2023On Diffusion Modeling for Anomaly Detectioncited by 71
  21. 2023Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistentcited by 58
  22. 2024Consistent Diffusion Meets Tweedie: Training Exact Ambient Diffusion Models with Noisy Datacited by 44
  23. 2023E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendationcited by 39

Built on by

Cited by year

Citing papers per year: 2025: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024DimeRec: A Unified Framework for Enhanced Sequential Recommendation via Generative Diffusion Models
  2. 2026Masked Diffusion Generative Recommendation
  3. 2025Unlocking the Power of Diffusion Models in Sequential Recommendation: A Simple and Effective Approach
  4. 2025MindRec: A Diffusion-driven Coarse-to-Fine Paradigm for Generative Recommendation
  5. 2025LLaDA-Rec: Discrete Diffusion for Parallel Semantic ID Generation in Generative Recommendation
  6. 2023Diffusion Augmentation for Sequential Recommendation
  7. 2024A Survey on Diffusion Models for Recommender Systems
  8. 2025A Survey on Generative Recommendation: Data, Model, and Tasks