mlsanityData to 7 Oct 2026

DiffGRM: Diffusion-based Generative Recommendation Model

arXiv 2510.21805 ↗First posted 21 Oct 2025cs.IR cs.AI cs.LGcited by 4

On the map: Diffusion models → Diffusion recommenders

Abstract (arXiv)

Generative recommendation (GR) is an emerging paradigm that represents each item via a tokenizer as an n-digit semantic ID (SID) and predicts the next item by autoregressively generating its SID conditioned on the user's history. However, two structural properties of SIDs make ARMs ill-suited. First, intra-item consistency: the n digits jointly specify one item, yet the left-to-right causality trains each digit only under its prefix and blocks bidirectional cross-digit evidence, collapsing supervision to a single causal path. Second, inter-digit heterogeneity: digits differ in semantic granularity and predictability, while the uniform next-token objective assigns equal weight to all digits, overtraining easy digits and undertraining hard digits. To address these two issues, we propose DiffGRM, a diffusion-based GR model that replaces the autoregressive decoder with a masked discrete diffusion model (MDM), thereby enabling bidirectional context and any-order parallel generation of SID digits for recommendation. Specifically, we tailor DiffGRM in three aspects: (1) tokenization with Parallel Semantic Encoding (PSE) to decouple digits and balance per-digit information; (2) training with On-policy Coherent Noising (OCN) that prioritizes uncertain digits via coherent masking to concentrate supervision on high-value signals; and (3) inference with Confidence-guided Parallel Denoising (CPD) that fills higher-confidence digits first and generates diverse Top-K candidates. Experiments show consistent gains over strong generative and discriminative recommendation baselines on multiple datasets, improving NDCG@10 by 6.9%-15.5%. Code is available at https://github.com/liuzhao09/DiffGRM.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Diffusion recommenders, one of 14 directions in Diffusion models. Builds on 47 of its 67 references that are in the map. First posted on arXiv 21 Oct 2025.

Builds on

47 of 67 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Distinguished Quantized Guidance for Diffusion-based Sequence Recommendation29 Jan

Other references · 46

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  6. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  7. 2018Self-Attentive Sequential Recommendationcited by 1,169
  8. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  9. 2024Simple and Effective Masked Diffusion Language Modelscited by 800
  10. 2015Image-based Recommendations on Styles and Substitutescited by 702
  11. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  12. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
34 more
  1. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  2. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
  3. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 439
  4. 2022A Continuous Time Framework for Discrete Denoising Modelscited by 437
  5. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
  6. 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 371
  7. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  8. 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 233
  9. 2016Professor Forcing: A New Algorithm for Training Recurrent Networkscited by 214
  10. 2021Autoregressive Diffusion Modelscited by 208
  11. 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 184
  12. 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
  13. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 167
  14. 2022Concrete Score Matching: Generalized Score Matching for Discrete Datacited by 144
  15. 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 137
  16. 2015Minimum Risk Training for Neural Machine Translationcited by 114
  17. 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
  18. 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
  19. 2019Hierarchical Gating Networks for Sequential Recommendationcited by 101
  20. 2024Tokenization Is More Than Compressioncited by 87
  21. 2025Path Planning for Masked Diffusion Model Samplingcited by 79
  22. 2024textitJump Your Steps: Optimizing Sampling Schedule of Discrete Diffusion Modelscited by 40
  23. 2025OneRec Technical Reportcited by 24
  24. 2025Order-agnostic Identifier for Large Language Model-based Generative Recommendationcited by 21
  25. 2025LLM2Rec: Large Language Models Are Powerful Embedding Models for Sequential Recommendationcited by 19
  26. 2025ActionPiece: Contextually Tokenizing Action Sequences for Generative Recommendationcited by 18
  27. 2025Any-Order GPT as Masked Diffusion Model: Decoupling Formulation and Architecturecited by 16
  28. 2024Generative News Recommendationcited by 10
  29. 2024EasyRec: Simple yet Effective Language Models for Recommendationcited by 10
  30. 2024Semantic Convergence: Harmonizing Recommender Systems via Two-Stage Alignment and Behavioral Semantic Tokenizationcited by 9
  31. 2023RecJPQ: Training Large-Catalogue Sequential Recommenderscited by 8
  32. 2024Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential Recommendationcited by 8
  33. 2025Bridging Textual-Collaborative Gap through Semantic Codes for Sequential Recommendationcited by 4
  34. 2025Sequential Data Augmentation for Generative Recommendationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Masked Diffusion for Generative Recommendation
  2. 2025LLaDA-Rec: Discrete Diffusion for Parallel Semantic ID Generation in Generative Recommendation
  3. 2024Generate and Instantiate What You Prefer: Text-Guided Diffusion for Sequential Recommendation
  4. 2023DiffuRec: A Diffusion Model for Sequential Recommendation
  5. 2026Time-Aware Diffusion based on Preference Disentanglement for Generative Recommendation
  6. 2026Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation
  7. 2026Diffusion Language Model for Recommendation
  8. 2025MindRec: A Diffusion-driven Coarse-to-Fine Paradigm for Generative Recommendation