mlsanityData to 7 Oct 2026

LLaDA-Rec: Discrete Diffusion for Parallel Semantic ID Generation in Generative Recommendation

arXiv 2511.06254 ↗First posted 9 Nov 2025cs.IR cs.CLcited by 9

On the map: Diffusion models → Diffusion recommenders

Abstract (arXiv)

Generative recommendation represents each item as a semantic ID, i.e., a sequence of discrete tokens, and generates the next item through autoregressive decoding. While effective, existing autoregressive models face two intrinsic limitations: (1) unidirectional constraints, where causal attention restricts each token to attend only to its predecessors, hindering global semantic modeling; and (2) error accumulation, where the fixed left-to-right generation order causes prediction errors in early tokens to propagate to the predictions of subsequent token. To address these issues, we propose LLaDA-Rec, a discrete diffusion framework that reformulates recommendation as parallel semantic ID generation. By combining bidirectional attention with the adaptive generation order, the approach models inter-item and intra-item dependencies more effectively and alleviates error accumulation. Specifically, our approach comprises three key designs: (1) a parallel tokenization scheme that produces semantic IDs for bidirectional modeling, addressing the mismatch between residual quantization and bidirectional architectures; (2) two masking mechanisms at the user-history and next-item levels to capture both inter-item sequential dependencies and intra-item semantic relationships; and (3) an adapted beam search strategy for adaptive-order discrete diffusion decoding, resolving the incompatibility of standard beam search with diffusion-based generation. Experiments on three real-world datasets show that LLaDA-Rec consistently outperforms both ID-based and state-of-the-art generative recommenders, establishing discrete diffusion as a new paradigm for generative recommendation.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Diffusion recommenders, one of 14 directions in Diffusion models. Builds on 29 of its 44 references that are in the map. First posted on arXiv 9 Nov 2025.

Builds on

29 of 44 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024DimeRec: A Unified Framework for Enhanced Sequential Recommendation via Generative Diffusion Models22 Aug
  2. 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusion31 Oct
  3. 2023DiffuRec: A Diffusion Model for Sequential Recommendation3 Apr

Other references · 26

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2018Self-Attentive Sequential Recommendationcited by 1,169
  5. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  6. 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
  7. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  8. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
  9. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
  10. 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 371
  11. 2024Better & Faster Large Language Models via Multi-token Predictioncited by 344
  12. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
14 more
  1. 2024Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoderscited by 213
  2. 2024Scaling up Masked Diffusion Models on Textcited by 195
  3. 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
  4. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 167
  5. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 145
  6. 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
  7. 2024Learnable Item Tokenization for Generative Recommendationcited by 106
  8. 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
  9. 2022Filter-enhanced MLP is All You Need for Sequential Recommendationcited by 96
  10. 2025A Survey on Diffusion Language Modelscited by 75
  11. 2024EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaborationcited by 55
  12. 2025Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendationcited by 50
  13. 2024Generative Recommender with End-to-End Learnable Item Tokenizationcited by 32
  14. 2025Order-agnostic Identifier for Large Language Model-based Generative Recommendationcited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Masked Diffusion Generative Recommendation
  2. 2025Masked Diffusion for Generative Recommendation
  3. 2025DiffGRM: Diffusion-based Generative Recommendation Model
  4. 2026VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation
  5. 2024Generate and Instantiate What You Prefer: Text-Guided Diffusion for Sequential Recommendation
  6. 2025MindRec: A Diffusion-driven Coarse-to-Fine Paradigm for Generative Recommendation
  7. 2026Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation
  8. 2026Rethinking Generative Recommender Tokenizer: Recsys-Native Encoding and Semantic Quantization Beyond LLMs