LLaDA-Rec: Discrete Diffusion for Parallel Semantic ID Generation in Generative Recommendation
On the map: Diffusion models → Diffusion recommenders
Abstract (arXiv)
Generative recommendation represents each item as a semantic ID, i.e., a sequence of discrete tokens, and generates the next item through autoregressive decoding. While effective, existing autoregressive models face two intrinsic limitations: (1) unidirectional constraints, where causal attention restricts each token to attend only to its predecessors, hindering global semantic modeling; and (2) error accumulation, where the fixed left-to-right generation order causes prediction errors in early tokens to propagate to the predictions of subsequent token. To address these issues, we propose LLaDA-Rec, a discrete diffusion framework that reformulates recommendation as parallel semantic ID generation. By combining bidirectional attention with the adaptive generation order, the approach models inter-item and intra-item dependencies more effectively and alleviates error accumulation. Specifically, our approach comprises three key designs: (1) a parallel tokenization scheme that produces semantic IDs for bidirectional modeling, addressing the mismatch between residual quantization and bidirectional architectures; (2) two masking mechanisms at the user-history and next-item levels to capture both inter-item sequential dependencies and intra-item semantic relationships; and (3) an adapted beam search strategy for adaptive-order discrete diffusion decoding, resolving the incompatibility of standard beam search with diffusion-based generation. Experiments on three real-world datasets show that LLaDA-Rec consistently outperforms both ID-based and state-of-the-art generative recommenders, establishing discrete diffusion as a new paradigm for generative recommendation.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Diffusion recommenders, one of 14 directions in Diffusion models. Builds on 29 of its 44 references that are in the map. First posted on arXiv 9 Nov 2025.
Builds on
29 of 44 references.
Closest ancestors · 3
Same direction, newest first
- 2024DimeRec: A Unified Framework for Enhanced Sequential Recommendation via Generative Diffusion Models22 Aug
- 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusion31 Oct
- 2023DiffuRec: A Diffusion Model for Sequential Recommendation3 Apr
Other references · 26
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2025Qwen3 Technical Reportcited by 8,195
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
- 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
- 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 371
- 2024Better & Faster Large Language Models via Multi-token Predictioncited by 344
- 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
14 more
- 2024Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoderscited by 213
- 2024Scaling up Masked Diffusion Models on Textcited by 195
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 167
- 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 145
- 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
- 2024Learnable Item Tokenization for Generative Recommendationcited by 106
- 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
- 2022Filter-enhanced MLP is All You Need for Sequential Recommendationcited by 96
- 2025A Survey on Diffusion Language Modelscited by 75
- 2024EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaborationcited by 55
- 2025Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendationcited by 50
- 2024Generative Recommender with End-to-End Learnable Item Tokenizationcited by 32
- 2025Order-agnostic Identifier for Large Language Model-based Generative Recommendationcited by 21
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026PROMISE: Process Reward Models Unlock Test-Time Scaling Laws in Generative Recommendationscited by 2
- 2026Time-Aware Diffusion based on Preference Disentanglement for Generative Recommendationcited by 1
- 2026Diffusion-Proof: Recipe for Formal Theorem Proving Beyond Auto-Regressive Generationcited by 0
- 2026ShopX: A Foundation Model for Intent-to-Item Fulfillment in Agentic Shoppingcited by 0
- 2026Diffusion Language Model for Recommendationcited by 0
- 2026From a Static Multi-Level Small Semantic Codebook to a Dynamic Single-Level Large Semantic Codebook for Generative Recommendationcited by 0
- 2026Adaptive Item-based Collaborative Structures via Noise Rescheduling in Diffusion for Generative Recommendationcited by 0
- 2026PRQ-KMeans: Projection Residual Quantization for Semantic ID Tokenizationcited by 0
- 2026X-Rec Technical Reportcited by 0
- 2026X-Rec Technical Report24 Sep 2026
- 2026PRQ-KMeans: Projection Residual Quantization for Semantic ID Tokenization25 Aug 2026
- 2026Adaptive Item-based Collaborative Structures via Noise Rescheduling in Diffusion for Generative Recommendation24 Aug 2026
- 2026From a Static Multi-Level Small Semantic Codebook to a Dynamic Single-Level Large Semantic Codebook for Generative Recommendation21 Aug 2026
- 2026Diffusion Language Model for Recommendation23 Jul 2026
- 2026ShopX: A Foundation Model for Intent-to-Item Fulfillment in Agentic Shopping30 Jun 2026
- 2026Diffusion-Proof: Recipe for Formal Theorem Proving Beyond Auto-Regressive Generation17 Jun 2026
- 2026Time-Aware Diffusion based on Preference Disentanglement for Generative Recommendation1 Jun 2026
- 2026PROMISE: Process Reward Models Unlock Test-Time Scaling Laws in Generative Recommendations8 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Masked Diffusion Generative Recommendation
- 2025Masked Diffusion for Generative Recommendation
- 2025DiffGRM: Diffusion-based Generative Recommendation Model
- 2026VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation
- 2024Generate and Instantiate What You Prefer: Text-Guided Diffusion for Sequential Recommendation
- 2025MindRec: A Diffusion-driven Coarse-to-Fine Paradigm for Generative Recommendation
- 2026Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation
- 2026Rethinking Generative Recommender Tokenizer: Recsys-Native Encoding and Semantic Quantization Beyond LLMs