From a Static Multi-Level Small Semantic Codebook to a Dynamic Single-Level Large Semantic Codebook for Generative Recommendation
Not on the map. Why?
Abstract (arXiv)
Generative recommendation represents each item with a sequence of discrete Semantic IDs (SIDs) and predicts the sequence to retrieve the next item. Typical systems use multi-level residual quantization, which increases autoregressive decoding cost and creates a large hierarchical space that may be sparsely occupied. Static codebooks also become misaligned with current traffic as new items arrive and exposure distributions change. We propose a single-level large semantic codebook that replaces multiple residual semantic codes with one semantic token while retaining a separate collaborative disambiguation token to reduce item collisions. We further introduce an exposure-aware dynamic update mechanism based on temporal weight decay, exponential moving-average center updates, and an exposure-weighted penalty on SID changes. We also develop an offline evaluation framework covering representation quality, code utilization, cluster load, full-SID collision, and temporal stability. On two public datasets, the two-level SID improves mean Recall@10 by 5.0%-8.8% and mean NDCG@10 by 4.1%-5.1% for OneRec-V1, and by 7.1%-8.7% and 3.8%-8.5%, respectively, for OneRec-V2. Dynamic updating provides further gains on KuaiRec. Across three serving architectures, the shorter SID reduces estimated autoregressive-decoding FLOPs by 47.93%-48.70% and increases single-card QPS by 28.57%-47.0%. A five-day online A/B test serving 2.5% of production traffic improves the primary consumption metric by 0.792%.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 30 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
28 of 30 references.
References · 28
- 2017Neural Discrete Representation Learningcited by 4,712
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2015Image-based Recommendations on Styles and Substitutescited by 706
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
- 2022Transformer Memory as a Differentiable Search Indexcited by 247
- 2023Recommender Systems with Generative Retrievalcited by 198
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
- 2024Learnable Item Tokenization for Generative Recommendationcited by 110
- 2022KuaiRec: A Fully-observed Dataset and Insights for Evaluating Recommender Systemscited by 96
16 more
- 2023Learning to Tokenize for Generative Retrievalcited by 68
- 2025Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense Representationscited by 35
- 2024Generative Recommender with End-to-End Learnable Item Tokenizationcited by 34
- 2025Generating Long Semantic IDs in Parallel for Recommendationcited by 30
- 2025OneRec-V2 Technical Reportcited by 29
- 2026Differentiable Semantic ID for Generative Recommendationcited by 19
- 2025REG4Rec: Reasoning-Enhanced Generative Model for Large-Scale Recommendation Systemscited by 18
- 2023Generative Retrieval with Semantic Tree-Structured Item Identifiers via Contrastive Learningcited by 12
- 2025LLaDA-Rec: Discrete Diffusion for Parallel Semantic ID Generation in Generative Recommendationcited by 10
- 2024Enhancing Item Tokenization for Generative Recommendation through Self-Improvementcited by 9
- 2025Pre-training Generative Recommender with Multi-Identifier Item Tokenizationcited by 4
- 2025A Simple Contrastive Framework Of Item Tokenization For Generative Recommendationcited by 4
- 2026Decoupled Residual Quantization for Robust Semantic IDs in Recommendationcited by 3
- 2021Online k-means Clustering on Arbitrary Data Streamscited by 2
- 2026MERGE: Next-Generation Item Indexing Paradigm for Large-Scale Streaming Recommendationcited by 2
- 2026SSRLive: Live Streaming Recommendation with Dynamic Semantic IDcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Semantics Meet Signals: Dual Codebook Representationl Learning for Generative Recommendation
- 2025Understanding Generative Recommendation with Semantic IDs from a Model-scaling View
- 2026VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation
- 2026PRISM: Purified Representation and Integrated Semantic Modeling for Generative Sequential Recommendation
- 2026Masked Diffusion Generative Recommendation
- 2026Conditional Memory Enhanced Item Representation for Generative Recommendation
- 2026Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation
- 2026FineSID: Scalable and Efficient Semantic Identifier Learning for Generative Recommendation