Beyond Semantic IDs: Finite-Beam Reachability and Continuous-Query Generation in Generative Recommendation
Not on the map. Why?
Abstract (arXiv)
Generative recommendation (GR) of social media platforms commonly retrieves items by autoregressively decoding discrete Semantic IDs (SIDs) with finite-width beam search. This work examines how this output interface constrains whether held-out targets enter finite returned lists, while distinguishing catalog-wide scoreability from empirical top-K support. We introduce two continuous-query paradigms: CQG-Single generates one retrieval query in a single pass, and CQG-AR autoregressively generates continuous residual updates, retaining step-wise decoding while removing the SID item-token vocabulary, code lookup, and discrete beam expansion. These designs thereby eliminate the SID-specific reachability constraint induced by finite-beam decoding and avoid the technical challenge of aligning a discrete SID vocabulary with the pretrained backbone's vector space. Both methods make every encoded item directly scoreable through dense or approximate-nearest-neighbor retrieval. Under a unified protocol with valid-prefix constrained decoding, CQG-Single exceeds the TIGER-style baseline in all seven runs while using 55.3% as many trainable parameters. CQG-AR remains comparable on ML-1M and is numerically stronger on Beauty and Sports datasets. A controlled depth ablation further shows that additional continuous refinement does not monotonically improve shallow accuracy. These findings motivate decoupling output representation, autoregressive modeling, and retrieval budget when evaluating generative recommendation systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 28 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
25 of 28 references.
References · 25
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2017Neural Discrete Representation Learningcited by 4,712
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2022Transformer Memory as a Differentiable Search Indexcited by 247
- 2023Recommender Systems with Generative Retrievalcited by 198
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
- 2022A Neural Corpus Indexer for Document Retrievalcited by 111
- 2023GPT4Rec: A Generative Framework for Personalized Recommendation and User Interests Interpretationcited by 103
13 more
- 2023DiffuRec: A Diffusion Model for Sequential Recommendationcited by 93
- 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusioncited by 74
- 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussionscited by 73
- 2024EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaborationcited by 58
- 2024IDGenRec: LLM-RecSys Alignment with Textual ID Learningcited by 53
- 2026Differentiable Semantic ID for Generative Recommendationcited by 19
- 2024Unifying Generative and Dense Retrieval for Sequential Recommendationcited by 18
- 2025Reasoning-Enhanced Domain-Adaptive Pretraining of Multimodal Large Language Models for Short Video Content Governancecited by 16
- 2025Audio-Enhanced Vision-Language Modeling with Latent Space Broadening for High Quality Data Expansioncited by 15
- 2025Diffusion Generative Recommendation with Continuous Tokenscited by 9
- 2024IPS: In-Prompt Process Supervision for Short Video Content Moderationcited by 7
- 2026Expressiveness Limits of Autoregressive Semantic ID Generation in Generative Recommendationcited by 4
- 2026UniGRec: Unified Generative Recommendation with Soft Identifiers for End-to-End Optimizationcited by 1
Built on by
Not cited yet.