Guiding the coarse levels of semantic IDs makes the fine levels learnable
Not on the map. Why?
Abstract (arXiv)
Generative retrieval represents each item by a short Semantic ID and casts recommendation as autoregressive generation of that sequence. Because the tokenizer is trained independently to reconstruct an item embedding, its codes are aligned with neither the downstream LLM nor the end task. Nearly every SID system therefore spends extra effort to bridge this gap--alignment corpora, reasoning/RL, or per-token encoders to make codes legible, or learned tokenizer supervision to make them task-aware--yet the recovered meaning is content-derived and may not be the meaning the task needs. We introduce Guided SID, which instead makes the levels that matter most meaningful by construction: we force the coarse RQ-VAE levels to encode a predefined categorical attribute--chosen to be text-grounded (hence legible to the LLM) and task-relevant--by deterministic supervised index assignment (overriding nearest-neighbor selection with the attribute label) while keeping the codebooks learnable (they still receive reconstruction gradients). A trie-merge construction maps any high-cardinality or set-valued attribute onto the fixed code budget while keeping merged buckets semantically coherent. Guiding costs nothing intrinsically: collision and reconstruction match or beat the vanilla baseline despite pinning the coarse level. In a matched end-to-end A/B differing only in the SID encoding, the guided retriever improves recall@k at every list length we measure (1.36x at k=1, 1.39x at k=10), raises mean reciprocal rank from 0.0260 to 0.0355, and predicts the pre-defined attribute 4.2x more often.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 20 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
16 of 20 references.
References · 16
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
- 2024Learnable Item Tokenization for Generative Recommendationcited by 110
- 2025PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendationscited by 30
- 2026Differentiable Semantic ID for Generative Recommendationcited by 19
- 2025REG4Rec: Reasoning-Enhanced Generative Model for Large-Scale Recommendation Systemscited by 18
- 2026Reasoning over Semantic IDs Enhances Generative Recommendationcited by 13
- 2025HiD-VAE: Interpretable Generative Recommendation via Hierarchical and Disentangled Semantic IDscited by 12
- 2025GPR: Towards a Generative Pre-trained One-Model Paradigm for Large-Scale Advertising Recommendationcited by 9
- 2025PinRec: Unified Generative Retrieval for Pinterest Recommender Systemscited by 8
- 2026Generative Recommendation for Large-Scale Advertisingcited by 7
- 2026Stop Treating Collisions Equally: Qualification-Aware Semantic ID Learning for Recommendation at Industrial Scalecited by 6
- 2026OneRanker: Unified Generation and Ranking with One Model in Industrial Advertising Recommendationcited by 4
4 more
- 2025Bi-Level Optimization for Generative Recommendation: Bridging Tokenization and Generationcited by 3
- 2025Taming the Long Tail: Denoising Collaborative Information for Robust Semantic ID Generationcited by 3
- 2026LLMs Need Encoders for Semantic IDs Toocited by 2
- 2026FedMM: Federated Collaborative Signal Quantization for Multi-Market CTR Predictioncited by 1
Built on by
Not cited yet.