CoFiRec: Coarse-to-Fine Tokenization for Generative Recommendation
Not on the map. Why?
Abstract (arXiv)
In web environments, user preferences are often refined progressively as users move from browsing broad categories to exploring specific items. However, existing generative recommenders overlook this natural refinement process. Generative recommendation formulates next-item prediction as autoregressive generation over tokenized user histories, where each item is represented as a sequence of discrete tokens. Prior models typically fuse heterogeneous attributes such as ID, category, title, and description into a single embedding before quantization, which flattens the inherent semantic hierarchy of items and fails to capture the gradual evolution of user intent during web interactions. To address this limitation, we propose CoFiRec, a novel generative recommendation framework that explicitly incorporates the Coarse-to-Fine nature of item semantics into the tokenization process. Instead of compressing all attributes into a single latent space, CoFiRec decomposes item information into multiple semantic levels, ranging from high-level categories to detailed descriptions and collaborative filtering signals. Based on this design, we introduce the CoFiRec Tokenizer, which tokenizes each level independently while preserving structural order. During autoregressive decoding, the language model is instructed to generate item tokens from coarse to fine, progressively modeling user intent from general interests to specific item-level interests. Experiments across multiple public benchmarks and backbones demonstrate that CoFiRec outperforms existing methods, offering a new perspective for generative recommendation. Theoretically, we prove that structured tokenization leads to lower dissimilarity between generated and ground truth items, supporting its effectiveness in generative recommendation. Our code is available at https://github.com/YennNing/CoFiRec.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 34 of its 40 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
34 of 40 references.
References · 34
- 2017Attention Is All You Needcited by 60,361
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2015Image-based Recommendations on Styles and Substitutescited by 706
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
- 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 463
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
22 more
- 2023Recommender Systems with Generative Retrievalcited by 198
- 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
- 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
- 2024Learnable Item Tokenization for Generative Recommendationcited by 110
- 2024Data-efficient Fine-tuning for LLM-based Recommendationcited by 104
- 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
- 2023CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendationcited by 100
- 2017Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networkscited by 84
- 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusioncited by 74
- 2023A Bi-Step Grounding Paradigm for Large Language Models in Recommendation Systemscited by 73
- 2023Collaborative Large Language Model for Recommender Systemscited by 64
- 2023LlamaRec: Two-Stage Recommendation using Large Language Models for Rankingcited by 53
- 2024IDGenRec: LLM-RecSys Alignment with Textual ID Learningcited by 53
- 2025MTGR: Industrial-Scale Generative Recommendation Framework in Meituancited by 49
- 2023Leveraging Large Language Models for Pre-trained Recommender Systemscited by 42
- 2023E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendationcited by 39
- 2023Bridging Items and Language: A Transition Paradigm for Large Language Model-Based Recommendationcited by 29
- 2025Order-agnostic Identifier for Large Language Model-based Generative Recommendationcited by 21
- 2023Language Models As Semantic Indexerscited by 20
- 2025ActionPiece: Contextually Tokenizing Action Sequences for Generative Recommendationcited by 18
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Reasoning over Semantic IDs Enhances Generative Recommendationcited by 13
- 2026Prune as You Generate: Online Rollout Pruning for Faster and Better RLVRcited by 10
- 2026CRAB: Codebook Rebalancing for Bias Mitigation in Generative Recommendationcited by 5
- 2026Mixture of Sequence: Theme-Aware Mixture-of-Experts for Long-Sequence Recommendationcited by 4
- 2026HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendationcited by 2
- 2026Graph homophily booster: Reimagining the role of discrete features in heterophilic graph learningcited by 1
- 2026ReMix: Reinforcement routing for mixtures of LoRAs in LLM finetuningcited by 1
- 2026An Embarrassingly Simple Graph Heuristic Reveals Shortcut-Solvable Benchmarks for Sequential Recommendationcited by 1
- 2026Trie-Aware Transformers for Generative Recommendationcited by 0
- 2026Plan-to-Synthesis: Cross-City Human Mobility Generation via Semantic Latent Flow Matchingcited by 0
- 2026AlignPoison: Conditional Targeted Poisoning of Generative Recommenders via Decoding-Aligned Prefixescited by 0
- 2026AlignPoison: Conditional Targeted Poisoning of Generative Recommenders via Decoding-Aligned Prefixes10 Oct 2026
- 2026Plan-to-Synthesis: Cross-City Human Mobility Generation via Semantic Latent Flow Matching26 Sep 2026
- 2026HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendation13 Jun 2026
- 2026An Embarrassingly Simple Graph Heuristic Reveals Shortcut-Solvable Benchmarks for Sequential Recommendation8 May 2026
- 2026CRAB: Codebook Rebalancing for Bias Mitigation in Generative Recommendation6 Apr 2026
- 2026Prune as You Generate: Online Rollout Pruning for Faster and Better RLVR25 Mar 2026
- 2026Reasoning over Semantic IDs Enhances Generative Recommendation24 Mar 2026
- 2026ReMix: Reinforcement routing for mixtures of LoRAs in LLM finetuning10 Mar 2026
- 2026Mixture of Sequence: Theme-Aware Mixture-of-Experts for Long-Sequence Recommendation1 Mar 2026
- 2026Trie-Aware Transformers for Generative Recommendation25 Feb 2026
- 2026Graph homophily booster: Reimagining the role of discrete features in heterophilic graph learning6 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2024Enhancing Item Tokenization for Generative Recommendation through Self-Improvement
- 2026PRISM: Purified Representation and Integrated Semantic Modeling for Generative Sequential Recommendation
- 2026GenRec: A Preference-Oriented Generative Framework for Large-Scale Recommendation
- 2025Semantics Meet Signals: Dual Codebook Representationl Learning for Generative Recommendation
- 2025Universal Item Tokenization for Transferable Generative Recommendation
- 2026Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation
- 2026Learning Variable-Length Tokenization for Generative Recommendation
- 2026EchoRec: Multi-Item Prediction-Empowered Generative Recommendation via Cycle-Consistent Preference Alignment