mlsanityData to 14 Oct 2026

CoFiRec: Coarse-to-Fine Tokenization for Generative Recommendation

arXiv 2511.22707 ↗First posted 27 Nov 2025cs.IR cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

In web environments, user preferences are often refined progressively as users move from browsing broad categories to exploring specific items. However, existing generative recommenders overlook this natural refinement process. Generative recommendation formulates next-item prediction as autoregressive generation over tokenized user histories, where each item is represented as a sequence of discrete tokens. Prior models typically fuse heterogeneous attributes such as ID, category, title, and description into a single embedding before quantization, which flattens the inherent semantic hierarchy of items and fails to capture the gradual evolution of user intent during web interactions. To address this limitation, we propose CoFiRec, a novel generative recommendation framework that explicitly incorporates the Coarse-to-Fine nature of item semantics into the tokenization process. Instead of compressing all attributes into a single latent space, CoFiRec decomposes item information into multiple semantic levels, ranging from high-level categories to detailed descriptions and collaborative filtering signals. Based on this design, we introduce the CoFiRec Tokenizer, which tokenizes each level independently while preserving structural order. During autoregressive decoding, the language model is instructed to generate item tokens from coarse to fine, progressively modeling user intent from general interests to specific item-level interests. Experiments across multiple public benchmarks and backbones demonstrate that CoFiRec outperforms existing methods, offering a new perspective for generative recommendation. Theoretically, we prove that structured tokenization leads to lower dissimilarity between generated and ground truth items, supporting its effectiveness in generative recommendation. Our code is available at https://github.com/YennNing/CoFiRec.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 34 of its 40 references that are in the map. First posted on arXiv 27 Nov 2025.

Builds on

34 of 40 references.

References · 34

  1. 2017Attention Is All You Needcited by 60,361
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2018Self-Attentive Sequential Recommendationcited by 1,184
  5. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
  6. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  7. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
  8. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  9. 2015Image-based Recommendations on Styles and Substitutescited by 706
  10. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
  11. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 463
  12. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
22 more
  1. 2023Recommender Systems with Generative Retrievalcited by 198
  2. 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
  3. 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
  4. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
  5. 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
  6. 2024Learnable Item Tokenization for Generative Recommendationcited by 110
  7. 2024Data-efficient Fine-tuning for LLM-based Recommendationcited by 104
  8. 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
  9. 2023CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendationcited by 100
  10. 2017Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networkscited by 84
  11. 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusioncited by 74
  12. 2023A Bi-Step Grounding Paradigm for Large Language Models in Recommendation Systemscited by 73
  13. 2023Collaborative Large Language Model for Recommender Systemscited by 64
  14. 2023LlamaRec: Two-Stage Recommendation using Large Language Models for Rankingcited by 53
  15. 2024IDGenRec: LLM-RecSys Alignment with Textual ID Learningcited by 53
  16. 2025MTGR: Industrial-Scale Generative Recommendation Framework in Meituancited by 49
  17. 2023Leveraging Large Language Models for Pre-trained Recommender Systemscited by 42
  18. 2023E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendationcited by 39
  19. 2023Bridging Items and Language: A Transition Paradigm for Large Language Model-Based Recommendationcited by 29
  20. 2025Order-agnostic Identifier for Large Language Model-based Generative Recommendationcited by 21
  21. 2023Language Models As Semantic Indexerscited by 20
  22. 2025ActionPiece: Contextually Tokenizing Action Sequences for Generative Recommendationcited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhancing Item Tokenization for Generative Recommendation through Self-Improvement
  2. 2026PRISM: Purified Representation and Integrated Semantic Modeling for Generative Sequential Recommendation
  3. 2026GenRec: A Preference-Oriented Generative Framework for Large-Scale Recommendation
  4. 2025Semantics Meet Signals: Dual Codebook Representationl Learning for Generative Recommendation
  5. 2025Universal Item Tokenization for Transferable Generative Recommendation
  6. 2026Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation
  7. 2026Learning Variable-Length Tokenization for Generative Recommendation
  8. 2026EchoRec: Multi-Item Prediction-Empowered Generative Recommendation via Cycle-Consistent Preference Alignment