mlsanityData to 13 Oct 2026

Universal Item Tokenization for Transferable Generative Recommendation

arXiv 2504.04405 ↗First posted 6 Apr 2025cs.IR cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Recently, generative recommendation has emerged as a promising paradigm, attracting significant research attention. The basic framework involves an item tokenizer, which represents each item as a sequence of codes serving as its identifier, and a generative recommender that predicts the next item by autoregressively generating the target item identifier. However, in existing methods, both the tokenizer and the recommender are typically domain-specific, limiting their ability for effective transfer or adaptation to new domains. To this end, we propose UTGRec, a Universal item Tokenization approach for transferable Generative Recommendation. Specifically, we design a universal item tokenizer for encoding rich item semantics by adapting a multimodal large language model (MLLM). By devising tree-structured codebooks, we discretize content representations into corresponding codes for item tokenization. To effectively learn the universal item tokenizer on multiple domains, we introduce two key techniques in our approach. For raw content reconstruction, we employ dual lightweight decoders to reconstruct item text and images from discrete representations to capture general knowledge embedded in the content. For collaborative knowledge integration, we assume that co-occurring items are similar and integrate collaborative signals through co-occurrence alignment and reconstruction. Finally, we present a joint learning framework to pre-train and adapt the transferable generative recommender across multiple domains. Extensive experiments on four public datasets demonstrate the superiority of UTGRec compared to both traditional and generative recommendation baselines.

Key facts. Cited by 7 papers in the map (data through 13 Oct 2026). Builds on 44 of its 71 references that are in the map. First posted on arXiv 6 Apr 2025.

Builds on

44 of 71 references.

References · 44

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,549
  4. 2020Scaling Laws for Neural Language Modelscited by 6,494
  5. 2018Self-Attentive Sequential Recommendationcited by 1,175
  6. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 958
  7. 2021SoundStream: An End-to-End Neural Audio Codeccited by 762
  8. 2022Autoregressive Image Generation using Residual Quantizationcited by 709
  9. 2015Session-based Recommendations with Recurrent Neural Networkscited by 688
  10. 2024Autoregressive Image Generation without Vector Quantizationcited by 647
  11. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 475
  12. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
32 more
  1. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 397
  2. 2018Session-based Recommendation with Graph Neural Networkscited by 312
  3. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  4. 2022Transformer Memory as a Differentiable Search Indexcited by 243
  5. 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 172
  6. 2016Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendationcited by 152
  7. 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
  8. 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 137
  9. 2021Contrastive Learning for Representation Degeneration Problem in Sequential Recommendationcited by 121
  10. 2022RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encodercited by 118
  11. 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
  12. 2022A Neural Corpus Indexer for Document Retrievalcited by 107
  13. 2024Learnable Item Tokenization for Generative Recommendationcited by 107
  14. 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
  15. 2022Filter-enhanced MLP is All You Need for Sequential Recommendationcited by 96
  16. 2016Improved Recurrent Neural Networks for Session-based Recommendationscited by 86
  17. 2018CoNet: Collaborative Cross Networks for Cross-Domain Recommendationcited by 81
  18. 2024Addressing Representation Collapse in Vector Quantized Models with One Linear Layercited by 78
  19. 2021Cross-Domain Recommendation: Challenges, Progress, and Prospectscited by 74
  20. 2023Learning to Tokenize for Generative Retrievalcited by 67
  21. 2024EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaborationcited by 55
  22. 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendationcited by 35
  23. 2024Generative Recommender with End-to-End Learnable Item Tokenizationcited by 32
  24. 2020One Person, One Model, One World: Learning Continual User Representation without Forgettingcited by 30
  25. 2023MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendationcited by 30
  26. 2021Contrastive Cross-domain Recommendation in Matchingcited by 25
  27. 2020PTUM: Pre-training User Model from Unlabeled User Behaviors via Self-supervisioncited by 22
  28. 2023Auto Search Indexer for End-to-End Document Retrievalcited by 16
  29. 2024Inductive Generative Recommendation via Retrieval-based Speculationcited by 15
  30. 2025Multimodal Quantitative Language for Generative Recommendationcited by 12
  31. 2024Semantic Convergence: Harmonizing Recommender Systems via Two-Stage Alignment and Behavioral Semantic Tokenizationcited by 9
  32. 2025Bridging Textual-Collaborative Gap through Semantic Codes for Sequential Recommendationcited by 4

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 4; 2026: 3.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhancing Item Tokenization for Generative Recommendation through Self-Improvement
  2. 2025CoFiRec: Coarse-to-Fine Tokenization for Generative Recommendation
  3. 2025A Simple Contrastive Framework Of Item Tokenization For Generative Recommendation
  4. 2025Semantics Meet Signals: Dual Codebook Representationl Learning for Generative Recommendation
  5. 2025Tokenize Once, Recommend Anywhere: Unified Item Tokenization for Multi-domain LLM-based Recommendation
  6. 2026Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation
  7. 2026PRISM: Purified Representation and Integrated Semantic Modeling for Generative Sequential Recommendation
  8. 2025Multi-Aspect Cross-modal Quantization for Generative Recommendation