Universal Item Tokenization for Transferable Generative Recommendation
Not on the map. Why?
Abstract (arXiv)
Recently, generative recommendation has emerged as a promising paradigm, attracting significant research attention. The basic framework involves an item tokenizer, which represents each item as a sequence of codes serving as its identifier, and a generative recommender that predicts the next item by autoregressively generating the target item identifier. However, in existing methods, both the tokenizer and the recommender are typically domain-specific, limiting their ability for effective transfer or adaptation to new domains. To this end, we propose UTGRec, a Universal item Tokenization approach for transferable Generative Recommendation. Specifically, we design a universal item tokenizer for encoding rich item semantics by adapting a multimodal large language model (MLLM). By devising tree-structured codebooks, we discretize content representations into corresponding codes for item tokenization. To effectively learn the universal item tokenizer on multiple domains, we introduce two key techniques in our approach. For raw content reconstruction, we employ dual lightweight decoders to reconstruct item text and images from discrete representations to capture general knowledge embedded in the content. For collaborative knowledge integration, we assume that co-occurring items are similar and integrate collaborative signals through co-occurrence alignment and reconstruction. Finally, we present a joint learning framework to pre-train and adapt the transferable generative recommender across multiple domains. Extensive experiments on four public datasets demonstrate the superiority of UTGRec compared to both traditional and generative recommendation baselines.
Key facts. Cited by 7 papers in the map (data through 13 Oct 2026). Builds on 44 of its 71 references that are in the map. First posted on arXiv 6 Apr 2025.
Builds on
44 of 71 references.
References · 44
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,549
- 2020Scaling Laws for Neural Language Modelscited by 6,494
- 2018Self-Attentive Sequential Recommendationcited by 1,175
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 958
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 762
- 2022Autoregressive Image Generation using Residual Quantizationcited by 709
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 688
- 2024Autoregressive Image Generation without Vector Quantizationcited by 647
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 475
- 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
32 more
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 397
- 2018Session-based Recommendation with Graph Neural Networkscited by 312
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
- 2022Transformer Memory as a Differentiable Search Indexcited by 243
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 172
- 2016Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendationcited by 152
- 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
- 2020RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithmscited by 137
- 2021Contrastive Learning for Representation Degeneration Problem in Sequential Recommendationcited by 121
- 2022RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encodercited by 118
- 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
- 2022A Neural Corpus Indexer for Document Retrievalcited by 107
- 2024Learnable Item Tokenization for Generative Recommendationcited by 107
- 2023How to Index Item IDs for Recommendation Foundation Modelscited by 102
- 2022Filter-enhanced MLP is All You Need for Sequential Recommendationcited by 96
- 2016Improved Recurrent Neural Networks for Session-based Recommendationscited by 86
- 2018CoNet: Collaborative Cross Networks for Cross-Domain Recommendationcited by 81
- 2024Addressing Representation Collapse in Vector Quantized Models with One Linear Layercited by 78
- 2021Cross-Domain Recommendation: Challenges, Progress, and Prospectscited by 74
- 2023Learning to Tokenize for Generative Retrievalcited by 67
- 2024EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaborationcited by 55
- 2024TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendationcited by 35
- 2024Generative Recommender with End-to-End Learnable Item Tokenizationcited by 32
- 2020One Person, One Model, One World: Learning Continual User Representation without Forgettingcited by 30
- 2023MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendationcited by 30
- 2021Contrastive Cross-domain Recommendation in Matchingcited by 25
- 2020PTUM: Pre-training User Model from Unlabeled User Behaviors via Self-supervisioncited by 22
- 2023Auto Search Indexer for End-to-End Document Retrievalcited by 16
- 2024Inductive Generative Recommendation via Retrieval-based Speculationcited by 15
- 2025Multimodal Quantitative Language for Generative Recommendationcited by 12
- 2024Semantic Convergence: Harmonizing Recommender Systems via Two-Stage Alignment and Behavioral Semantic Tokenizationcited by 9
- 2025Bridging Textual-Collaborative Gap through Semantic Codes for Sequential Recommendationcited by 4
Built on by
Citing papers per year: 2025: 4; 2026: 3.
7 papers.
- 2025MMQ: Multimodal Mixture-of-Quantization Tokenization for Semantic ID Generation and User Behavioral Adaptationcited by 10
- 2025Discrete Tokenization for Multimodal LLMs: A Comprehensive Surveycited by 7
- 2025LLM-Aligned Geographic Item Tokenization for Local-Life Recommendationcited by 3
- 2025Cognitive-Aligned Spatio-Temporal Large Language Models For Next Point-of-Interest Predictioncited by 2
- 2026EPIC: Explicit Posterior Item Conditioning for Semantic ID Diffusion Recommendationcited by 1
- 2026ShopX: A Foundation Model for Intent-to-Item Fulfillment in Agentic Shoppingcited by 0
- 2026SIDScope: A Diagnostic Resource for Semantic-ID Interfaces in Generative Recommendationcited by 0
- 2026EPIC: Explicit Posterior Item Conditioning for Semantic ID Diffusion Recommendation3 Sep 2026
- 2026SIDScope: A Diagnostic Resource for Semantic-ID Interfaces in Generative Recommendation19 Aug 2026
- 2026ShopX: A Foundation Model for Intent-to-Item Fulfillment in Agentic Shopping30 Jun 2026
- 2025LLM-Aligned Geographic Item Tokenization for Local-Life Recommendation18 Nov 2025
- 2025Cognitive-Aligned Spatio-Temporal Large Language Models For Next Point-of-Interest Prediction16 Oct 2025
- 2025MMQ: Multimodal Mixture-of-Quantization Tokenization for Semantic ID Generation and User Behavioral Adaptation21 Aug 2025
- 2025Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey21 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2024Enhancing Item Tokenization for Generative Recommendation through Self-Improvement
- 2025CoFiRec: Coarse-to-Fine Tokenization for Generative Recommendation
- 2025A Simple Contrastive Framework Of Item Tokenization For Generative Recommendation
- 2025Semantics Meet Signals: Dual Codebook Representationl Learning for Generative Recommendation
- 2025Tokenize Once, Recommend Anywhere: Unified Item Tokenization for Multi-domain LLM-based Recommendation
- 2026Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation
- 2026PRISM: Purified Representation and Integrated Semantic Modeling for Generative Sequential Recommendation
- 2025Multi-Aspect Cross-modal Quantization for Generative Recommendation