Generative Recommender with End-to-End Learnable Item Tokenization
Not on the map. Why?
Abstract (arXiv)
Generative recommendation systems have gained increasing attention as an innovative approach that directly generates item identifiers for recommendation tasks. Despite their potential, a major challenge is the effective construction of item identifiers that align well with recommender systems. Current approaches often treat item tokenization and generative recommendation training as separate processes, which can lead to suboptimal performance. To overcome this issue, we introduce ETEGRec, a novel End-To-End Generative Recommender that unifies item tokenization and generative recommendation into a cohesive framework. Built on a dual encoder-decoder architecture, ETEGRec consists of an item tokenizer and a generative recommender. To enable synergistic interaction between these components, we propose a recommendation-oriented alignment strategy, which includes two key optimization objectives: sequence-item alignment and preference-semantic alignment. These objectives tightly couple the learning processes of the item tokenizer and the generative recommender, fostering mutual enhancement. Additionally, we develop an alternating optimization technique to ensure stable and efficient end-to-end training of the entire framework. Extensive experiments demonstrate the superior performance of our approach compared to traditional sequential recommendation models and existing generative recommendation baselines. Our code is available at https://github.com/RUCAIBox/ETEGRec.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Sep 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 10; 2026: 22.
32 papers.
Sort:
By area:
- 2025MMQ: Multimodal Mixture-of-Quantization Tokenization for Semantic ID Generation and User Behavioral Adaptationcited by 10
- 2025LLaDA-Rec: Discrete Diffusion for Parallel Semantic ID Generation in Generative Recommendationcited by 9
- 2025Universal Item Tokenization for Transferable Generative Recommendationcited by 7
- 2025Discrete Tokenization for Multimodal LLMs: A Comprehensive Surveycited by 7
- 2025Understanding Generative Recommendation with Semantic IDs from a Model-scaling Viewcited by 6
- 2026Stop Treating Collisions Equally: Qualification-Aware Semantic ID Learning for Recommendation at Industrial Scalecited by 5
- 2025Pctx: Tokenizing Personalized Context for Generative Recommendationcited by 3
- 2026When Text-as-Vision Meets Semantic IDs in Generative Recommendation: An Empirical Studycited by 3
- 2026Understanding Semantic IDs: From Item Representation to Item Selection in Generative Recommendationcited by 3
- 2025Cognitive-Aligned Spatio-Temporal Large Language Models For Next Point-of-Interest Predictioncited by 2
- 2026Generative Recall, Dense Reranking: Learning Multi-View Semantic IDs for Efficient Text-to-Video Retrievalcited by 2
- 2026Rethinking Generative Recommender Tokenizer: Recsys-Native Encoding and Semantic Quantization Beyond LLMscited by 2
20 more
- 2026MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Cachescited by 2
- 2026LLMs Need Encoders for Semantic IDs Toocited by 2
- 2026TRACER: Token ReAssignment for Concept ERasure in Generative Recommendationcited by 2
- 2025HoMer: Addressing Heterogeneities by Modeling Sequential and Set-wise Contexts for CTR Predictioncited by 1
- 2026Learning Variable-Length Tokenization for Generative Recommendationcited by 1
- 2026Do LLM Recommenders Know When They're Hallucinating? Auditing Confidence Calibration in Catalog Faithfulnesscited by 1
- 2026History-Conditioned Joint-Prefix Alignment for Generative Recommendationcited by 1
- 2025SPARC: Soft Probabilistic Adaptive multi-interest Retrieval Model via Codebooks for recommender systemcited by 0
- 2025Learning Decomposed Contextual Token Representations from Pretrained and Collaborative Signals for Generative Recommendationcited by 0
- 2026PRISM: Purified Representation and Integrated Semantic Modeling for Generative Sequential Recommendationcited by 0
- 2026UniGRec: Unified Generative Recommendation with Soft Identifiers for End-to-End Optimizationcited by 0
- 2026SIGMA: A Semantic-Grounded Instruction-Driven Generative Multi-Task Recommender at AliExpresscited by 0
- 2026VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendationcited by 0
- 2026EchoRec: Multi-Item Prediction-Empowered Generative Recommendation via Cycle-Consistent Preference Alignmentcited by 0
- 2026SIDScope: A Diagnostic Resource for Semantic-ID Interfaces in Generative Recommendationcited by 0
- 2026From a Static Multi-Level Small Semantic Codebook to a Dynamic Single-Level Large Semantic Codebook for Generative Recommendationcited by 0
- 2026SA-RSQ: A Versatile Sparse Representation Framework for Multi-modal Recommender Systemscited by 0
- 2026Adaptive Item-based Collaborative Structures via Noise Rescheduling in Diffusion for Generative Recommendationcited by 0
- 2026Tlow: Flow-based Item Tokenizer for Recommendationcited by 0
- 2026PRQ-KMeans: Projection Residual Quantization for Semantic ID Tokenizationcited by 0
- 2026History-Conditioned Joint-Prefix Alignment for Generative Recommendation29 Aug 2026
- 2026PRQ-KMeans: Projection Residual Quantization for Semantic ID Tokenization25 Aug 2026
- 2026Tlow: Flow-based Item Tokenizer for Recommendation25 Aug 2026
- 2026Adaptive Item-based Collaborative Structures via Noise Rescheduling in Diffusion for Generative Recommendation24 Aug 2026
- 2026SA-RSQ: A Versatile Sparse Representation Framework for Multi-modal Recommender Systems24 Aug 2026
- 2026From a Static Multi-Level Small Semantic Codebook to a Dynamic Single-Level Large Semantic Codebook for Generative Recommendation21 Aug 2026
- 2026SIDScope: A Diagnostic Resource for Semantic-ID Interfaces in Generative Recommendation19 Aug 2026
- 2026EchoRec: Multi-Item Prediction-Empowered Generative Recommendation via Cycle-Consistent Preference Alignment14 Aug 2026
- 2026Do LLM Recommenders Know When They're Hallucinating? Auditing Confidence Calibration in Catalog Faithfulness7 Aug 2026
- 2026VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation28 Jul 2026
- 2026Understanding Semantic IDs: From Item Representation to Item Selection in Generative Recommendation27 Jul 2026
- 2026TRACER: Token ReAssignment for Concept ERasure in Generative Recommendation5 Jun 2026
20 more
- 2026LLMs Need Encoders for Semantic IDs Too29 May 2026
- 2026Learning Variable-Length Tokenization for Generative Recommendation18 May 2026
- 2026MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches24 Apr 2026
- 2026Stop Treating Collisions Equally: Qualification-Aware Semantic ID Learning for Recommendation at Industrial Scale28 Feb 2026
- 2026SIGMA: A Semantic-Grounded Instruction-Driven Generative Multi-Task Recommender at AliExpress26 Feb 2026
- 2026Rethinking Generative Recommender Tokenizer: Recsys-Native Encoding and Semantic Quantization Beyond LLMs2 Feb 2026
- 2026Generative Recall, Dense Reranking: Learning Multi-View Semantic IDs for Efficient Text-to-Video Retrieval29 Jan 2026
- 2026UniGRec: Unified Generative Recommendation with Soft Identifiers for End-to-End Optimization24 Jan 2026
- 2026PRISM: Purified Representation and Integrated Semantic Modeling for Generative Sequential Recommendation23 Jan 2026
- 2026When Text-as-Vision Meets Semantic IDs in Generative Recommendation: An Empirical Study21 Jan 2026
- 2025LLaDA-Rec: Discrete Diffusion for Parallel Semantic ID Generation in Generative Recommendation9 Nov 2025
- 2025Pctx: Tokenizing Personalized Context for Generative Recommendation24 Oct 2025
- 2025Cognitive-Aligned Spatio-Temporal Large Language Models For Next Point-of-Interest Prediction16 Oct 2025
- 2025HoMer: Addressing Heterogeneities by Modeling Sequential and Set-wise Contexts for CTR Prediction13 Oct 2025
- 2025Understanding Generative Recommendation with Semantic IDs from a Model-scaling View29 Sep 2025
- 2025Learning Decomposed Contextual Token Representations from Pretrained and Collaborative Signals for Generative Recommendation22 Aug 2025
- 2025MMQ: Multimodal Mixture-of-Quantization Tokenization for Semantic ID Generation and User Behavioral Adaptation21 Aug 2025
- 2025SPARC: Soft Probabilistic Adaptive multi-interest Retrieval Model via Codebooks for recommender system12 Aug 2025
- 2025Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey21 Jul 2025
- 2025Universal Item Tokenization for Transferable Generative Recommendation6 Apr 2025
- 2025Discrete Tokenization for Multimodal LLMs: A Comprehensive Surveycited by 7
- 2026LLMs Need Encoders for Semantic IDs Toocited by 2
- 2026LLMs Need Encoders for Semantic IDs Too29 May 2026
- 2025Discrete Tokenization for Multimodal LLMs: A Comprehensive Survey21 Jul 2025
- 2025MMQ: Multimodal Mixture-of-Quantization Tokenization for Semantic ID Generation and User Behavioral Adaptationcited by 10
- 2025Universal Item Tokenization for Transferable Generative Recommendationcited by 7
- 2025Understanding Generative Recommendation with Semantic IDs from a Model-scaling Viewcited by 6
- 2026Stop Treating Collisions Equally: Qualification-Aware Semantic ID Learning for Recommendation at Industrial Scalecited by 5
- 2025Pctx: Tokenizing Personalized Context for Generative Recommendationcited by 3
- 2026When Text-as-Vision Meets Semantic IDs in Generative Recommendation: An Empirical Studycited by 3
- 2026Understanding Semantic IDs: From Item Representation to Item Selection in Generative Recommendationcited by 3
- 2026Generative Recall, Dense Reranking: Learning Multi-View Semantic IDs for Efficient Text-to-Video Retrievalcited by 2
- 2026Rethinking Generative Recommender Tokenizer: Recsys-Native Encoding and Semantic Quantization Beyond LLMscited by 2
- 2026MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Cachescited by 2
- 2025HoMer: Addressing Heterogeneities by Modeling Sequential and Set-wise Contexts for CTR Predictioncited by 1
- 2026Learning Variable-Length Tokenization for Generative Recommendationcited by 1
12 most cited of 25 All 25 (JSON)
- 2026History-Conditioned Joint-Prefix Alignment for Generative Recommendation29 Aug 2026
- 2026PRQ-KMeans: Projection Residual Quantization for Semantic ID Tokenization25 Aug 2026
- 2026Tlow: Flow-based Item Tokenizer for Recommendation25 Aug 2026
- 2026SA-RSQ: A Versatile Sparse Representation Framework for Multi-modal Recommender Systems24 Aug 2026
- 2026From a Static Multi-Level Small Semantic Codebook to a Dynamic Single-Level Large Semantic Codebook for Generative Recommendation21 Aug 2026
- 2026SIDScope: A Diagnostic Resource for Semantic-ID Interfaces in Generative Recommendation19 Aug 2026
- 2026Do LLM Recommenders Know When They're Hallucinating? Auditing Confidence Calibration in Catalog Faithfulness7 Aug 2026
- 2026VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation28 Jul 2026
- 2026Understanding Semantic IDs: From Item Representation to Item Selection in Generative Recommendation27 Jul 2026
- 2026Learning Variable-Length Tokenization for Generative Recommendation18 May 2026
- 2026MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches24 Apr 2026
- 2026Stop Treating Collisions Equally: Qualification-Aware Semantic ID Learning for Recommendation at Industrial Scale28 Feb 2026
12 newest of 25 All 25 (JSON)