GenRec: A Preference-Oriented Generative Framework for Large-Scale Recommendation
Not on the map. Why?
Abstract (arXiv)
Generative Retrieval (GR) offers a promising paradigm for recommendation through next-token prediction (NTP). However, scaling it to large-scale industrial systems introduces three challenges: (i) within a single request, the identical model inputs may produce inconsistent outputs due to the pagination request mechanism; (ii) the prohibitive cost of encoding long user behavior sequences with multi-token item representations based on semantic IDs, and (iii) aligning the generative policy with nuanced user preference signals. We present GenRec, a preference-oriented generative framework deployed on the JD App that addresses above challenges within a single decoder-only architecture. For training objective, we propose Page-wise NTP task, which supervises over an entire interaction page rather than each interacted item individually, providing denser gradient signal and resolving the one-to-many ambiguity of point-wise training. On the prefilling side, an asymmetric linear Token Merger compresses multi-token Semantic IDs in the prompt while preserving full-resolution decoding, reducing input length by ~2X with negligible accuracy loss. To further align outputs with user satisfaction, we introduce GRPO-SR, a reinforcement learning method that pairs Group Relative Policy Optimization with NLL regularization for training stability, and employs Hybrid Rewards combining a dense reward model with a relevance gate to mitigate reward hacking. In month-long online A/B tests serving production traffic, GenRec achieves 9.5% improvement in click count and 8.7% in transaction count over the existing pipeline.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
16 of 25 references.
References · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2023Recommender Systems with Generative Retrievalcited by 191
- 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 176
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
- 2024Learnable Item Tokenization for Generative Recommendationcited by 106
- 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
- 2025MTGR: Industrial-Scale Generative Recommendation Framework in Meituancited by 47
- 2025Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense Representationscited by 35
- 2025OneTrans: Unified Feature Interaction and Sequence Modeling with One Transformer in Industrial Recommendercited by 34
4 more
- 2025OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking Systemcited by 18
- 2024Enhancing Item Tokenization for Generative Recommendation through Self-Improvementcited by 9
- 2025From IDs to Semantics: A Generative Framework for Cross-Domain Recommendation with Adaptive Semantic Tokenizationcited by 9
- 2025Unified Semantic and ID Representation Learning for Deep Recommenderscited by 8
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026UniPinRec: Unifying Generative Retrieval and Ranking at Pinterest Scalecited by 1
- 2026Token Factory: Efficiently Integrating Diverse Signals into Large Recommendation Modelscited by 1
- 2026Difficulty-Aware Semantic-ID Optimization for Generative Recommendationcited by 1
- 2026Adaptive Loss Balancing for Noise-Robust GRPO in Generative Recommendationcited by 0
- 2026Learning from Unreachable Rewards: Hint-Conditioned Reinforcement Learning for Generative Recommendationcited by 0
- 2026Difficulty-Aware Semantic-ID Optimization for Generative Recommendation20 Aug 2026
- 2026Learning from Unreachable Rewards: Hint-Conditioned Reinforcement Learning for Generative Recommendation12 Aug 2026
- 2026Token Factory: Efficiently Integrating Diverse Signals into Large Recommendation Models17 Jun 2026
- 2026Adaptive Loss Balancing for Noise-Robust GRPO in Generative Recommendation7 Jun 2026
- 2026UniPinRec: Unifying Generative Retrieval and Ranking at Pinterest Scale29 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026EchoRec: Multi-Item Prediction-Empowered Generative Recommendation via Cycle-Consistent Preference Alignment
- 2025Semantics Meet Signals: Dual Codebook Representationl Learning for Generative Recommendation
- 2026VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignment
- 2026Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation
- 2026GEMs: Breaking the Long-Sequence Barrier in Generative Recommendation with a Multi-Stream Decoder
- 2025A Survey on Generative Recommendation: Data, Model, and Tasks
- 2024IDGenRec: LLM-RecSys Alignment with Textual ID Learning