mlsanityData to 14 Oct 2026

WeGR: Unified Generative Retrieval for Industrial Search Systems in WeChat

arXiv 2610.16979 ↗First posted 12 Oct 2026cs.IR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Generative retrieval (GR) offers a promising paradigm for industrial search by unifying candidate generation within an autoregressive framework. However, its effectiveness is limited by two key challenges. First, existing Semantic ID (SID) tokenizers struggle to incorporate collaborative signals while maintaining effective codebook utilization, limiting their ability to distinguish items and achieve high-quality retrieval. Second, existing reinforcement learning (RL) methods suffer from severe reward sparsity under exact SID matching, leaving many sampled trajectories without effective learning signals and hindering preference optimization. To address these challenges, we propose WeGR, a unified generative retrieval framework consisting of two complementary components. Specifically, the Collaborative and Collapse-free Tokenizer (CoCo-VAE) incorporates query-to-item and item-to-item collaborative signals while mitigating codebook collapse through codebook refresh and complementary regularization, enabling more informative and balanced SID representations. Building upon these SIDs, Dynamic Horizon Policy Optimization (DHPO) progressively expands both reward evaluation and policy optimization horizons, reducing learning difficulty while leveraging behavioral reward signals at different levels of the SID hierarchy, without relying on auxiliary reward models. Extensive offline experiments demonstrate the effectiveness of WeGR in improving retrieval and ranking performance. Moreover, a two-month online A/B test in WeChat E-commerce Search demonstrates relative improvements of 2.539% in orders, 1.508% in click-through rate, and 1.381% in conversion rate, while reducing online CPU and GPU usage by 25.5% and 26.1%, respectively. The system has been successfully deployed across multiple search scenarios in WeChat, serving billions of users, generating tens of millions of PVs daily.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

25 of 42 references.

References · 25

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2017Neural Discrete Representation Learningcited by 4,712
  5. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  6. 2020Jukebox: A Generative Model for Musiccited by 542
  7. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
  8. 2023Preference Ranking Optimization for Human Alignmentcited by 285
  9. 2023Recommender Systems with Generative Retrievalcited by 198
  10. 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 179
  11. 2022Autoregressive Search Engines: Generating Substrings as Document Identifierscited by 113
  12. 2024Learnable Item Tokenization for Generative Recommendationcited by 110
13 more
  1. 2024Generative Recommender with End-to-End Learnable Item Tokenizationcited by 34
  2. 2025OneSearch: A Preliminary Exploration of the Unified End-to-End Generative Framework for E-commerce Searchcited by 25
  3. 2026Differentiable Semantic ID for Generative Recommendationcited by 19
  4. 2025OneSug: The Unified End-to-End Generative Framework for E-commerce Query Suggestioncited by 14
  5. 2024Generative Retrieval with Preference Optimization for E-commerce Searchcited by 10
  6. 2026WeMM-Embedding: WeChat Multi-Modal Embedding Technical Reportcited by 8
  7. 2026OneMall: One Architecture, More Scenarios -- End-to-End Generative Recommender Family at Kuaishou E-Commercecited by 3
  8. 2026RAD-DPO: Robust Adaptive Denoising Direct Preference Optimization for Generative Retrieval in E-commercecited by 2
  9. 2026R3-VAE: Reference Vector-Guided Rating Residual Quantization VAE for Generative Recommendationcited by 2
  10. 2026LocalSUG: City-Preference-Enhanced LLM for Query Suggestion in Local-Life Servicescited by 1
  11. 2026Hierarchical Residual Policy Optimization for Generative Recommendationscited by 1
  12. 2026Learning from Unreachable Rewards: Hint-Conditioned Reinforcement Learning for Generative Recommendationcited by 1
  13. 2026VARG: Value-Aware and Ranking-Aligned Generative Retrieval for Dynamic E-commerce Searchcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Efficient Generative Retrieval for E-commerce Search with Semantic Cluster IDs and Expert-Guided RL
  2. 2026It Takes Two to Match: Co-Evolving Generative Retriever with Reinforcement Learning
  3. 2024Breaking the Hourglass Phenomenon of Residual Quantization: Enhancing the Upper Bound of Generative Retrieval
  4. 2026Pailitao-VL: Unified Embedding and Reranker for Real-Time Multi-Modal Industrial Search
  5. 2025Lightweight and Direct Document Relevance Optimization for Generative Information Retrieval
  6. 2026Preference Shapes Relevance: Cross-component Hierarchical Semantic Alignment for Personalized Generative Retrieval
  7. 2026Token-Level Credit Assignment Optimization for Generative Document Retrieval ↗
  8. 2026Dual-Rerank: Fusing Causality and Utility for Industrial Generative Reranking