mlsanityData to 14 Oct 2026

UniGD: A Unified Generative-Discriminative Framework for Industrial Retrieval

arXiv 2608.03150 ↗First posted 4 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Generative retrieval (GR) is a promising paradigm for industrial search advertising, yet its deployment is constrained by strict relevance and latency requirements. Existing systems cascade GR with an independent relevance model, decoupling the generative likelihood objective from query-ad relevance discrimination, which compromises effectiveness and increases serving costs. We propose a Unified Generative-Discriminative framework (UniGD) that integrates retrieval and relevance scoring within a single model. To mitigate gradient interference in joint optimization, UniGD introduces Conflict-Aware Gradient Enhancement (CAGE) to adaptively coordinate the two objectives. UniGD further designs a Codebook-Anchored Representation Module (CAM) that anchors item representations to frozen hierarchical codebooks distilled from a multimodal pretrained model, thereby endowing them with rich and generalizable semantic priors. For heterogeneous short-video, product, and live-stream ads, UniGD proposes Heterogeneous Ad-material Modeling (HAM), which captures cross-type semantic commonality over a shared backbone while preserving type-specific modeling capacity. Online AB tests on Kuaishou search advertising platform show that UniGD raises ad revenue by 5.78%, reduces inference latency by 33%, and improves discriminative relevance estimation. On NQ320K and MS300K, UniGD improves Recall@10 over the strongest reproduced GR baseline by 8.44% and 3.19%, respectively.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 35 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

28 of 35 references.

References · 28

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  3. 2017Neural Discrete Representation Learningcited by 4,712
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  5. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
  6. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 463
  7. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 413
  8. 2022Transformer Memory as a Differentiable Search Indexcited by 247
  9. 2022A Neural Corpus Indexer for Document Retrievalcited by 111
  10. 2023Learning to Tokenize for Generative Retrievalcited by 68
  11. 2022Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generationcited by 48
  12. 2020RepBERT: Contextualized Text Embeddings for First-Stage Retrievalcited by 46
16 more
  1. 2023Learning to Rank in Generative Retrievalcited by 46
  2. 2023Scalable and Effective Generative Information Retrievalcited by 39
  3. 2022Ultron: An Ultimate Retriever on Corpus with a Model-based Indexercited by 31
  4. 2025OneSearch: A Preliminary Exploration of the Unified End-to-End Generative Framework for E-commerce Searchcited by 25
  5. 2024Planning Ahead in Generative Retrieval: Guiding Autoregressive Generation through Simultaneous Decodingcited by 19
  6. 2025OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking Systemcited by 18
  7. 2025OneSug: The Unified End-to-End Generative Framework for E-commerce Query Suggestioncited by 14
  8. 2025Generative Retrieval and Alignment Model: A New Paradigm for E-commerce Retrievalcited by 13
  9. 2025Killing Two Birds with One Stone: Unifying Retrieval and Ranking with a Single Generative Recommendation Modelcited by 13
  10. 2024Generative Retrieval with Preference Optimization for E-commerce Searchcited by 10
  11. 2025Lightweight and Direct Document Relevance Optimization for Generative Information Retrievalcited by 9
  12. 2026Generative Recommendation for Large-Scale Advertisingcited by 7
  13. 2024Generative Retrieval Meets Multi-Graded Relevancecited by 6
  14. 2025EGA-V2: An End-to-end Generative Framework for Industrial Advertisingcited by 6
  15. 2025GRank: Towards Target-Aware and Streamlined Industrial Retrieval with a Generate-Rank Frameworkcited by 4
  16. 2026RankGR: Rank-Enhanced Generative Retrieval with Listwise Direct Preference Optimization in Recommendationcited by 2

Built on by

Not cited yet.