mlsanityData to 14 Oct 2026

GR2 Technical Report

arXiv 2606.31984 ↗First posted 30 Jun 2026cs.IR cs.AIcited by 0

On the map: Knowledge distillation → Distillation for recommender systems

Abstract (arXiv)

Industrial recommendation systems serve billions of users through a multi-stage funnel -- retrieval, early-stage ranking, and re-ranking -- where the final re-ranking step disproportionately shapes user engagement and downstream performance, particularly for carousel and grid display formats. Despite growing enthusiasm for Large Language Models (LLMs) in recommendation, three gaps hinder industrial adoption: (1) most efforts target retrieval and ranking, leaving re-ranking -- the stage closest to the final user experience -- largely underexplored; (2) LLMs are typically deployed zero-shot or via supervised fine-tuning, underutilizing the reasoning capabilities unlocked by reinforcement learning (RL) on verifiable rewards; (3) deployed catalogs index billions of items with non-semantic identifiers that lie outside any base-LLM vocabulary. We present GR2 (Generative Reasoning Re-Ranker), an end-to-end framework that combines (i) mid-training on semantic IDs produced by a tokenizer with >=99% uniqueness, (ii) reasoning-trace distilled from a stronger teacher via targeted prompting and rejection sampling, and (iii) RL with verifiable rewards purpose-built for re-ranking. To make GR2 resource-viable, we further (iv) introduce a context compressor that amortizes training cost, On-Policy Distillation (OPD) as a scalable alternative to SFT -- which we find collapses at industrial scale -- and reasoning distillation for low-latency serving. GR2 delivers +18.7% R@1, +7.1% R@3, and +9.6% N@3 over legacy baselines on industrial-scale traffic. We further find that reward design is critical in re-ranking: LLMs often hack rewards by preserving the incoming order or exploiting position bias, motivating conditional verifiable rewards as essential industrial components.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Distillation for recommender systems, one of 12 directions in Knowledge distillation. Builds on 33 of its 44 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

33 of 44 references.

References · 33

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  4. 2025Group Sequence Policy Optimizationcited by 835
  5. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  6. 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 455
  7. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
  8. 2023A Survey on Large Language Models for Recommendationcited by 379
  9. 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 338
  10. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
  11. 2025MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attentioncited by 263
  12. 2023Recommender Systems with Generative Retrievalcited by 198
21 more
  1. 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 189
  2. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
  3. 2024Wukong: Towards a Scaling Law for Large-Scale Recommendationcited by 74
  4. 2025OneRec-Think: In-Text Reasoning for Generative Recommendationcited by 51
  5. 2024Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMscited by 48
  6. 2024LLM4Rerank: LLM-based Auto-Reranking Framework for Recommendationscited by 40
  7. 2025PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendationscited by 30
  8. 2025OneRec-V2 Technical Reportcited by 29
  9. 2025REARANK: Reasoning Re-ranking Agent via Reinforcement Learningcited by 24
  10. 2025MM-R5: MultiModal Reasoning-Enhanced ReRanker via Reinforcement Learning for Document Retrievalcited by 21
  11. 2022Neural Re-ranking in Multi-stage Recommender Systems: A Reviewcited by 20
  12. 2024Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitationcited by 19
  13. 2025R4ec: A Reasoning, Reflection, and Refinement Framework for Recommendation Systemscited by 16
  14. 2025OpenOneRec Technical Reportcited by 16
  15. 2025External Large Foundation Model: How to Efficiently Serve Trillions of Parameters for Online Ads Recommendationcited by 13
  16. 2026GR2: Generative Reasoning Re-rankercited by 11
  17. 2025The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exitcited by 10
  18. 2025Meta Lattice: Model Space Redesign for Cost-Effective Industry-Scale Ads Recommendationscited by 5
  19. 2025Large Scale Retrieval for the LinkedIn Feed using Causal Language Modelscited by 4
  20. 2025LLM as Explainable Re-Ranker for Recommendation Systemcited by 3
  21. 2026ReasonRec: A Reasoning-Augmented Multimodal Agent for Unified Recommendationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025GR-LLMs: Recent Advances in Generative Recommendation Based on Large Language Models
  2. 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learning
  3. 2026Reasoning to Rank: An End-to-End Solution for Exploiting Large Language Models for Recommendation
  4. 2026Learning Better Reasoning for Generative Recommendation with Semantic IDs
  5. 2025Generative Reasoning Recommendation via LLMs
  6. 2025RecLLM-R1: A Two-Stage Training Paradigm with Reinforcement Learning and Chain-of-Thought v1
  7. 2025R1-Ranker: Teaching LLM Rankers to Reason
  8. 2026Implicit Reasoning for Large Language Model-based Generative Recommendation