mlsanityData to 7 Oct 2026

ReCast: Recasting Learning Signals for Reinforcement Learning in Generative Recommendation

arXiv 2604.22169 ↗First posted 24 Apr 2026cs.LG cs.AI cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Generic group-based RL assumes that sampled rollout groups are already usable learning signals. We show that this assumption breaks down in sparse-hit generative recommendation, where many sampled groups never become learnable at all. We propose ReCast, a repair-then-contrast learning-signal framework that first restores minimal learnability for all-zero groups and then replaces full-group reward normalization with a boundary-focused contrastive update on the strongest positive and the hardest negative. ReCast leaves the outer RL framework unchanged, modifies only within-group signal construction, and partially decouples rollout search width from actor-side update width. Across multiple generative recommendation tasks, ReCast consistently outperforms OpenOneRec-RL, achieving up to 36.6% relative improvement in Pass@1. Its matched-budget advantage is substantially larger: ReCast reaches the baseline's target performance with only 4.1% of the rollout budget, and this advantage widens with model scale. The same design also yields direct system-level gains, reducing actor-side update time by 16.60x, lowering peak allocated memory by 16.5%, and improving actor MFU by 14.2%. Mechanism analysis shows that ReCast mitigates the persistent all-zero / single-hit regime, restores learnability when natural positives are scarce, and converts otherwise wasted rollout budget into more stable policy updates. These results suggest that, for generative recommendation, the decisive RL problem is not only how to assign rewards, but how to construct learnable optimization events from sparse, structured supervision.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 31 references that are in the map. First posted on arXiv 24 Apr 2026.

Builds on

25 of 31 references.

References · 25

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
  3. 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 336
  4. 2023Recommender Systems with Generative Retrievalcited by 191
  5. 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
  6. 2022M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systemscited by 152
  7. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  8. 2024Learnable Item Tokenization for Generative Recommendationcited by 106
  9. 2024EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaborationcited by 55
  10. 2025OneRec-Think: In-Text Reasoning for Generative Recommendationcited by 47
  11. 2025Reinforced Latent Reasoning for LLM-based Recommendationcited by 46
  12. 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learningcited by 32
13 more
  1. 2025OneRec-V2 Technical Reportcited by 28
  2. 2025OneRec Technical Reportcited by 24
  3. 2024Content-Based Collaborative Generation for Recommender Systemscited by 16
  4. 2025OpenOneRec Technical Reportcited by 16
  5. 2026Reasoning over Semantic IDs Enhances Generative Recommendationcited by 12
  6. 2025OxygenREC: An Instruction-Following Generative Framework for E-commerce Recommendationcited by 7
  7. 2025UNGER: Generative Recommendation with A Unified Code via Semantic and Collaborative Integrationcited by 6
  8. 2025EAGER-LLM: Enhancing Large Language Models as Recommenders through Exogenous Behavior-Semantic Integrationcited by 6
  9. 2025GFlowGR: Fine-tuning Generative Recommendation Frameworks with Generative Flow Networkscited by 3
  10. 2026Fine-grained Semantics Integration for Large Language Model-based Recommendationcited by 3
  11. 2026Spend Search Where It Pays: Value-Guided Structured Sampling and Optimization for Generative Recommendationcited by 2
  12. 2026SAGE: Sequence-level Adaptive Gradient Evolution for Generative Recommendationcited by 1
  13. 2026Towards Sample-Efficient and Stable Reinforcement Learning for LLM-based Recommendationcited by 1

Built on by

Not cited yet.