mlsanityData to 14 Oct 2026

OneTrans-V2: Unifying Retrieval, Pre-rank, and Fine-rank with One Transformer in Industrial Recommender

arXiv 2609.28589 ↗First posted 23 Sep 2026cs.IRcited by 0

On the map: Mixture-of-experts → MoE for recommender systems

Abstract (arXiv)

Industrial recommendation systems typically operate as a cascade of retrieval, pre-rank, and fine-rank, but these stages are usually trained and served as separate models, causing repeated user-sequence encoding, isolated optimization, and duplicated engineering effort. Building on OneTrans' model-level unification, we present OneTrans-V2, one Transformer that unifies the entire cascade. It encodes the user behavior sequence once as a shared context while preserving stage-specific candidate features and computation. Joint training lets the three stages reinforce one another and enables in-model knowledge distillation from fine-rank to pre-rank. We scale the shared backbone with sparse mixture-of-experts (MoE), which increases capacity with bounded activated computation, and stabilize scaling with μP-style parameterization. To consolidate objective-specific retrieval channels, we introduce Decision-Conditioned Generative Retrieval (DCGR). DCGR predicts a decision prefix describing the upcoming interaction and generates items conditioned on it, allowing business objectives to steer a single generative process. Finally, Sequence-Native Training (SNT) organizes training around each user's lifelong behavior sequence and amortizes its encoding across exposures. Deployed across all three stages of a large-scale industrial recommendation system, OneTrans-V2 improves gross merchandise value (GMV) by 9.74% and, with a co-designed serving stack, delivers 3.2× the throughput of the cascade it replaces under the same hardware budget.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MoE for recommender systems, one of 12 directions in Mixture-of-experts. First posted on arXiv 23 Sep 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking System
  2. 2026OneMall: One Architecture, More Scenarios -- End-to-End Generative Recommender Family at Kuaishou E-Commerce
  3. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignment
  4. 2025RankMixer: Scaling Up Ranking Models in Industrial Recommenders
  5. 2026GR2 Technical Report
  6. 2026LLMAR: A Tuning-Free Recommendation Framework for Sparse and Text-Rich Industrial Domains
  7. 2025Equip Pre-ranking with Target Attention by Residual Quantization
  8. 2025OxygenREC: An Instruction-Following Generative Framework for E-commerce Recommendation