OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking System
On the map: LLM reasoning → LLM reasoning for recommendation
Abstract (arXiv)
Despite the growing interest in replicating the scaled success of large language models (LLMs) in industrial search and recommender systems, most existing industrial efforts remain limited to transplanting Transformer architectures, which bring only incremental improvements over strong Deep Learning Recommendation Models (DLRMs). From a first principle perspective, the breakthroughs of LLMs stem not only from their architectures but also from two complementary mechanisms: context engineering, which enriches raw input queries with contextual cues to better elicit model capabilities, and multi-step reasoning, which iteratively refines model outputs through intermediate reasoning paths. However, these two mechanisms and their potential to unlock substantial improvements remain largely underexplored in industrial ranking systems. In this paper, we propose OnePiece, a unified framework that seamlessly integrates LLM-style context engineering and reasoning into both retrieval and ranking models of industrial cascaded pipelines. OnePiece is built on a pure Transformer backbone and further introduces three key innovations: (1) structured context engineering, which augments interaction history with preference and scenario signals and unifies them into a structured tokenized input sequence for both retrieval and ranking; (2) block-wise latent reasoning, which equips the model with multi-step refinement of representations and scales reasoning bandwidth via block size; (3) progressive multi-task training, which leverages user feedback chains to effectively supervise reasoning steps during training. OnePiece has been deployed in the main personalized search scenario of Shopee and achieves consistent online gains across different key business metrics, including over +2% GMV/UU and a +2.90% increase in advertising revenue.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Placed in LLM reasoning for recommendation, one of 17 directions in LLM reasoning. Builds on 29 of its 60 references that are in the map. First posted on arXiv 22 Sep 2025.
Builds on
29 of 60 references.
Closest ancestors · 5
Same direction, newest first
- 2025R4ec: A Reasoning, Reflection, and Refinement Framework for Recommendation Systems23 Jul
- 2025Reinforced Latent Reasoning for LLM-based Recommendation25 May
- 2025ThinkRec: Thinking-based recommendation via LLM21 May
- 2025Slow Thinking for Sequential Recommendation13 Apr
- 2025Reason4Rec: Deliberative User Preference Alignment of Large Language Models for Recommendation4 Feb
Other references · 24
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023A Survey of Large Language Modelscited by 2,576
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
- 2017Tacotron: Towards End-to-End Speech Synthesiscited by 490
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
- 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 225
- 2023Large Language Model Guided Tree-of-Thoughtcited by 221
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
- 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
- 2025A Survey of Context Engineering for Large Language Modelscited by 126
12 more
- 2024Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphscited by 119
- 2025Token Assorted: Mixing Latent and Text Tokens for Improved Language Model Reasoningcited by 91
- 2025A Survey on Latent Reasoningcited by 81
- 2023Unleashing the potential of prompt engineering for large language modelscited by 72
- 2023Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Modelscited by 52
- 2025Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendationcited by 51
- 2024Prompt Design and Engineering: Introduction and Advanced Methodscited by 45
- 2025OneSearch: A Preliminary Exploration of the Unified End-to-End Generative Framework for E-commerce Searchcited by 25
- 2024Self-Refine Instruction-Tuning for Aligning Reasoning in Language Modelscited by 24
- 2023Probabilistic Tree-of-thought Reasoning for Answering Knowledge-intensive Complex Questionscited by 19
- 2025LARES: Latent Reasoning for Sequential Recommendationcited by 12
- 2024Mirror: A Multiple-perspective Self-Reflection Method for Knowledge-rich Reasoningcited by 10
Built on by
Citing papers per year: 2025: 5; 2026: 13.
18 papers.
Sort:
By area:
- 2025MiniOneRec: An Open-Source Framework for Scaling Generative Recommendationcited by 17
- 2026Reasoning over Semantic IDs Enhances Generative Recommendationcited by 13
- 2026OneReason Technical Reportcited by 8
- 2025Everything is Context: Agentic File System Abstraction for Context Engineeringcited by 6
- 2026S2GR: Stepwise Semantic-Guided Reasoning in Latent Space for Generative Recommendationcited by 6
- 2026GenRec: A Preference-Oriented Generative Framework for Large-Scale Recommendationcited by 5
- 2025MTmixAtt: Integrating Mixture-of-Experts with Multi-Mix Attention for Large-Scale Recommendationcited by 3
- 2026Verifiable Reasoning for LLM-based Generative Recommendationcited by 2
- 2026MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Cachescited by 2
- 2026HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendationcited by 2
- 2025HiGR: Industrial-Scale Hierarchical Generative Slate Recommendation Framework in Tencentcited by 1
- 2026LASAR: Latent Adaptive Semantic Aligned Reasoning for Generative Recommendationcited by 1
6 more
- 2026UniPinRec: Unifying Generative Retrieval and Ranking at Pinterest Scalecited by 1
- 2025ReaSeq: Unleashing World Knowledge via Reasoning for Sequential Modelingcited by 0
- 2026RGAlign-Rec: Ranking-Guided Alignment for Latent Query Reasoning in Recommendation Systemscited by 0
- 2026Intuition-Guided Latent Reasoning for LLM-Based Recommendationcited by 0
- 2026WhisperRec: Latent Reasoning for Efficient Foundation Recommendation Modelscited by 0
- 2026UniGD: A Unified Generative-Discriminative Framework for Industrial Retrievalcited by 0
- 2026UniGD: A Unified Generative-Discriminative Framework for Industrial Retrieval4 Aug 2026
- 2026WhisperRec: Latent Reasoning for Efficient Foundation Recommendation Models29 Jul 2026
- 2026Intuition-Guided Latent Reasoning for LLM-Based Recommendation26 Jun 2026
- 2026HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendation13 Jun 2026
- 2026OneReason Technical Report4 Jun 2026
- 2026UniPinRec: Unifying Generative Retrieval and Ranking at Pinterest Scale29 May 2026
- 2026LASAR: Latent Adaptive Semantic Aligned Reasoning for Generative Recommendation11 May 2026
- 2026MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches24 Apr 2026
- 2026GenRec: A Preference-Oriented Generative Framework for Large-Scale Recommendation16 Apr 2026
- 2026Reasoning over Semantic IDs Enhances Generative Recommendation24 Mar 2026
- 2026Verifiable Reasoning for LLM-based Generative Recommendation8 Mar 2026
- 2026RGAlign-Rec: Ranking-Guided Alignment for Latent Query Reasoning in Recommendation Systems13 Feb 2026
6 more
- 2026S2GR: Stepwise Semantic-Guided Reasoning in Latent Space for Generative Recommendation26 Jan 2026
- 2025HiGR: Industrial-Scale Hierarchical Generative Slate Recommendation Framework in Tencent31 Dec 2025
- 2025ReaSeq: Unleashing World Knowledge via Reasoning for Sequential Modeling24 Dec 2025
- 2025Everything is Context: Agentic File System Abstraction for Context Engineering5 Dec 2025
- 2025MiniOneRec: An Open-Source Framework for Scaling Generative Recommendation28 Oct 2025
- 2025MTmixAtt: Integrating Mixture-of-Experts with Multi-Mix Attention for Large-Scale Recommendation17 Oct 2025
- 2026Reasoning over Semantic IDs Enhances Generative Recommendationcited by 13
- 2026OneReason Technical Reportcited by 8
- 2026S2GR: Stepwise Semantic-Guided Reasoning in Latent Space for Generative Recommendationcited by 6
- 2026Verifiable Reasoning for LLM-based Generative Recommendationcited by 2
- 2026HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendationcited by 2
- 2026LASAR: Latent Adaptive Semantic Aligned Reasoning for Generative Recommendationcited by 1
- 2025ReaSeq: Unleashing World Knowledge via Reasoning for Sequential Modelingcited by 0
- 2026RGAlign-Rec: Ranking-Guided Alignment for Latent Query Reasoning in Recommendation Systemscited by 0
- 2026Intuition-Guided Latent Reasoning for LLM-Based Recommendationcited by 0
- 2026WhisperRec: Latent Reasoning for Efficient Foundation Recommendation Modelscited by 0
- 2026WhisperRec: Latent Reasoning for Efficient Foundation Recommendation Models29 Jul 2026
- 2026Intuition-Guided Latent Reasoning for LLM-Based Recommendation26 Jun 2026
- 2026HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendation13 Jun 2026
- 2026OneReason Technical Report4 Jun 2026
- 2026LASAR: Latent Adaptive Semantic Aligned Reasoning for Generative Recommendation11 May 2026
- 2026Reasoning over Semantic IDs Enhances Generative Recommendation24 Mar 2026
- 2026Verifiable Reasoning for LLM-based Generative Recommendation8 Mar 2026
- 2026RGAlign-Rec: Ranking-Guided Alignment for Latent Query Reasoning in Recommendation Systems13 Feb 2026
- 2026S2GR: Stepwise Semantic-Guided Reasoning in Latent Space for Generative Recommendation26 Jan 2026
- 2025ReaSeq: Unleashing World Knowledge via Reasoning for Sequential Modeling24 Dec 2025
- 2025MiniOneRec: An Open-Source Framework for Scaling Generative Recommendationcited by 17
- 2026GenRec: A Preference-Oriented Generative Framework for Large-Scale Recommendationcited by 5
- 2026MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Cachescited by 2
- 2025HiGR: Industrial-Scale Hierarchical Generative Slate Recommendation Framework in Tencentcited by 1
- 2026UniPinRec: Unifying Generative Retrieval and Ranking at Pinterest Scalecited by 1
- 2026UniGD: A Unified Generative-Discriminative Framework for Industrial Retrievalcited by 0
- 2026UniGD: A Unified Generative-Discriminative Framework for Industrial Retrieval4 Aug 2026
- 2026UniPinRec: Unifying Generative Retrieval and Ranking at Pinterest Scale29 May 2026
- 2026MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches24 Apr 2026
- 2026GenRec: A Preference-Oriented Generative Framework for Large-Scale Recommendation16 Apr 2026
- 2025HiGR: Industrial-Scale Hierarchical Generative Slate Recommendation Framework in Tencent31 Dec 2025
- 2025MiniOneRec: An Open-Source Framework for Scaling Generative Recommendation28 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026OneTrans-V2: Unifying Retrieval, Pre-rank, and Fine-rank with One Transformer in Industrial Recommender
- 2026LLMAR: A Tuning-Free Recommendation Framework for Sparse and Text-Rich Industrial Domains
- 2025A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challenges
- 2025RankMixer: Scaling Up Ranking Models in Industrial Recommenders
- 2025Scaling Down, Serving Fast: Compressing and Deploying Efficient LLMs for Recommendation Systems
- 2026RRCM: Ranking-Driven Retrieval over Collaborative and Meta Memories for LLM Recommendation
- 2026GR2 Technical Report
- 2025Rethinking LLM-Based Recommendations: A Personalized Query-Driven Parallel Integration