mlsanityData to 14 Oct 2026

UniScale: Synergistic Entire Space Data and Model Scaling for Search Ranking

arXiv 2603.24226 ↗First posted 25 Mar 2026cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in Large Language Models (LLMs) have inspired a surge of scaling research in industrial search, advertising, and recommendation systems. However, existing approaches focus mainly on architectural improvements, overlooking the critical synergy between data and architecture design. We observe that scaling model parameters alone exhibits diminishing returns, and that the performance degradation caused by complex heterogeneous data distributions is often irrecoverable through model design alone. In this paper, we propose UniScale, a novel co-design framework that jointly optimizes data and architecture to unlock the full potential of model scaling. UniScale includes two core parts: (1) ES3 (Entire-Space Sample System), a high-quality data scaling system that expands the training signal beyond conventional sampling strategies through intra-domain expansion with hierarchical label attribution and cross-domain searchification; and (2) HHSFT (Heterogeneous Hierarchical Sample Fusion Transformer), a novel architecture that effectively models the complex heterogeneous distribution of scaled data via Heterogeneous Hierarchical Feature Interaction and Entire Space User Interest Fusion, thereby surpassing the performance ceiling of structure-only model tuning. Extensive experiments on large-scale industrial datasets demonstrate that UniScale achieves significant improvements and exhibits clear scaling trends. Online A/B tests on a real-world E-commerce search platform confirm that UniScale consistently outperforms strong production baselines, achieving 1.70% and 2.04% increases in user purchase and Gross Merchandise Value (GMV).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

17 of 36 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Scaling Laws for Neural Language Modelscited by 6,586
  3. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  4. 2020GLU Variants Improve Transformercited by 1,804
  5. 2016Wide & Deep Learning for Recommender Systemscited by 747
  6. 2022Mixture-of-Experts with Expert Choice Routingcited by 623
  7. 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
  8. 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
  9. 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
  10. 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 283
  11. 2018Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Ratecited by 173
  12. 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 173
5 more
  1. 2024Wukong: Towards a Scaling Law for Large-Scale Recommendationcited by 74
  2. 2023PEPNet: Parameter and Embedding Personalized Network for Infusing with Personalized Prior Informationcited by 60
  3. 2025OneTrans: Unified Feature Interaction and Sequence Modeling with One Transformer in Industrial Recommendercited by 35
  4. 2023Hiformer: Heterogeneous Feature Interactions Learning with Transformers for Recommender Systemscited by 14
  5. 2025HHFT: Hierarchical Heterogeneous Feature Transformer for Recommendation Systemscited by 4

Built on by

Not cited yet.