Chain Dimension Scaling: Communication-Efficient Loop-Style Scaling for Industrial Short-Video Ranking
Not on the map. Why?
Abstract (arXiv)
Industrial recommendation rankers keep scaling in width and depth to billions of parameters, but this increasingly incurs costs in parameter growth, distributed communication overhead, and training inefficiency. We introduce underlineChain underlineDimension underlineScaling (CDS), a scaling strategy orthogonal to width and depth. CDS repeatedly applies a single feature-interaction block with parameters shared across iterations, so the number of iterations (the chain length) becomes a new scaling dimension that adds no parameters. A lightweight intra-chain residual connection stabilizes optimization and improves quality. CDS enables two regimes. In the compression regime, shallow blocks with a longer chain match deeper baselines with fewer parameters and faster training; in the quality-scaling regime, increasing chain length under a fixed parameter budget yields consistent offline and online gains, suggesting the chain dimension adds modeling capacity beyond parameter reuse. We evaluate CDS in a large-scale multi-task short-video ranking system in production. In the compression regime, CDS stays within 0.03% of baseline offline quality while reducing trainable parameters by 26.6% and improving training throughput by 6.4%, with neutral-to-positive online participation. In the quality-scaling regime, quality improves monotonically with chain length. Wall-clock analysis shows the efficiency gain comes mainly not from reduced FLOPs but from lower cross-device synchronization overhead and reduced optimizer update cost. These results position parameter-shared iterative computation as a practical, communication-efficient scaling axis for industrial ranking systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 35 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
31 of 35 references.
References · 31
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2020Reformer: The Efficient Transformercited by 1,668
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2016Wide & Deep Learning for Recommender Systemscited by 747
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 676
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
- 2017Deep Interest Network for Click-Through Rate Predictioncited by 544
- 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
- 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 415
- 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
19 more
- 2018AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networkscited by 320
- 2020ReZero is All You Need: Fast Convergence at Large Depthcited by 264
- 2025Reasoning with Latent Thoughts: On the Power of Looped Transformerscited by 240
- 2019Fixup Initialization: Residual Learning Without Normalizationcited by 198
- 2024Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendationscited by 188
- 2021PonderNet: Learning to Pondercited by 168
- 2025Scaling Latent Reasoning via Looped Language Modelscited by 165
- 2019Behavior Sequence Transformer for E-commerce Recommendation in Alibabacited by 130
- 2021GSPMD: General and Scalable Parallelization for ML Computation Graphscited by 111
- 2024Wukong: Towards a Scaling Law for Large-Scale Recommendationcited by 74
- 2026Parcae: Scaling Laws For Stable Looped Language Modelscited by 55
- 2025MTGR: Industrial-Scale Generative Recommendation Framework in Meituancited by 49
- 2025RankMixer: Scaling Up Ranking Models in Industrial Recommenderscited by 42
- 2026Loop, Think, & Generalize: Implicit Reasoning in Recurrent-Depth Transformerscited by 37
- 2025OneTrans: Unified Feature Interaction and Sequence Modeling with One Transformer in Industrial Recommendercited by 35
- 2025Chain-of-Experts: Unlocking the Communication Power of Mixture-of-Experts Modelscited by 9
- 2025Scaling Recommender Transformers to One Billion Parameterscited by 9
- 2025Beyond Parameters: Exploring Virtual Logic Depth for Scaling Lawscited by 4
- 2026LoopCTR: Unlocking the Loop Scaling Power for Click-Through Rate Predictioncited by 2
Built on by
Not cited yet.