A Deterministic Constant-Competitive Algorithm for Dynamic Mixture-of-Experts Serving
On the map: Mixture-of-experts → Efficient MoE training and inference systems
Abstract (arXiv)
Dynamic Mixture-of-Experts Serving allocates k replica GPUs among m experts as workloads change. At each round, the online algorithm sees the current workload, chooses integral replica counts, and pays bottleneck service cost plus replica movement. It does not know future workloads. Huang, Lou, and Xiao gave an O(sqrt(log k))-competitive randomized algorithm for this problem. We prove a deterministic O(1)-competitive algorithm. For every number of experts and every k>=1, the algorithm satisfies ALG_det <= 10 C_PB OPT + (5 C_PB + 8) k + 16, where C_PB is the absolute constant from Chasing Positive Bodies at resource augmentation one and covering sparsity two. Consequently, CR_det(k)<=10 C_PB for every k>=1, so CR_det(k)=Theta(1). The multiplicative factor does not depend on the number of experts, replica budget, horizon, or workload values. Thus randomization is not needed for the asymptotic guarantee. The proof has two layers. A finite tangent envelope, summable positive resets, and a nonexpansive balanced projection reduce reciprocal-max service costs to a deterministic exact-budget fractional path. A new deterministic rounding theorem converts every such path to integral allocations with service distortion three and movement bounded by the fractional movement plus 6k. The complete reduction, rounding theorem, causal composition, and quantified main theorem are machine-checked in Lean 4 relative to the positive-body result as the sole scientific source premise. The theorem concerns the allocation model above. It does not include network topology, shared-edge congestion, or routing decisions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Efficient MoE training and inference systems, one of 12 directions in Mixture-of-experts. Builds on 4 of its 4 references that are in the map. First posted on arXiv 15 Aug 2026.
Builds on
4 of 4 references.
References · 4
- 2026Mixture-of-Experts Servingcited by 2
- 2023Chasing Positive Bodiescited by 1
- 2025Dimension-Free Correlated Sampling for the Hypersimplexcited by 1
- 2026On Rounding on the Hypersimplexcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Sparsity Saves Compute, Not Samples: Oracle Inequalities for Dense and Sparse Mixture of Experts
- 2026DuoRate: Two-Rate Per-Expert Precision Allocation for Mixture-of-Experts Serving
- 2026TAOT: Topology-Aware Optimal Transport for Dynamic Expert Replica Placement in MoE Training
- 2026Function Over Form: Distributional Orthogonalization in Mixture-of-Experts with Replica Expert Mechanism
- 2026Director: Accelerating Distributed MoE Serving via Online Proactive Expert Placement
- 2024Communication-Efficient Sparsely-Activated Model Training via Sequence Migration and Token Condensation
- 2025Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts
- 2025A Theoretical Framework for Auxiliary-Loss-Free Load Balancing of Sparse Mixture-of-Experts in Large-Scale AI Models