LAWS: Learning from Actual Workloads Symbolically -- A Self-Certifying Parametrized Cache Architecture for Neural Inference, Robotics, and Edge Deployment
On the map: Mixture-of-experts → Efficient MoE training and inference systems
Abstract (arXiv)
We introduce LAWS (Learning from Actual Workloads Symbolically), a self-certifying inference caching architecture that builds a growing library of certified expert functions from deployment observations. Each expert covers a region of input space defined by a node in the Probabilistic Language Trie (PLT) of the base model and carries a formal error bound holding uniformly over all inputs. The central result is a self-certification theorem: for any input x, the LAWS approximation error is bounded by epsilon_fit + 2*Lambda(W)*C_E, where Lambda(W) is the model Lipschitz constant, C_E is the maximum embedding diameter, and epsilon_fit is the expert training error -- all checkable at deployment time without ground truth. We prove that LAWS generalizes both Mixture-of-Experts and KV prefix caching as special cases and is strictly more expressive than any fixed-K MoE or finite cache. Further results include a monotone hit rate theorem (any-match routing ensures coverage only increases), an expert library growth rate of O(2^H log N) where H is workload entropy, a fleet learning convergence theorem with Omega(K) speedup for K-unit fleets, and an over-the-air update bandwidth bound. We conjecture that LAWS is acquisition-optimal among stationary online caching algorithms and that the effective Lipschitz constant on the training distribution grows polynomially rather than exponentially in depth. Applications are developed for LLM inference, robotic control, and multi-agent edge deployment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Efficient MoE training and inference systems, one of 12 directions in Mixture-of-experts. Builds on 12 of its 47 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
12 of 47 references.
References · 12
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024Mixtral of Expertscited by 1,785
- 2016Error bounds for approximations with deep ReLU networkscited by 567
- 2022Efficiently Scaling Transformer Inferencecited by 529
- 2025Skill-Based Mixture-of-Experts: Adaptive Routing for Heterogeneous Reasoning via Inferred Skillscited by 24
- 2023Fast Feedforward Networkscited by 10
- 2026Probabilistic Language Tries: A Unified Framework for Compression, Decision Policies, and Execution Reusecited by 2
- 2026Sequential KV Cache Compression via Probabilistic Language Tries: Beyond the Per-Vector Shannon Limitcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MawForge: Memory-Bounded Expert Materialization for Local Mixture-of-Experts Inference
- 2026Sticky Routing: Training MoE Models for Memory-Efficient Inference
- 2026rMuscle: Robotic Muscle Memory for Efficient Vision-Language-Action Model Inference
- 2025Not All Models Suit Expert Offloading: On Local Routing Consistency of Mixture-of-Expert Models
- 2026SAEM: Stage-Aware Expert Management for Memory-Efficient MoE Inference in Chain-of-Thought Reasoning
- 2025SlimCaching: Edge Caching of Mixture-of-Experts for Distributed Inference
- 2026Beyond Speedup -- Utilizing KV Cache for Sampling and Reasoning
- 2026SpecMD: A Comprehensive Study On Speculative Expert Prefetching