Continued AI Scaling Requires Repeated Efficiency Doublings
Not on the map. Why?
Abstract (arXiv)
This paper argues that continued AI scaling requires repeated efficiency doublings. Classical AI scaling laws remain useful because they make progress predictable despite diminishing returns, but the compute variable in those laws is best read as logical compute, not as a record of one fixed physical implementation. Practical burden therefore depends on the efficiency with which physical resources realize that compute. Under that interpretation, diminishing returns mean rising operational burden, not merely a flatter curve. Sustained progress then requires recurrent gains in hardware, algorithms, and systems that keep additional logical compute feasible at acceptable cost. The relevant analogy is Moore's Law, understood less as a theorem than as an organizing expectation of repeated efficiency improvement. AI does not yet have a single agreed cadence for such gains, but recent evidence suggests trends that are at least Moore-like and sometimes faster. The paper's claim is therefore simple: if AI scaling is to remain active, repeated efficiency doublings are not optional. They are required.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 16 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
12 of 16 references.
References · 12
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2024Scaling Laws for Fine-Grained Mixture of Expertscited by 173
- 2023Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Lawscited by 159
- 2025The Art of Scaling Reinforcement Learning Compute for LLMscited by 101
- 2024Scaling Laws for Precisioncited by 95
- 2026Attention Residualscited by 65
- 2020Measuring the Algorithmic Efficiency of Neural Networkscited by 52
- 2025Joint MoE Scaling Laws: Mixture of Experts Can Be Memory Efficientcited by 31
- 2025Scaling Behaviors of LLM Reinforcement Learning Post-Training: An Empirical Study in Mathematical Reasoningcited by 29
- 2024Provable Scaling Laws for the Test-Time Compute of Large Language Modelscited by 26
Built on by
Not cited yet.