Artificial Jagged Intelligence as Uneven Optimization Energy Allocation Capability Concentration, Redistribution, and Optimization Governance
Not on the map. Why?
Abstract (arXiv)
Artificial Jagged Intelligence (AJI) denotes a recurring pattern in which large learning systems exhibit strong local capabilities while remaining weak or brittle in other domains. This paper develops a formal theory of AJI as uneven allocation of optimization pressure. We model training as a finite-budget process that distributes gradient-driven update energy across capability-relevant directions in parameter space. In this model, jagged capability profiles arise from anisotropic objective structure, data geometry, and representational coupling rather than from a single scalar quantity called intelligence. The paper defines capability gain, optimization energy share, and jaggedness, then proves that persistent concentration of cumulative update energy yields lower bounds on dispersion in capability gains. A finite-budget tradeoff theorem shows why prioritizing one capability can impose opportunity costs on others unless positive coupling or shared structure offsets the cost. The analysis also studies redistribution mechanisms, including energy-variance regularization and auxiliary structural objectives, as interventions that reshape the optimization field. The resulting framework links uneven emergence, training architecture, and optimization governance. It predicts that early concentration of update energy should forecast later capability jaggedness; that scaling under a narrow objective need not eliminate anisotropy; and that explicitly funded auxiliary objectives can revive neglected capabilities. AJI is therefore not merely a descriptive label for uneven model behavior, but a testable theory of how finite optimization resources produce concentrated, delayed, and structurally uneven capability formation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 40 references that are in the map. First posted on arXiv 2 May 2026.
Builds on
34 of 40 references.
References · 34
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,621
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2016Concrete Problems in AI Safetycited by 1,642
- 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,631
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2022Red Teaming Language Models with Language Modelscited by 1,026
22 more
- 2022Toy Models of Superpositioncited by 971
- 2022In-context Learning and Induction Headscited by 964
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 839
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 821
- 2018On Lazy Training in Differentiable Programmingcited by 675
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 629
- 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 523
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
- 2021Explaining Neural Scaling Lawscited by 363
- 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
- 2022Multi-Task Learning as a Bargaining Gamecited by 215
- 2022Predictability and Surprise in Large Generative Modelscited by 210
- 2020Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernelcited by 187
- 2023Model evaluation for extreme riskscited by 177
- 2018Towards Understanding the Role of Over-Parametrization in Generalization of Neural Networkscited by 142
- 2022Is Power-Seeking AI an Existential Risk?cited by 105
- 2018Adapting Auxiliary Losses Using Gradient Similaritycited by 100
- 2023Frontier AI Regulation: Managing Emerging Risks to Public Safetycited by 98
- 2021RotoGrad: Gradient Homogenization in Multitask Learningcited by 83
- 2023Predicting Grokking Long Before it Happens: A look into the loss landscape of models which grokcited by 35
- 2024Towards Data Governance of Frontier AI Modelscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Where Does Jagged Competence Come From?cited by 0
- 2026Where Does Jagged Competence Come From?2 Oct 2026