Comprehensive AI governance requires addressing non-model gains
Not on the map. Why?
Abstract (arXiv)
Frontier AI governance often centres on the model-level governance paradigm, which assumes that a model's capability profile is primarily a function of the compute and data used during training. This position paper argues that model-level governance becomes less effective when capability progress is increasingly driven by "non-model gains"--improvements that are independent from advances in the base model. We formalise the concept of non-model gains and provide a taxonomy of three distinct vectors of capability gain: inference gain (scaling compute at test-time), systems gain (post-training enhancements such as scaffolds), and asset gain (enhancing a model with restricted assets). We demonstrate how these vectors--alongside potential future impacts from embodiment, continual learning, and AI diffusion--may undermine risk management strategies that hinge mostly on pre-deployment evaluation and mitigation. We provide an overview of governance approaches that go beyond the model level: system, entity, agent, and cloud governance. Finally, we emphasise the importance of societal resilience as a complement to these governance layers.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 82 references that are in the map. First posted on arXiv 1 May 2026.
Builds on
42 of 82 references.
References · 42
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2017Deep Learning Scaling is Predictable, Empiricallycited by 556
- 2020Scaling Laws for Autoregressive Generative Modelingcited by 510
- 2021Explaining Neural Scaling Lawscited by 353
30 more
- 2022Large Language Models are Better Reasoners with Self-Verificationcited by 304
- 2023Large Language Model Unlearningcited by 288
- 2021Scaling Laws for Transfercited by 265
- 2023AI Alignment: A Comprehensive Surveycited by 256
- 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 228
- 2025Multi-Agent Risks from Advanced AIcited by 150
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
- 2024Observational Scaling Laws and the Predictability of Language Model Performancecited by 128
- 2024Evaluating Frontier Models for Dangerous Capabilitiescited by 121
- 2021Algorithmic Monoculture and Social Welfarecited by 98
- 2022Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?cited by 89
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 82
- 2025Nested Learning: The Illusion of Deep Learning Architecturescited by 69
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 67
- 2024LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoningcited by 57
- 2025Infrastructure for AI Agentscited by 40
- 2024Computing Power and the Governance of Artificial Intelligencecited by 38
- 2025Recursive Self-Aggregation Unlocks Deep Thinking in Large Language Modelscited by 30
- 2023AI capabilities can be significantly improved without expensive retrainingcited by 28
- 2024A Survey of Robotic Language Grounding: Tradeoffs between Symbols and Embeddingscited by 23
- 2024Safety case template for frontier AI: A cyber inability argumentcited by 19
- 2025Forecasting Rare Language Model Behaviorscited by 16
- 2025Scaling Inference-Efficient Language Modelscited by 14
- 2023VITA: A Multi-modal LLM-based System for Longitudinal, Autonomous, and Adaptive Robotic Mental Well-being Coachingcited by 13
- 2024Societal Adaptation to Advanced AIcited by 10
- 2026Frontier AI Auditing: Toward Rigorous Third-Party Assessment of Safety and Security Practices at Leading AI Companiescited by 10
- 2024Governing Through the Cloud: The Intermediary Role of Compute Providers in AI Regulationcited by 9
- 2025The Singapore Consensus on Global AI Safety Research Prioritiescited by 9
- 2025One Bug, Hundreds Behind: LLMs for Large-Scale Bug Discoverycited by 6
- 2025Societal Capacity Assessment Framework: Measuring Resilience to Inform Advanced AI Risk Managementcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.