A Case for Specialisation in Non-Human Entities
Not on the map. Why?
Abstract (arXiv)
With the rise of large multi-modal AI models, fuelled by recent interest in large language models (LLMs), the notion of artificial general intelligence (AGI) went from being restricted to a fringe community, to dominate mainstream large AI development programs. In contrast, in this paper, we make a case for specialisation, by reviewing the pitfalls of generality and stressing the industrial value of specialised systems. Our contribution is threefold. First, we review the most widely accepted arguments against specialisation, and discuss how their relevance in the context of human labour is actually an argument for specialisation in the case of non human agents, be they algorithms or human organisations. Second, we propose four arguments in favor of specialisation, ranging from machine learning robustness, to computer security, social sciences and cultural evolution. Third, we finally make a case for specification, discuss how the machine learning approach to AI has so far failed to catch up with good practices from safety-engineering and formal verification of software, and discuss how some emerging good practices in machine learning help reduce this gap. In particular, we justify the need for specified governance for hard-to-specify systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 132 references that are in the map. First posted on arXiv 5 Feb 2025.
Builds on
23 of 132 references.
References · 23
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2018Datasheets for Datasetscited by 1,371
- 2018Model Cards for Model Reportingcited by 1,068
- 2018The Hidden Vulnerability of Distributed Learning in Byzantiumcited by 324
- 2024COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllabilitycited by 162
- 2024Here Comes The AI Worm: Unleashing Zero-click Worms that Target GenAI-Powered Applicationscited by 58
- 2017A Voting-Based System for Ethical Decision Makingcited by 55
- 2020Collaborative Learning in the Jungle (Decentralized, Byzantine, Heterogeneous, Asynchronous and Nonconvex Learning)cited by 54
- 2020Adapting a Kidney Exchange Algorithm to Align with Human Valuescited by 36
- 2022On the Impossible Safety of Large AI Modelscited by 27
11 more
- 2022The Brussels Effect and Artificial Intelligence: How EU regulation will impact the global AI marketcited by 18
- 2021Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameterscited by 17
- 2022An Equivalence Between Data Poisoning and Byzantine Gradient Attackscited by 16
- 2023Scaling Laws Do Not Scalecited by 13
- 2021Tournesol: A quest for a large, secure and trustworthy database of reliable human judgmentscited by 11
- 2024Bluesky and the AT Protocol: Usable Decentralized Social Mediacited by 9
- 2024On Goodhart's law, with an application to value alignmentcited by 9
- 2016Lower Bounds for Differential Privacy from Gaussian Widthcited by 3
- 2024The poison of dimensionalitycited by 3
- 2022Solidago: A Modular Collaborative Scoring Pipelinecited by 1
- 2024Google's Chrome Antitrust Paradoxcited by 1
Built on by
Not cited yet.