mlsanityData to 14 Oct 2026

An Aristotelian ontology of instrumental goals: Structural features to be managed and not failures to be eliminated

arXiv 2510.25471 ↗First posted 29 Oct 2025cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Instrumental goals such as resource acquisition, power-seeking, and self-preservation are key to contemporary AI alignment research, yet the phenomenon's ontology remains under-theorised. This article develops an ontological account of instrumental goals and draws out governance-relevant distinctions for advanced AI systems. After systematising the dominant alignment literature on instrumental goals we offer an exploratory Aristotelian framework that treats advanced AI systems as complex artefacts whose ends are externally imposed through design, training and deployment. On a structural reading, Aristotle's notion of hypothetical necessity explains why, given an imposed end pursued over extended horizons in particular environments, certain enabling conditions become conditionally required, thereby yielding robust instrumental tendencies. On a contingent reading, accidental causation and chance-like intersections among training regimes, user inputs, infrastructure and deployment contexts can generate instrumental-goal-like behaviours not entailed by the imposed end-structure. This dual-aspect ontology motivates for governance and management approaches that treat instrumental goals as features of advanced AI systems to be managed rather than anomalies eliminable by technical interventions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 66 references that are in the map. First posted on arXiv 29 Oct 2025.

Builds on

27 of 66 references.

References · 27

  1. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  2. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  3. 2018Scalable agent alignment via reward modeling: a research directioncited by 447
  4. 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 328
  5. 2023AI Alignment: A Comprehensive Surveycited by 263
  6. 2017Inverse Reward Designcited by 249
  7. 2022Defining and Characterizing Reward Hackingcited by 203
  8. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
  9. 2024Evaluating Frontier Models for Dangerous Capabilitiescited by 128
  10. 2022Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goalscited by 126
  11. 2019Optimal Policies Tend to Seek Powercited by 119
  12. 2019Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspectivecited by 108
15 more
  1. 2022Is Power-Seeking AI an Existential Risk?cited by 105
  2. 2023Evaluating Language-Model Agents on Realistic Autonomous Taskscited by 96
  3. 2025Evaluating Frontier Models for Stealth and Situational Awarenesscited by 37
  4. 2021The Challenge of Value Alignment: from Fairer Algorithms to AI Safetycited by 35
  5. 2025Evaluating the Paperclip Maximizer: Are RL-Based Language Models More Likely to Pursue Instrumental Goals?cited by 33
  6. 2024The Reasons that Agents Act: Intention and Instrumental Goalscited by 23
  7. 2025Deception in LLMs: Self-Preservation and Autonomous Goals in Large Language Modelscited by 16
  8. 2023Deceptive Alignment Monitoringcited by 14
  9. 2025AgentBreeder: Mitigating the AI Safety Risks of Multi-Agent Scaffolds via Self-Improvementcited by 14
  10. 2024Jailbreaking as a Reward Misspecification Problemcited by 11
  11. 2024Contextual Moral Value Alignment Through Context-Based Aggregationcited by 10
  12. 2023A Review of the Evidence for Existential Risk from AI via Misaligned Power-Seekingcited by 8
  13. 2025Are Large Reasoning Models Interruptible?cited by 7
  14. 2025Self-Improvement in Multimodal Large Language Models: A Surveycited by 6
  15. 2025How Artificial Intelligence Leads to Knowledge Why: An Inquiry Inspired by Aristotle's Posterior Analyticscited by 4

Built on by

Not cited yet.