mlsanityData to 13 Oct 2026

Alignment, Agency and Autonomy in Frontier AI: A Systems Engineering Perspective

arXiv 2503.05748 ↗First posted 20 Feb 2025cs.CY cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

As artificial intelligence scales, the concepts of alignment, agency, and autonomy have become central to AI safety, governance, and control. However, even in human contexts, these terms lack universal definitions, varying across disciplines such as philosophy, psychology, law, computer science, mathematics, and political science. This inconsistency complicates their application to AI, where differing interpretations lead to conflicting approaches in system design and regulation. This paper traces the historical, philosophical, and technical evolution of these concepts, emphasizing how their definitions influence AI development, deployment, and oversight. We argue that the urgency surrounding AI alignment and autonomy stems not only from technical advancements but also from the increasing deployment of AI in high-stakes decision making. Using Agentic AI as a case study, we examine the emergent properties of machine agency and autonomy, highlighting the risks of misalignment in real-world systems. Through an analysis of automation failures (Tesla Autopilot, Boeing 737 MAX), multi-agent coordination (Metas CICERO), and evolving AI architectures (DeepMinds AlphaZero, OpenAIs AutoGPT), we assess the governance and safety challenges posed by frontier AI.

Key facts. Cited by 7 papers in the map (data through 13 Oct 2026). Builds on 5 of its 33 references that are in the map. First posted on arXiv 20 Feb 2025.

Builds on

5 of 33 references.

References · 5

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2017Deep reinforcement learning from human preferencescited by 3,871
  3. 2016Concrete Problems in AI Safetycited by 1,614
  4. 2017Learning with Opponent-Learning Awarenesscited by 220
  5. 2018The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communitiescited by 78

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 4; 2026: 3.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Intent-aligned AI systems deplete human agency: the need for agency foundations research in AI safety
  2. 2026Institutional AI: A Governance Framework for Distributional AGI Safety
  3. 2025Characterizing AI Agents for Alignment and Governance
  4. 2024Using AI Alignment Theory to understand the potential pitfalls of regulatory frameworks
  5. 2026The CASE Framework: A Multi-Disciplinary Control Architecture for Governing Enterprise Agentic AI
  6. 2026Autonomy and Agency in Agentic AI: Architectural Tactics for Regulated Contexts
  7. 2026Separating Capability from Permission: A Governance Framework for Agentic AI Autonomy Levels
  8. 2026Intelligence as Managed Autonomy: Failure, Escalation, and Governance for Agentic AI Systems