Autonomy and Agency in Agentic AI: Architectural Tactics for Regulated Contexts
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Deploying agentic AI in regulated contexts requires principled reasoning about two design dimensions: agency (what the system can do) and autonomy (how much it acts without human involvement). Though often treated independently, they are coupled: at higher autonomy, human error correction is less available, so reliable operation requires constraining agency accordingly; compliance requirements reinforce this by mandating human involvement as action consequences grow. Yet no established approach addresses them jointly, leaving practitioners without a principled basis for reasoning about oversight, action consequences, and error correction. This work introduces a two-dimensional design space in which both dimensions are organised into five operational levels, making the coupling explicit and navigable. Autonomy ranges from human-commanded operation (L1) to fully autonomous monitoring (L5); agency ranges from reasoning over supplied context (L1) to committed writes to authoritative records (L5). Building on this space, we propose six architectural tactics--checkpoints, escalation, multi-agent delegation, tool provisioning, tool fencing, and write staging--for adjusting a deployment's position within it. The tactics are grounded in two worked examples from public-sector contexts, illustrating how they apply under realistic compliance constraints. We further examine five deployment parameters--model capability, agent architecture, tool fidelity, workflow bottlenecks, and evaluation--that shape what is achievable at any configuration independently of agency and autonomy. Together, the design space, tactics, and deployment parameters provide a shared vocabulary for principled, compliance-aware agentic AI design in which responsibility, auditability, and reversibility are explicit design considerations rather than properties that must be retrofitted after deployment.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 16 of its 25 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
16 of 25 references.
Closest ancestors · 1
Same direction, newest first
- 2025Defeating Prompt Injections by Design24 Mar
Other references · 15
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 167
- 2025Establishing Best Practices for Building Rigorous Agentic Benchmarkscited by 94
- 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directionscited by 46
- 2025Levels of Autonomy for AI Agentscited by 45
- 2025Fully Autonomous AI Agents Should Not be Developedcited by 43
- 2025Magentic-UI: Towards Human-in-the-loop Agentic Systemscited by 41
- 2026Atomix: Timely, Transactional Tool Use for Reliable Agentic Workflowscited by 27
- 2025Securing the Model Context Protocol (MCP): Risks, Controls, and Governancecited by 22
- 2025Agentic AI Needs a Systems Theorycited by 19
- 2025Oversight Structures for Agentic AI in Public-Sector Organizationscited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026The Digital Apprentice: A Framework for Human-Directed Agentic AI Development
- 2026Separating Capability from Permission: A Governance Framework for Agentic AI Autonomy Levels
- 2026Intelligence as Managed Autonomy: Failure, Escalation, and Governance for Agentic AI Systems
- 2026A pragmatic approach to regulating AI agents
- 2026Evaluating Bounded Autonomy in Regulated Agentic AI: A Diagnostic Harness with Constitutional Rewards, Escalation Labels, and Runtime Governance
- 2026The CASE Framework: A Multi-Disciplinary Control Architecture for Governing Enterprise Agentic AI
- 2025Architectures for Building Agentic AI
- 2026Anticipatory Human Oversight of Agentic AI: A Philosophical Account