mlsanityData to 14 Oct 2026

Specifying the Delegated-Autonomy Boundary: Requirements Engineering for Agentic AI

arXiv 2607.17225 ↗First posted 19 Jul 2026cs.SE cs.AIcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Agentic AI systems do not just predict or recommend; they plan, maintain state, and act in external environments with varying degrees of autonomy. This changes the requirements engineering problem in a specific and under-addressed way: it introduces what we call the delegated-autonomy boundary -- the set of decisions about what may be delegated to the system, under what graduated authority, with what oversight, and how control is returned. Current practices bury these decisions inside prompts, tool schemas, and runtime policies, even though they are requirements-level commitments. This paper proposes two complementary artifacts. First, an Agency Justification Record (AJR) helps teams decide when an agent is warranted over simpler alternatives. Second, an Agentic Delegation Policy (ADP) captures what must be specified for safe and effective development: purpose, authority, information, coordination, assurance, and evolution. Crucially, authority in the ADP is modelled as graduated, i.e., a tiered structure. We illustrate the framework with two contrasting examples: a safety-critical hospital discharge coordination agent and an automated code review agent.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 8 of its 29 references that are in the map. First posted on arXiv 19 Jul 2026.

Builds on

8 of 29 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systems19 Feb

Other references · 7

  1. 2024Agents in Software Engineering: Survey, Landscape, and Visioncited by 60
  2. 2019Requirements Engineering for Machine Learning: Perspectives from Data Scientistscited by 49
  3. 2022Requirements Engineering for Artificial Intelligence Systems: A Systematic Mapping Studycited by 14
  4. 2025Facilitating Trustworthy Human-Agent Collaboration in LLM-based Multi-Agent System oriented Software Engineeringcited by 7
  5. 2025Requirements-Driven Automated Software Testing: A Systematic Reviewcited by 2
  6. 2025Prompt Engineering for Requirements Engineering: A Literature Review and Roadmapcited by 2
  7. 2026Agentic Problem Frames: A Systematic Approach to Engineering Reliable Domain Agentscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Separating Capability from Permission: A Governance Framework for Agentic AI Autonomy Levels
  2. 2026Autonomy and Agency in Agentic AI: Architectural Tactics for Regulated Contexts
  3. 2026A pragmatic approach to regulating AI agents
  4. 2026Beyond Task Success: An Evidence-Synthesis Framework for Evaluating, Governing, and Orchestrating Agentic AI
  5. 2026Overlaying Governance: A Compositional Authorization Framework for Delegation and Scope in Agentic AI
  6. 2026Regret Dominates Surprise: Design-Time Requirements Engineering for Agentic-AI Safety
  7. 2026The Work Behind Delegation: A Framework for Supervising AI Coding Agents
  8. 2026Runtime Governance for AI Agents: Policies on Paths