Runtime Authorization of Self-Generated Subgoals in Long-Horizon Tool-Using AI Agents
Not on the map. Why?
Abstract (arXiv)
Long-horizon tool-using AI agents create subgoals, replan, delegate work, and compose sibling results. Per-tool permission checks cannot establish that a changing goal graph remains within the principal-approved task. We address this authorization gap in a finite structured domain with one principal and one authorization root. Each proposed goal-graph mutation carries a version-bound witness that its continuation traces, resources, obligations, invariants, and closing condition refine the active root contract; every protected effect is rechecked at an atomic commit boundary. Free-form goal text supplies no authority. We prove trace-policy and modeled forbidden-state preservation under explicit mediation, abstraction, freshness, and atomicity assumptions, plus conditional root-success preservation, a separation result for memoryless allowlists, exact finite-domain decidability, and universal-safety monotonicity under sound abstraction refinement. An executable model explores 340 states and 419 transitions. Across 96 matched cases covering 25 structural schemas, the complete mechanism commits zero forbidden states in 48 drifted cases and completes all 48 benign counterparts. Two public upstream runtime paths execute 258 native dispatches across 32 cases, with every case-level decision and receipt chain matching. A frozen host-local study covers 129 synthetic one-factor-at-a-time cells, all matching fixed decisions and reasons. A history-aware continuation comparator blocks every modeled bad trace prefix but commits all operations in 11 cases whose violations lie in typed resources, freshness, or explicit-join evidence outside its trace projection. Within the registered structured domains, runtime authorization preserves useful replanning while preventing self-generated subgoals from becoming a source of new authority.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 58 references that are in the map. First posted on arXiv 4 Oct 2026.
Builds on
24 of 58 references.
References · 24
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 548
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 538
- 2017Safe Reinforcement Learning via Shieldingcited by 449
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 401
- 2017Inverse Reward Designcited by 249
- 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agentscited by 223
- 2021Goal Misgeneralization in Deep Reinforcement Learningcited by 123
- 2025SafeArena: Evaluating the Safety of Autonomous Web Agentscited by 102
- 2022Safe Reinforcement Learning via Shielding under Partial Observabilitycited by 56
12 more
- 2026AgentLAB: Benchmarking LLM Agents against Long-Horizon Attackscited by 39
- 2026ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosiscited by 36
- 2025Enforcing Temporal Constraints for LLM Agentscited by 34
- 2026Unsafer in Many Turns: Benchmarking and Defending Multi-Turn Safety Risks in Tool-Using Agentscited by 30
- 2026Agent Behavioral Contracts: Formal Specification and Runtime Enforcement for Reliable Autonomous AI Agentscited by 19
- 2026HINTBench: Horizon-agent Intrinsic Non-attack Trajectory Benchmarkcited by 9
- 2026VIGIL: Runtime Enforcement of Behavioral Specifications in AI Agent Skillscited by 9
- 2026SafetyDrift: Predicting When AI Agents Cross the Line Before They Actually Docited by 5
- 2026Safe Multi-Agent Behavior Must Be Maintained, Not Merely Asserted: Constraint Drift in LLM-Based Multi-Agent Systemscited by 3
- 2026Structural Enforcement of Goal Integrity in AI Agents via Separation-of-Powers Architecturecited by 1
- 2026Beyond Suspicious Steps: Ontological Trust in Long-Horizon Agentscited by 1
- 2026CaMeLoT: CaMeL orchestrated with Temporal logic for static verification and livenesscited by 1
Built on by
Not cited yet.