Bounded Autonomy for Enterprise AI: Typed Action Contracts and Consumer-Side Execution
Not on the map. Why?
Abstract (arXiv)
Large language models are increasingly used as natural-language interfaces to enterprise software, but their direct use as system operators remains unsafe. Model errors can propagate into unauthorized actions, malformed requests, cross-workspace execution, and other costly failures. We argue this is primarily an execution architecture problem. We present a bounded-autonomy architecture in which language models may interpret intent and propose actions, but all executable behavior is constrained by typed action contracts, permission-aware capability exposure, scoped context, validation before side effects, consumer-side execution boundaries, and optional human approval. The enterprise application remains the source of truth for business logic and authorization, while the orchestration engine operates over an explicit published actions manifest. We evaluate the architecture in a deployed multi-tenant enterprise application across three conditions: manual operation, unconstrained AI with safety layers disabled, and full bounded autonomy. Across 25 scenario trials spanning seven failure families, the bounded-autonomy system completed 23 of 25 tasks with zero unsafe executions, while the unconstrained configuration completed only 17 of 25. Two wrong-entity mutations escaped all consumer-contributed layers; only disambiguation and confirmation mechanisms intercept this class. Both AI conditions delivered 13-18x speedup over manual operation. Critically, removing safety layers made the system less useful: structured validation feedback guided the model to correct outcomes in fewer turns, while the unconstrained system hallucinated success. Several safety properties are structurally enforced by code and intercepted all targeted violations regardless of model output. The result is a practical, deployed architecture for making imperfect language models operationally useful in enterprise systems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 58 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
23 of 58 references.
References · 23
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
- 2025Progent: Securing AI Agents with Privilege Controlcited by 121
- 2025LlamaFirewall: An open source guardrail system for building secure AI agentscited by 114
- 2025SAGA: A Security Architecture for Governing AI Agentic Systemscited by 45
11 more
- 2022Efficient Learning of Safe Driving Policy via Human-AI Copilot Optimizationcited by 44
- 2025Enforcing Temporal Constraints for LLM Agentscited by 31
- 2025MCPToolBench++: A Large Scale AI Agent Model Context Protocol MCP Tool Use Benchmarkcited by 30
- 2017Agent-Agnostic Human-in-the-Loop Reinforcement Learningcited by 23
- 2025PALADIN: Self-Correcting Language Model Agents to Cure Tool-Failure Casescited by 21
- 2025MI9: An Integrated Runtime Governance Framework for Agentic AIcited by 18
- 2024ToolScan: A Benchmark for Characterizing Errors in Tool-Use LLMscited by 17
- 2026AgentHallu: Benchmarking Automated Hallucination Attribution of LLM-based Agentscited by 15
- 2026Before the Tool Call: Deterministic Pre-Action Authorization for Autonomous AI Agentscited by 12
- 2025Protect: Towards Robust Guardrailing Stack for Trustworthy Enterprise LLM Systemscited by 3
- 2026The PBSAI Governance Ecosystem: A Multi-Agent AI Reference Architecture for Securing Enterprise AI Estatescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.