When Agents Act Unwatched: The Reduced-Supervision Paradox in Agentic AI
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Agentic AI is sold on a simple promise: the system keeps acting when the user stops watching. That promise creates an accountability inversion. As stepwise supervision recedes, verification does not disappear; it moves into the runtime infrastructure that defines authority, records action, interrupts execution, checks outcomes, and supports repair. We call this the reduced-supervision paradox. Using a 63-artifact audit, we examine its public visibility across 46 research papers and 17 engineering, documentation, security, and governance sources. We find that agents' action surfaces are far easier to reconstruct than the mechanisms needed to answer for their actions. Tool mediation and monitoring traces were clearly visible in 40 and 37 artifacts, whereas checkpoint placement was clearly visible in 6, validator independence in 4, recovery in 2, and contestability in 1. Three action paths show why this imbalance matters. A repository path can preserve rich diffs after a consequential change. A browser path can cross organizational boundaries faster than permissions travel. A service path can follow policy while leaving affected people without recourse. We argue that observability can become a substitute for accountability when it shifts verification onto users after meaningful intervention is no longer possible. Our action-path diagnostic instead asks whether a delegated action remains connected to authority, evidence, interruption, independent judgment, recovery, and challenge. The claim is deliberately bounded to public visibility; it does not establish the prevalence or effectiveness of undisclosed controls. We contribute an action-level account that recasts the harness from a technical wrapper into accountability infrastructure.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 30 of its 52 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
30 of 52 references.
Closest ancestors · 5
Same direction, newest first
- 2026SARC: A Governance-by-Architecture Framework for Agentic AI Systems8 May
- 2026From Governance Norms to Enforceable Controls: A Layered Translation Method for Runtime Guardrails in Agentic AI6 Apr
- 2024The Task Shield: Enforcing Task Alignment to Defend Against Indirect Prompt Injection in LLM Agents21 Dec
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agents5 Mar
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep
Other references · 25
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 363
- 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
- 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
- 2021To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-makingcited by 118
- 2024The Language Barrier: Dissecting Safety Challenges of LLMs in Multilingual Contextscited by 94
- 2024Red-Teaming for Generative AI: Silver Bullet or Security Theater?cited by 83
- 2025Authenticated Delegation and Authorized AI Agentscited by 65
- 2026Natural-Language Agent Harnessescited by 61
13 more
- 2023LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Pluginscited by 51
- 2021Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systemscited by 31
- 2024Towards interactive evaluations for interaction harms in human-AI systemscited by 29
- 2025SABER: Small Actions, Big Errors -- Safeguarding Mutating Steps in LLM Agentscited by 21
- 2026Building Effective AI Coding Agents for the Terminal: Scaffolding, Harness, Context Engineering, and Lessons Learnedcited by 18
- 2024Foundation Model Transparency Reportscited by 14
- 2025AI Agents and the Lawcited by 9
- 2025Interactional Fairness in LLM Multi-Agent Systems: An Evaluation Frameworkcited by 6
- 2025Incident Analysis for AI Agentscited by 5
- 2025Accountability Capture: How Record-Keeping to Support AI Transparency and Accountability (Re)shapes Algorithmic Oversightcited by 5
- 2024Do Responsible AI Artifacts Advance Stakeholder Goals? Four Key Barriers Perceived by Legal and Civil Stakeholderscited by 4
- 2025A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidentscited by 4
- 2025The Model Hears You: Audio Language Model Deployments Should Consider the Principle of Least Privilegecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Observability for Delegated Execution in Agentic AI Systems
- 2026Runtime Governance for AI Agents: Policies on Paths
- 2026Auditable Agents
- 2026Designing for Doubt: The Case for Informed Abstention in Autonomous Agents
- 2026No One to Blame: A Framework of Constitutive AI Unaccountability
- 2026The Troy Moment: How LLM Agents Adjudicate the Decision Point Under Impossible Tasks, Claimed Authority, and Peer Information
- 2026Beyond Agent Harnesses: Cross-Substrate Authority for Multi-Agent Systems
- 2026Autonomy and Agency in Agentic AI: Architectural Tactics for Regulated Contexts