OverAct: Measuring and Mitigating Proactive Over-Authorization in LLM Tool-Calling Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
LLM agents with tool-calling capabilities can access external services and private user data, but they may retrieve more information than a user's request explicitly requires. We study this behavior in structured tool-calling agents and term it proactive over-authorization. This setting differs from filesystem-level coding agents because the main risk is unnecessary access to private data. We introduce OverAct, a controlled benchmark spanning eight privacy-sensitive domains with deterministic, judge-free scoring, together with an interpretive decision-theoretic framework that yields three testable predictions. Across seven models from four families, all models significantly exceed authorized scope. Request specificity is the strongest predictor of severity, over-authorization grows sublinearly with tool-pool size, and decoding temperature has little effect. These patterns are consistent with a cost-asymmetry account, suggesting that over-authorization arises more from structural decision tendencies than from decoding randomness. We also propose SelfAudit, a zero-shot inference-time method that generates request-grounded justifications and filters unjustified calls before execution. Ablation shows that explicit filtering is the main driver of scope reduction. SelfAudit reduces privacy-oriented excess by 43% without oracle knowledge.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 28 of its 45 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
28 of 45 references.
Closest ancestors · 6
Same direction, newest first
- 2026Overeager Coding Agents: Measuring Out-of-Scope Actions on Benign Tasks18 May
- 2025A Vision for Access Control in LLM-based Agent Systems13 Oct
- 2025Prompt Flow Integrity to Prevent Privilege Escalation in LLM Agents17 Mar
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
- 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep
Other references · 22
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2020Learning to summarize from human feedbackcited by 2,562
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,056
10 more
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 312
- 2024ToolSword: Unveiling Safety Issues of Large Language Models in Tool Learning Across Three Stagescited by 77
- 2022A Customized Text Sanitization Mechanism with Differential Privacycited by 51
- 2023On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlookcited by 15
- 2025Student-Centered Distillation Narrows the Agentic Gap Between Small and Large LLMscited by 11
- 2026Mock Worlds, Real Skills: Building Small Agentic Language Models with Synthetic Tasks, Simulated Environments, and Rubric-Based Rewardscited by 9
- 2026The Tool-Overuse Illusion: Why Does LLM Prefer External Tools over Internal Knowledge?cited by 6
- 2026Taming "Zombie'' Agents: A Markov State-Aware Framework for Resilient Multi-Agent Evolutioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MiniScope: A Least Privilege Framework for Authorizing Tool Calling Agents
- 2026AgentRaft: Automated Detection of Data Over-Exposure in LLM Agents
- 2026The Claws in Plain Sight: Unauthorized Context Disclosure through LLM Agent Tool Calls
- 2026Agents That Know Too Much: A Data-Centric Survey of Privacy in LLM Agents
- 2026ActGov: Governing LLM Agent Actions via Policy-Constrained Validation
- 2026Agent Memory Is a Surface for Endogenous Authorization Laundering
- 2026When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents
- 2026Capability Gates Are Not Authorization: Confused-Deputy Failures in LLM Agent Frameworks