AgentXploit: Autonomous Repository-to-Runtime Red-Teaming for AI Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 1 more
Abstract (arXiv)
AI agents combine language models with external data and tools that can modify files, call APIs, or execute code. Security failures can arise when adversarial content changes an agent's tool use or when the surrounding software contains vulnerabilities such as path traversal or command injection. We study authorized white-box pre-deployment auditing, where the auditor has access to the target repository and a controlled runtime, but successful attacks must still act through the task-defined attacker interface and be confirmed by an external verifier. We present AgentXploit, a two-role auditing system that separates repository-level attack-path discovery from runtime exploitation. The Analyzer Agent traces attacker-controlled inputs to sensitive operations and records code-supported candidate attack paths; the Exploiter Agent turns these paths into concrete attacks and revises them using runtime feedback. We also introduce AgentXploit-Bench, containing 72 reproducible vulnerabilities across 12 open-source AI-agent systems and frameworks. Across three runs, AgentXploit reaches 59.3% end-to-end success, compared with 38.4% for Codex. Under a token-budget-matched comparison, Codex reaches 46.3%. On AgentDojo, where injection points are provided, the Exploiter Agent reaches 79.2% attack success versus 52.7% for AgentVigil. These results highlight repository discovery and runtime exploitation as distinct challenges in end-to-end agent security auditing.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 34 of its 49 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
34 of 49 references.
Closest ancestors · 10
Same direction, newest first
- 2026Co-RedTeam: Orchestrated Security Discovery and Exploitation with LLM Agents2 Feb
- 2025PromptArmor: Simple yet Effective Prompt Injection Defenses21 Jul
- 2025AgentVigil: Generic Black-Box Red-teaming for Indirect Prompt Injection against LLM Agents9 May
- 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
- 2024Attacking Vision-Language Computer Agents via Pop-ups4 Nov
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
- 2024EIA: Environmental Injection Attack on Generalist Web Agents for Privacy Leakage17 Sep
- 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies28 Jul
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
- 2024Dissecting Adversarial Robustness of Multimodal LM Agents18 Jun
Other references · 24
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Promptscited by 520
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
12 more
- 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 342
- 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 328
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 325
- 2024Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Securitycited by 257
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
- 2024SecAlign: Defending Against Prompt Injection with Preference Optimizationcited by 179
- 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
- 2023Agents: An Open-source Framework for Autonomous Language Agentscited by 116
- 2024System-Level Defense against Indirect Prompt Injection Attacks: An Information Flow Control Perspectivecited by 91
- 2025CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scalecited by 71
- 2024When LLM Meets DRL: Advancing Jailbreaking Efficiency via DRL-guided Searchcited by 42
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Securing the AI Agent: A Unified Framework for Multi-Layer Agent Red Teaming
- 2026AgentTrust: Runtime Safety Evaluation and Interception for AI Agent Tool Use
- 2026PI-Hunter: Automated Red-Teaming for Exposing and Localizing Prompt Injections
- 2026MonitoringBench: Semi-Automated Red-Teaming for Agent Monitoring
- 2026Proteus: A Self-Evolving Red Team for Agent Skill Ecosystems
- 2026Agent Hacks Agent: Autoresearch for Production-Agent Red-Teaming
- 2026AgentRiskBOM: A Risk-Scoping Security Bill of Materials for Agentic AI Systems
- 2026Redefining AI Red Teaming in the Agentic Era: From Weeks to Hours