mlsanityData to 14 Oct 2026

AWE: Adaptive Agents for Dynamic Web Penetration Testing

arXiv 2603.00960 ↗First posted 1 Mar 2026cs.CR cs.AIcited by 1

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Modern web applications are increasingly produced through AI-assisted development and rapid no-code deployment pipelines, widening the gap between accelerating software velocity and the limited adaptability of existing security tooling. Pattern-driven scanners fail to reason about novel contexts, while emerging LLM-based penetration testers rely on unconstrained exploration, yielding high cost, unstable behavior, and poor reproducibility. We introduce AWE, a memory-augmented multi-agent framework for autonomous web penetration testing that embeds structured, vulnerability-specific analysis pipelines within a lightweight LLM orchestration layer. Unlike general-purpose agents, AWE couples context aware payload mutations and generations with persistent memory and browser-backed verification to produce deterministic, exploitation-driven results. Evaluated on the 104-challenge XBOW benchmark, AWE achieves substantial gains on injection-class vulnerabilities - 87% XSS success (+30.5% over MAPTA) and 66.7% blind SQL injection success (+33.3%) - while being much faster, cheaper, and more token-efficient than MAPTA, despite using a midtier model (Claude Sonnet 4) versus MAPTA's GPT-5. MAPTA retains higher overall coverage due to broader exploratory capabilities, underscoring the complementary strengths of specialized and general-purpose architectures. Our results demonstrate that architecture matters as much as model reasoning capabilities: integrating LLMs into principled, vulnerability-aware pipelines yields substantial gains in accuracy, efficiency, and determinism for injection-class exploits. The source code for AWE is available at: https://github.com/stuxlabs/AWE

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 5 of its 13 references that are in the map. First posted on arXiv 1 Mar 2026.

Builds on

5 of 13 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Multi-Agent Penetration Testing AI for the Web28 Aug
  2. 2025Mimicking the Familiar: Dynamic Command Generation for Information Theft Attacks in LLM Tool-Learning System17 Feb

Other references · 3

  1. 2023PentestGPT: An LLM-empowered Automatic Penetration Testing Toolcited by 97
  2. 2024AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attackscited by 96
  3. 2025CAI: An Open, Bug Bounty-Ready Cybersecurity AIcited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026APT-Agent: Automated Penetration Testing using Large Language Models
  2. 2026Red-MIRROR: Agentic LLM-based Autonomous Penetration Testing with Reflective Verification and Knowledge-augmented Interaction
  3. 2026PenForge: On-the-Fly Expert Agent Construction for Automated Penetration Testing
  4. 2025From Capabilities to Performance: Evaluating Key Functional Properties of LLM Architectures in Penetration Testing
  5. 2025xOffense: An Autonomous Multi-Agent Framework for Penetration Testing with Domain-Adapted Large Language Models
  6. 2026MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks
  7. 2026What Makes a Good LLM Agent for Real-world Penetration Testing?
  8. 2024HackSynth: LLM Agent and Evaluation Framework for Autonomous Penetration Testing