Red-MIRROR: Agentic LLM-based Autonomous Penetration Testing with Reflective Verification and Knowledge-augmented Interaction
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Web applications remain the dominant attack surface in cybersecurity, where vulnerabilities such as SQL injection, XSS, and business logic flaws continue to cause significant data breaches. While penetration testing is effective for identifying these weaknesses, traditional manual approaches are time-consuming and heavily dependent on scarce expert knowledge. Recent Large Language Models (LLM)-based multi-agent systems have shown promise in automating penetration testing, yet they still suffer from critical limitations: over-reliance on parametric knowledge, fragmented session memory, and insufficient validation of attack payloads and responses. This paper proposes Red-MIRROR, a novel multi-agent automated penetration testing system that introduces a tightly coupled memory-reflection backbone to explicitly govern inter-agent reasoning. By synthesizing Retrieval-Augmented Generation (RAG) for external knowledge augmentation, a Shared Recurrent Memory Mechanism (SRMM) for persistent state management, and a Dual-Phase Reflection mechanism for adaptive validation, Red-MIRROR provides a robust solution for complex web exploitation. Empirical evaluation on the XBOW benchmark and Vulhub CVEs shows that Red-MIRROR achieves performance comparable to state-of-the-art agents on Vulhub scenarios, while demonstrating a clear advantage on the XBOW benchmark. On the XBOW benchmark, Red-MIRROR attains an overall success rate of 86.0 percent, outperforming PentestAgent (50.0 percent), AutoPT (46.0 percent), and the VulnBot baseline (6.0 percent). Furthermore, the system achieves a 93.99 percent subtask completion rate, indicating strong long-horizon reasoning and payload refinement capability. Finally, we discuss ethical implications and propose safeguards to mitigate misuse risks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 18 of its 43 references that are in the map. First posted on arXiv 28 Mar 2026.
Builds on
18 of 43 references.
Closest ancestors · 2
Same direction, newest first
- 2025VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Framework23 Jan
- 2024PentestAgent: Incorporating LLM Agents to Automated Penetration Testing7 Nov
Other references · 16
- 2017Attention Is All You Needcited by 60,361
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2023Large Language Modelscited by 780
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
- 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 377
- 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 312
- 2025LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insightscited by 47
4 more
- 2024Large Language Model for Vulnerability Detection and Repair: Literature Review and the Road Aheadcited by 42
- 2025On the Surprising Efficacy of LLMs for Penetration-Testingcited by 10
- 2025SRMT: Shared Memory for Multi-agent Lifelong Pathfindingcited by 8
- 2025MIRROR: Multi-agent Intra- and Inter-Reflection for Optimized Reasoning in Tool Learningcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026AWE: Adaptive Agents for Dynamic Web Penetration Testing
- 2025Guided Reasoning in LLM-Driven Penetration Testing Using Structured Attack Trees
- 2026APT-Agent: Automated Penetration Testing using Large Language Models
- 2025From Capabilities to Performance: Evaluating Key Functional Properties of LLM Architectures in Penetration Testing
- 2026Staying on the Attack Path: Structured State for Long-Horizon Automated Penetration Testing
- 2026Hackers or Hallucinators? A Comprehensive Analysis of LLM-Based Automated Penetration Testing
- 2025xOffense: An Autonomous Multi-Agent Framework for Penetration Testing with Domain-Adapted Large Language Models
- 2025Automated Penetration Testing with LLM Agents and Classical Planning