mlsanityData to 14 Oct 2026

Staying on the Attack Path: Structured State for Long-Horizon Automated Penetration Testing

arXiv 2609.07344 ↗First posted 7 Sep 2026cs.CR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language model (LLM) based agents are increasingly applied to cybersecurity tasks such as vulnerability discovery and automated penetration testing. On long-horizon security tasks, however, such agents remain limited by context forgetting and intent drift: early critical facts and causal reasoning chains are lost over extended interactions, and the agent falls into aimless, repetitive exploration. This paper proposes Intentest, an intent-graph-guided automated penetration testing agent that externalizes long-horizon state from the LLM's context window onto a persistent fact-intent directed acyclic graph (DAG), thereby substantially reducing invalid transitions. We evaluate Intentest on automated penetration testing of web applications, a representative long-tail task in cybersecurity. In the DAG, verified network states are stored as immutable fact nodes, and exploration directions are constrained as intent edges bounded by predecessor facts. The system adopts a three-layer architecture, in which the fact-intent mapping layer maintains the global state, the task scheduling and allocation layer ensures execution stability through two-phase degradation recovery and multi-dimensional adaptive load balancing, and the intent retrieval and prediction layer provides tactical priors through a top-down five-stage filtering algorithm. On a benchmark of real CTF challenges covering more than ten vulnerability types across three difficulty levels, Intentest achieves an overall success rate of 88.2% and a success rate of 75.0% on hard tasks, improving over the baseline by approximately 44 and 50 percentage points. Ablation experiments further show that the intent retrieval and prediction reduce the average number of rounds on successful medium and hard tasks by about 33% and 48%, respectively, without changing the set of solvable tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

31 of 47 references.

References · 31

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  6. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  7. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  8. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  9. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  10. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  11. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  12. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
19 more
  1. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  2. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  3. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  4. 2024CyberSecEval 2: A Wide-Ranging Cybersecurity Evaluation Suite for Large Language Modelscited by 89
  5. 2024PentestAgent: Incorporating LLM Agents to Automated Penetration Testingcited by 47
  6. 2025VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Frameworkcited by 31
  7. 2025Cyber-Zero: Training Cybersecurity Agents without Runtimecited by 22
  8. 2013POMDPs Make Better Hackers: Accounting for Uncertainty in Penetration Testingcited by 14
  9. 2025Mitigating Hallucinations in Large Language Models via Causal Reasoningcited by 13
  10. 2026What Makes a Good LLM Agent for Real-world Penetration Testing?cited by 10
  11. 2025PentestEval: Benchmarking LLM-based Penetration Testing with Modular and Stage-Level Designcited by 7
  12. 2025Pentest-R1: Towards Autonomous Penetration Testing Reasoning Optimized via Two-Stage Reinforcement Learningcited by 5
  13. 2025Automated Penetration Testing with LLM Agents and Classical Planningcited by 5
  14. 2026Measuring Real-World Prompt Injection Attacks in LLM-based Resume Screeningcited by 5
  15. 2026LLM agents security duality: a comprehensive survey of self-security and empowered cybersecuritycited by 4
  16. 2015Exact Inference Techniques for the Analysis of Bayesian Attack Graphscited by 2
  17. 2026APT-Agent: Automated Penetration Testing using Large Language Modelscited by 2
  18. 2025Integrating DAST in Kanban and CI/CD: A Real World Security Case Studycited by 1
  19. 2025Unlocking User-oriented Pages: Intention-driven Black-box Scanner for Real-world Web Applicationscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Guided Reasoning in LLM-Driven Penetration Testing Using Structured Attack Trees
  2. 2025From Capabilities to Performance: Evaluating Key Functional Properties of LLM Architectures in Penetration Testing
  3. 2026Red-MIRROR: Agentic LLM-based Autonomous Penetration Testing with Reflective Verification and Knowledge-augmented Interaction
  4. 2026CAIRN: Dynamic Fact-Intent DAGs for Multi-Agent Exploration
  5. 2026Big Enough to Break Out: Tracking the Rising Capability of LLM Penetration-Testing Agents
  6. 2026AWE: Adaptive Agents for Dynamic Web Penetration Testing
  7. 2026Agentic Security: A Systematization of Tools, Failure Modes, and Design Laws for LLM-Driven Penetration Testing
  8. 2026ZERO-APT: A Closed-Loop Adversarial Framework for LLM-Driven Automated Penetration Testing under Intelligent Defense ↗