FORGE: Multi-Agent Graduated Exploitation and Detection Engineering
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Vulnerability disclosure volumes now far exceed organizational assessment capacity, yet three adjacent research communities (proof-of-concept generation, vulnerability prioritization, and detection rule engineering) operate largely in isolation. Existing automated exploit generation systems report binary pass/fail outcomes, discarding partial progress and producing no signal for the other two communities. This paper presents FORGE, a multi-agent system that bridges these three silos through graduated exploitation depth. Five specialized agents (Intel, Generator, Planner, Exploit, and Detector) execute in a fixed pipeline that (1) generates targeted vulnerable applications from CVE metadata, (2) conducts coached, multi-turn exploitation assessed by an LLM-primary oracle on a four-level taxonomy (L0: no evidence through L3: full compromise), and (3) produces Sigma and Snort detection rules grounded in OpenTelemetry exploitation traces. Graduated depth is the bridging mechanism: deeper exploitation yields richer behavioral traces for detection engineering, while depth data across scoring bands provides ground truth for prioritization validation. A tiered knowledge architecture accumulates intelligence across assessments, transferring build and exploitation experience to subsequent CVEs. Evaluation on 603 CVEs from the CVE-GENIE dataset achieves 67.8% end-to-end L1+ exploitation at USD 1.50 per CVE across eight languages and 187 CWE types. Exploitation rates remain near 68% regardless of EPSS or CVSS band, indicating that pattern-level reachability is orthogonal to metadata-based prioritization. Detection rules from L2+ exploitation achieve significantly higher span-normalized grounding than L1-derived rules (p=0.035), and 93.4% of generated Snort rules produce zero false positives against a synthetic benign corpus.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 20 of its 34 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
20 of 34 references.
Closest ancestors · 7
Same direction, newest first
- 2026ZeroDayBench: Evaluating LLM Agents on Unseen Zero-Day Vulnerabilities for Cyberdefense2 Mar
- 2026CVE-Factory: Scaling Expert-Level Agentic Tasks for Code Security Vulnerability3 Feb
- 2025LLM Agents for Automated Web Vulnerability Reproduction: Are We There Yet?16 Oct
- 2025From CVE Entries to Verifiable Exploits: An Automated Multi-Agent Framework for Reproducing CVEs1 Sep
- 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilities21 Mar
- 2024Teams of LLM Agents can Exploit Zero-Day Vulnerabilities2 Jun
- 2024LLM Agents can Autonomously Exploit One-day Vulnerabilities11 Apr
Other references · 13
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2025PoCGen: Generating Proof-of-Concept Exploits for Vulnerabilities in Npm Packagescited by 12
- 2023You Cannot Escape Me: Detecting Evasions of SIEM Rules in Enterprise Networkscited by 6
- 2023Enhancing Vulnerability Prioritization: Data-Driven Exploit Predictions with Community-Driven Insightscited by 4
- 2025FALCON: Transforming Cyber Threat Intelligence into Deployable IDS Rules with Self-Reflectioncited by 4
- 2025A Systematic Literature Review on Automated Exploit and Security Test Generationcited by 3
- 2025Conflicting Scores, Confusing Signals: An Empirical Study of Vulnerability Scoring Systemscited by 3
- 2025Prompting the Priorities: A First Look at Evaluating LLMs for Vulnerability Triage and Prioritizationcited by 3
- 2026Execution-State-Aware LLM Reasoning for Automated Proof-of-Vulnerability Generationcited by 3
- 2025RuleGenie: SIEM Detection Rule Set Optimizationcited by 2
- 2026Contextualizing Sink Knowledge for Java Vulnerability Discoverycited by 2
- 2024Efficacy of EPSS in High Severity CVEs found in KEVcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AXE: Grey-Box Exploitability Confirmation for Localized Vulnerability Reports
- 2026Argus: Reorchestrating Static Analysis via a Multi-Agent Ensemble for Full-Chain Security Vulnerability Detection
- 2026A Multi-Agent Framework for Automated Exploit Generation with Constraint-Guided Comprehension and Reflection
- 2025VulAgent: Hypothesis-Validation based Multi-Agent Vulnerability Detection
- 2026A Dual-Loop Agent Framework for Automated Vulnerability Reproduction
- 2026From Runnable to Verifiable: An Independent Reproducibility Study of LLM/Agent-Driven Vulnerability Validation Artifacts
- 2026PenForge: On-the-Fly Expert Agent Construction for Automated Penetration Testing
- 2026From Capability to Assurance in Autonomous Penetration-Testing Harnesses: A Framework and Reference Implementation