SysEvolve: An AI-native, safe, autonomous adversarial attack-defense co-evolutionary system
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of large language models (LLMs) has created a growing asymmetry in cybersecurity, where attack accelerates toward autonomous execution while defense remains predominantly human-intensive. Despite substantial prior work across cyber ranges, AI-driven attack, and AI-driven defense, this asymmetry persists. We trace it to a deeper root cause, that evolution itself has stalled on both sides at three layers. To overcome this, we propose co-evolution as the integrating insight, where attack and defense AI agents autonomously and safely drive each other's evolution through adversarial confrontation. Based on this insight, we present sysevolve, comprising three co-designed components, sysfield, sysspear, and sysarmor. sysfield constructs realistic multi-host ranges. sysspear generates efficient, safe attack schemes. sysarmor performs real-time, interpretable defense. Together they form a self-driven adversarial loop restoring evolution at all three layers. In evaluation, sysfield achieves zero-loss collection at 2.1% overhead and orchestrates 257 CVEs into 1,148 ranges, sysspear improves attack success by over 25% over baseline LLMs, and sysarmor achieves 10--1000× greater precision than prior systems and detects real APT attacks in production at Huawei and Sangfor. Our evaluation also reveals three findings about LLM agent capabilities. First, multi-step composition and larger topologies expose agent capability gaps hidden by single-step evaluations. Second, the bottleneck lies after initial access in post-compromise state utilization. Third, LLM agents are susceptible to environmental interference. When decoy endpoints are deployed in the range, agent timeouts triple and downstream completion disappears despite the success rates of initial accesses are unchanged.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 55 references that are in the map. First posted on arXiv 15 Aug 2026.
Builds on
29 of 55 references.
References · 29
- 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 238
- 2024Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Modelscited by 164
- 2023Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Modelscited by 138
- 2026Kimi K3: Open Frontier Intelligencecited by 138
- 2024LLM Agents can Autonomously Exploit One-day Vulnerabilitiescited by 128
- 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilitiescited by 96
- 2024Teams of LLM Agents can Exploit Zero-Day Vulnerabilitiescited by 95
- 2023Getting pwn'd by AI: Penetration Testing with Large Language Modelscited by 83
- 2025CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scalecited by 78
- 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 68
- 2024PentestAgent: Incorporating LLM Agents to Automated Penetration Testingcited by 47
- 2023Kairos: Practical Intrusion Detection and Investigation using Whole-system Provenancecited by 31
17 more
- 2026ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?cited by 29
- 2025Multi-Agent Penetration Testing AI for the Webcited by 20
- 2026ExploitBench: A Capability Ladder Benchmark for LLM Cybersecurity Agentscited by 19
- 2023NODLINK: An Online System for Fine-Grained APT Attack Detection and Investigationcited by 14
- 2026Measuring AI Agents' Progress on Multi-Step Cyber Attack Scenarioscited by 14
- 2026Think Fast: Estimating No-CoT Task-Completion Time Horizons of Frontier AI Modelscited by 12
- 2026SEC-bench Pro: Can Language Models Solve Long-Horizon Software Security Tasks?cited by 9
- 2026Hackers or Hallucinators? A Comprehensive Analysis of LLM-Based Automated Penetration Testingcited by 4
- 2026AgentCyberRange: Benchmarking Frontier AI Systems in Realistic Cyber Rangescited by 4
- 2024The Path To Autonomous Cyber Defensecited by 3
- 2025KnowHow: Automatically Applying High-Level CTI Knowledge for Interpretable and Accurate Provenance Analysiscited by 3
- 2023Eunomia: Enabling User-specified Fine-Grained Search in Symbolically Executing WebAssembly Binariescited by 2
- 2026A Survey of LLM-Driven Penetration Testing: Taxonomy, Co-Evolution, and Open Challengescited by 2
- 2026Baselines Before Architecture: Evaluating Coding Agents for Autonomous Penetration Testingcited by 2
- 2023Auditing Frameworks Need Resource Isolation: A Systematic Study on the Super Producer Threat to System Auditing and Its Mitigationcited by 1
- 2026STAIR: Effective Incident Response Using an End-to-End Agentic Planning Frameworkcited by 1
- 2026RangeFactory: Scalable Construction of Multi-Hop Cyber Rangescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CoopGuard: Stateful Cooperative Agents Safeguarding LLMs Against Evolving Multi-Round Attacks
- 2026AgentSafeEvo: Adversarial Co-Evolution for LLM Agent Safety
- 2025Adversarial Attack-Defense Co-Evolution for LLM Safety Alignment via Tree-Group Dual-Aware Search and Optimization
- 2025AdvEvo-MARL: Shaping Internalized Safety through Adversarial Co-Evolution in Multi-Agent Reinforcement Learning
- 2026MAGIC: A Co-Evolving Attacker-Defender Adversarial Game for Robust LLM Safety
- 2026NAAMSE: Framework for Evolutionary Security Evaluation of Agents
- 2026CyberArena: Benchmarking AI Agents in Live Symmetric Attack-and-Defense Combat
- 2026Stateful Cooperative Agents Safeguarding LLMs Against Evolving Multi-Turn Attacks