mlsanityData to 14 Oct 2026

CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild

arXiv 2608.23181 ↗First posted 24 Aug 2026cs.CR cs.CLcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

As large language models (LLMs) continue to advance in coding capabilities, their potential in cybersecurity has drawn increasing research attention, with closed-source LLMs (e.g., Mythos) delivering advanced cybersecurity capabilities. However, existing open-source efforts remain limited: frontier open-weight models do not provide reproducible cybersecurity training solutions, open-source training solutions focus on isolated tasks and lack scalable agentic data, and scaling agentic rollouts requires strong domain priors. In this work, we introduce CyberFactory, a unified open-source framework that connects data construction, trajectory synthesis, and model training across proof-of-concept (PoC) generation, vulnerability patching, and cybersecurity question answering (CyberQA). CyberFactory transforms public vulnerability artifacts, including CVEs from the wild, into executable and verifiable task instances. It further uses a reusable vulnerability-analysis skill to guide the teacher through source inspection, problem solving with domain prior, and evidence-based validation. The resulting supervision is agentic: the model interacts with tools and target environments and revises its solutions according to execution feedback. Using these trajectories, we train and release modelnamefootnoteAegis is, in Greek mythology, the protective shield of Zeus and Athena; the name reflects the model's defensive, security-oriented purpose., which internalizes the skill-guided procedure without requiring the skill at inference time. On CyberGym, modelname reaches 52.4% Pass@1 under a one-hour budget, improving over its Qwen~3.5 base model by +22.8 points and outperforming the evaluated general-purpose backbones under the same scaffold.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 23 of its 36 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

23 of 36 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?11 May
  2. 2026CVE-Factory: Scaling Expert-Level Agentic Tasks for Code Security Vulnerability3 Feb
  3. 2026Co-RedTeam: Orchestrated Security Discovery and Exploitation with LLM Agents2 Feb
  4. 2025Cyber-Zero: Training Cybersecurity Agents without Runtime29 Jul
  5. 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilities21 Mar

Other references · 18

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  4. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  5. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 336
  6. 2019Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networkscited by 272
  7. 2024Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Modelscited by 164
  8. 2024NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Securitycited by 93
  9. 2021CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Softwarecited by 91
  10. 2025CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scalecited by 78
  11. 2025Context as a Tool: Context Management for Long-Horizon SWE-Agentscited by 43
  12. 2023SecQA: A Concise Question-Answering Dataset for Evaluating Large Language Models in Computer Securitycited by 37
6 more
  1. 2025Primus: A Pioneering Collection of Open-Source Datasets for Cybersecurity LLM Trainingcited by 23
  2. 2026Quantifying Frontier LLM Capabilities for Container Sandbox Escapecited by 18
  3. 2026Harnessing LLM Agents with Skill Programscited by 9
  4. 2026ARVO: Atlas of Reproducible Vulnerabilities for Open-Source Softwarecited by 9
  5. 2026CyberGym-E2E: Scalable Real-World Benchmark for AI Agents' End-to-End Cybersecurity Capabilitiescited by 8
  6. 2021An Empirical Study of OSS-Fuzz Bugscited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CyberForge: Verified Vulnerability Injection at Repository Level for Cybersecurity Agent Training
  2. 2025Leveraging Large Language Models for Cybersecurity Risk Assessment -- A Case from Forestry Cyber-Physical Systems
  3. 2025DefenderBench: A Toolkit for Evaluating Language Agents in Cybersecurity Environments
  4. 2025Toward Cybersecurity-Expert Small Language Models
  5. 2024Crimson: Empowering Strategic Reasoning in Cybersecurity through Large Language Models
  6. 2025AgentBnB: A Browser-Based Cybersecurity Tabletop Exercise with Large Language Model Support and Retrieval-Aligned Scaffolding
  7. 2026Systematic Capability Benchmarking of Frontier Large Language Models for Offensive Cyber Tasks
  8. 2025Less Data, More Security: Advancing Cybersecurity LLMs Specialization via Resource-Efficient Domain-Adaptive Continuous Pre-training with Minimal Tokens