Feyospace-v1: How the Cyber Mercury Seven Trained Frontier Cyber Models
Not on the map. Why?
Abstract (arXiv)
Training capable cyber agents is often treated primarily as a problem of model scale, yet open-weight post-training is constrained more directly by the cost of executable environments, reliable multi-turn supervision, and access to strong teachers. We present a data-centric framework that addresses these bottlenecks through five complementary systems: Choulea analyzes hidden reasoning signatures, SkyReal reduces teacher-sampling cost, Hongzwang bypasses API restrictions on teacher execution, PSBreakup restores capabilities weakened by model merging, and Kreator converts expert interventions into trainable reasoning. Our data engine constructs resettable coding, vulnerability, CTF, kernel-history, full-exploit, firmware, and device-backed environments. Candidate trajectories are retained only after execution verification and evidence auditing, yielding 164,269 trajectories for long-context supervised fine-tuning. The three checkpoints improve over their starting models by an average of 23.76% on the full CyberGym suite and 10.49% across the pooled CTF suites. As of September 1, 2026, Feyospace-s1 achieves a verified success rate of 63.24% and ranks 10th on the official CyberGym leaderboard, while all three checkpoints rank 1st among models at comparable parameter scales. To our knowledge, this is the first end-to-end demonstration that a seven-person independent team can train open-weight models with leading agentic cyber capability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 60 of its 92 references that are in the map. First posted on arXiv 8 Sep 2026.
Builds on
60 of 92 references.
References · 60
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
38 more
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 737
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 672
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
- 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 504
- 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 455
- 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 336
- 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 300
- 2023Shadow Alignment: The Ease of Subverting Safely-Aligned Language Modelscited by 297
- 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
- 2025Learning to Reason under Off-Policy Guidancecited by 281
- 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 238
- 2022Data Contamination: From Memorization to Exploitationcited by 236
- 2022Defining and Characterizing Reward Hackingcited by 203
- 2023LoRA Fine-tuning Efficiently Undoes Safety Training in Llama 2-Chat 70Bcited by 195
- 2024Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Modelscited by 164
- 2026Kimi K3: Open Frontier Intelligencecited by 138
- 2024LLM Agents can Autonomously Exploit One-day Vulnerabilitiescited by 128
- 2025Large Language Models Often Know When They Are Being Evaluatedcited by 128
- 2024LLM Agents can Autonomously Hack Websitescited by 109
- 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilitiescited by 96
- 2024NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Securitycited by 93
- 2025Stress Testing Deliberative Alignment for Anti-Scheming Trainingcited by 86
- 2025CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scalecited by 78
- 2026MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Trainingcited by 72
- 2026Qwen3-Coder-Next Technical Reportcited by 71
- 2025ImpossibleBench: Measuring LLMs' Propensity of Exploiting Test Casescited by 65
- 2025Scaf-GRPO: Scaffolded Group Relative Policy Optimization for Enhancing LLM Reasoningcited by 52
- 2023FuzzLLM: A Novel and Universal Fuzzing Framework for Proactively Discovering Jailbreak Vulnerabilities in Large Language Modelscited by 51
- 2025Agent-RLVR: Training Software Engineering Agents via Guidance and Environment Rewardscited by 42
- 2025EnvBench: A Benchmark for Automated Environment Setupcited by 36
- 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 31
- 2026ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?cited by 29
- 2025SWE-RM: Execution-free Feedback For Software Engineering Agentscited by 28
- 2014An introduction to Docker for reproducible research, with examples from the R environmentcited by 26
50 most cited of 60 All 60 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild
- 2026MiST: Mid-Training LLMs for Cybersecurity
- 2025Cyber-Zero: Training Cybersecurity Agents without Runtime
- 2025OCCULT: Evaluating Large Language Models for Offensive Cyber Operation Capabilities
- 2026Cyber Defense Benchmark: Agentic Threat Hunting Evaluation for LLMs in SecOps
- 2026Fara-1.5: Scalable Learning Environments for Computer Use Agents
- 2026Llama-3.1-FoundationAI-SecurityLLM-Reasoning-8B Technical Report
- 2025AthenaBench: A Dynamic Benchmark for Evaluating LLMs in Cyber Threat Intelligence