Co-RedTeam: Orchestrated Security Discovery and Exploitation with LLM Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Large language models (LLMs) have shown promise in assisting cybersecurity tasks, yet existing approaches struggle with automatic vulnerability discovery and exploitation due to limited interaction, weak execution grounding, and a lack of experience reuse. We propose Co-RedTeam, a security-aware multi-agent framework designed to mirror real-world red-teaming workflows by integrating security-domain knowledge, code-aware analysis, execution-grounded iterative reasoning, and long-term memory. Co-RedTeam decomposes vulnerability analysis into coordinated discovery and exploitation stages, enabling agents to plan, execute, validate, and refine actions based on real execution feedback while learning from prior trajectories. Extensive evaluations on challenging security benchmarks demonstrate that Co-RedTeam consistently outperforms strong baselines across diverse backbone models, achieving over 60% success rate in vulnerability exploitation and over 10% absolute improvement in vulnerability detection. Ablation and iteration studies further confirm the critical role of execution feedback, structured interaction, and memory for building robust and generalizable cybersecurity agents.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 22 of its 37 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
22 of 37 references.
Closest ancestors · 4
Same direction, newest first
- 2025Training Language Model Agents to Find Vulnerabilities with CTF-Dojo25 Aug
- 2025BountyBench: Dollar Impact of AI Agent Attackers and Defenders on Real-World Cybersecurity Systems21 May
- 2025Let the Trial Begin: A Mock-Court Approach to Vulnerability Detection using LLM-Based Agents16 May
- 2024LLM Agents can Autonomously Hack Websites6 Feb
Other references · 18
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024Understanding the planning of LLM agents: A surveycited by 414
- 2025Accelerating scientific discovery with Co-Scientistcited by 353
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
- 2024Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Modelscited by 156
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 146
- 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 133
- 2023LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarkscited by 94
- 2024When LLMs Meet Cybersecurity: A Systematic Literature Reviewcited by 70
- 2025RepoAudit: An Autonomous LLM-Agent for Repository-Level Code Auditingcited by 47
6 more
- 2024Large Language Model for Vulnerability Detection: Emerging Results and Future Directionscited by 44
- 2024Chain-of-Thought Prompting of Large Language Models for Discovering and Fixing Software Vulnerabilitiescited by 31
- 2024To Err is Machine: Vulnerability Detection Challenges LLM Reasoningcited by 17
- 2020Cybersecurity for Industrial Control Systems: A Surveycited by 12
- 2025Multi-lingual Multi-turn Automated Red Teaming for LLMscited by 12
- 2024Make LLMs better zero-shot reasoners: Structure-orientated autonomous reasoningcited by 6
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026NAAMSE: Framework for Evolutionary Security Evaluation of Agentscited by 1
- 2026Revelio: Cost-Efficient Agentic Memory Safety Vulnerability Detection For Repository-Scale Codebasescited by 1
- 2026Large Byte Model: Teaching Language Models About Compiled Codecited by 0
- 2026StealthBench: Measuring Operational Stealth in Autonomous Offensive-Security Agentscited by 0
- 2026CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wildcited by 0
- 2026AgentXploit: Autonomous Repository-to-Runtime Red-Teaming for AI Agentscited by 0
- 2026AgentXploit: Autonomous Repository-to-Runtime Red-Teaming for AI Agents25 Sep 2026
- 2026CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild24 Aug 2026
- 2026StealthBench: Measuring Operational Stealth in Autonomous Offensive-Security Agents28 Jul 2026
- 2026Revelio: Cost-Efficient Agentic Memory Safety Vulnerability Detection For Repository-Scale Codebases20 Jun 2026
- 2026Large Byte Model: Teaching Language Models About Compiled Code1 Jun 2026
- 2026NAAMSE: Framework for Evolutionary Security Evaluation of Agents7 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026A Red Teaming Framework for Evaluating Robustness of AI-enabled Security Orchestration, Automation, and Response Systems
- 2026REDAgentBench: Executable Red Teaming and Faithful Measurement of LLM Agent Systems
- 2026Agent Hacks Agent: Autoresearch for Production-Agent Red-Teaming
- 2026Autonomous Adversary: Red-Teaming in the age of LLM
- 2025SIRAJ: Diverse and Efficient Red-Teaming for LLM Agents via Distilled Structured Reasoning
- 2025CoP: Agentic Red-teaming for Large Language Models using Composition of Principles
- 2025Strategize Globally, Adapt Locally: A Multi-Turn Red Teaming Agent with Dual-Level Learning
- 2025DREAM: Dynamic Red-teaming across Environments for AI Models