mlsanityData to 14 Oct 2026

AI In Cybersecurity Education -- Scalable Agentic CTF Design Principles and Educational Outcomes

arXiv 2603.21551 ↗First posted 23 Mar 2026cs.SEcited by 1

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Large language models are rapidly changing how learners acquire and demonstrate cybersecurity skills. However, when human--AI collaboration is allowed, educators still lack validated competition designs and evaluation practices that remain fair and evidence-based. This paper presents a cross-regional study of LLM-centered Capture-the-Flag competitions built on the Cyber Security Awareness Week competition system. To understand how autonomy levels and participants' knowledge backgrounds influence problem-solving performance and learning-related behaviors, we formalize three autonomy levels: human-in-the-loop, autonomous agent frameworks, and hybrid. To enable verification, we require traceable submissions including conversation logs, agent trajectories, and agent code. We analyze multi-region competition data covering an in-class track, a standard track, and a year-long expert track, each targeting participants with different knowledge backgrounds. Using data from the 2025 competition, we compare solve performance across autonomy levels and challenge categories, and observe that autonomous agent frameworks and hybrid achieve higher completion rates on challenges requiring iterative testing and tool interactions. In the in-class track, we classify participants' agent designs and find a preference for lightweight, tool-augmented prompting and reflection-based retries over complex multi-agent architectures. Our results offer actionable guidance for designing LLM-assisted cybersecurity competitions as learning technologies, including autonomy-specific scoring criteria, evidence requirements that support solution verification, and track structures that improve accessibility while preserving reliable evaluation and engagement.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 48 of its 76 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

48 of 76 references.

Closest ancestors · 10

Same direction, newest first

  1. 2026CTFExplorer: Evaluating LLM Offensive Agents Through Multi-Target Web CTF Benchmarking8 Feb
  2. 2025From Trace to Line: LLM Agent for Real-World OSS Vulnerability Localization30 Sep
  3. 2025Training Language Model Agents to Find Vulnerabilities with CTF-Dojo25 Aug
  4. 2025Towards Effective Offensive Security LLM Agents: Hyperparameter Tuning, LLM as a Judge, and a Lightweight CTF Benchmark5 Aug
  5. 2025Cyber-Zero: Training Cybersecurity Agents without Runtime29 Jul
  6. 2025Improving LLM Agents with Reinforcement Learning on Cryptographic CTF Challenges1 Jun
  7. 2025CRAKEN: Cybersecurity LLM Agent with Knowledge-Based Execution21 May
  8. 2024Hacking CTFs with Plain Agents3 Dec
  9. 2024HackSynth: LLM Agent and Evaluation Framework for Autonomous Penetration Testing2 Dec
  10. 2024EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security Vulnerabilities24 Sep

Other references · 38

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  7. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  8. 2023Qwen Technical Reportcited by 3,344
  9. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  10. 2023A Survey of Large Language Modelscited by 2,576
  11. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  12. 2023BloombergGPT: A Large Language Model for Financecited by 939
26 more
  1. 2022Galactica: A Large Language Model for Sciencecited by 744
  2. 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 238
  3. 2022Large Language Models Meet NL2Code: A Surveycited by 138
  4. 2025A Survey on Code Generation with LLM-based Agentscited by 106
  5. 2024NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Securitycited by 93
  6. 2024CYBERSECEVAL 3: Advancing the Evaluation of Cybersecurity Risks and Capabilities in Large Language Modelscited by 58
  7. 2024An Empirical Evaluation of LLMs for Solving Offensive Security Challengescited by 35
  8. 2023From Text to MITRE Techniques: Exploring the Malicious Use of Large Language Models for Generating Cyber Attack Payloadscited by 32
  9. 2024Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challengescited by 32
  10. 2023Using Large Language Models for Cybersecurity Capture-The-Flag Challenges and Certification Questionscited by 23
  11. 2025ELFuzz: Efficient Input Generation via LLM-driven Synthesis Over Fuzzer Spacecited by 15
  12. 2025Measuring and Augmenting Large Language Models for Solving Capture-the-Flag Challengescited by 15
  13. 2024Fine-Tuned Large Language Model for Visualization System: A Study on Self-Regulated Learning in Educationcited by 12
  14. 2025VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilitiescited by 12
  15. 2023Dcc --help: Generating Context-Aware Compiler Error Explanations with Large Language Modelscited by 11
  16. 2024Explaining Code with a Purpose: An Integrated Approach for Developing Code Comprehension and Prompting Skillscited by 11
  17. 2025NetDeTox: Adversarial and Efficient Evasion of Hardware-Security GNNs via RL-LLM Orchestrationcited by 9
  18. 2020Benefits and Pitfalls of Using Capture the Flag Games in University Coursescited by 6
  19. 2021Cybersecurity Knowledge and Skills Taught in Capture the Flag Challengescited by 6
  20. 2025All You Need Is A Fuzzing Brain: An LLM-Powered System for Automated Vulnerability Detection and Patchingcited by 6
  21. 2024Can LLMs Identify Gaps and Misconceptions in Students' Code Explanations?cited by 4
  22. 2025MaLAware: Automating the Comprehension of Malicious Software Behaviours using Large Language Models (LLMs)cited by 4
  23. 2025MalGEN: A Testbed for Modeling and Evaluating Malware Behaviorscited by 3
  24. 2025Code Refactoring with LLM: A Comprehensive Evaluation With Few-Shot Settingscited by 3
  25. 2025Autonomous Penetration Testing: Solving Capture-the-Flag Challenges with LLMscited by 2
  26. 2026Understanding Human-AI Collaboration in Cybersecurity Competitionscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Can AI Lower the Barrier to Cybersecurity? A Human-Centered Mixed-Methods Study of Novice CTF Learning
  2. 2026CyberAGENTS: Structured Autonomy for Agentic Gamified Learning in Cybersecurity
  3. 2025AgentBnB: A Browser-Based Cybersecurity Tabletop Exercise with Large Language Model Support and Retrieval-Aligned Scaffolding
  4. 2026When Skills Don't Help: A Negative Result on Procedural Knowledge for Tool-Grounded Agents in Offensive Cybersecurity
  5. 2025Cybersecurity AI Benchmark (CAIBench): A Meta-Benchmark for Evaluating Cybersecurity AI Agents
  6. 2026CyberJustice Tutor: An Agentic AI Framework for Cybersecurity Learning via Think-Plan-Act Reasoning and Pedagogical Scaffolding
  7. 2025Cybersecurity AI: Evaluating Agentic Cybersecurity in Attack/Defense CTFs
  8. 2025D-CIPHER: Dynamic Collaborative Intelligent Multi-Agent System with Planner and Heterogeneous Executors for Offensive Security