Benefits and Pitfalls of Using Capture the Flag Games in University Courses
Not on the map. Why?
Abstract (arXiv)
The concept of Capture the Flag (CTF) games for practicing cybersecurity skills is widespread in informal educational settings and leisure-time competitions. However, it is not much used in university courses. This paper summarizes our experience from using jeopardy CTF games as homework assignments in an introductory undergraduate course. Our analysis of data describing students' in-game actions and course performance revealed four aspects that should be addressed in the design of CTF tasks: scoring, scaffolding, plagiarism, and learning analytics capabilities of the used CTF platform. The paper addresses these aspects by sharing our recommendations. We believe that these recommendations are useful for cybersecurity instructors who consider using CTF games for assessment in university courses and developers of CTF game frameworks.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 2.
6 papers.
- 2024NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Securitycited by 93
- 2025D-CIPHER: Dynamic Collaborative Intelligent Multi-Agent System with Planner and Heterogeneous Executors for Offensive Securitycited by 20
- 2025Measuring and Augmenting Large Language Models for Solving Capture-the-Flag Challengescited by 15
- 2025CRAKEN: Cybersecurity LLM Agent with Knowledge-Based Executioncited by 14
- 2026AI In Cybersecurity Education -- Scalable Agentic CTF Design Principles and Educational Outcomescited by 1
- 2026Reveree: Diagnosing LLM Reverse-Engineering Agentscited by 0
- 2026Reveree: Diagnosing LLM Reverse-Engineering Agents1 Sep 2026
- 2026AI In Cybersecurity Education -- Scalable Agentic CTF Design Principles and Educational Outcomes23 Mar 2026
- 2025Measuring and Augmenting Large Language Models for Solving Capture-the-Flag Challenges21 Jun 2025
- 2025CRAKEN: Cybersecurity LLM Agent with Knowledge-Based Execution21 May 2025
- 2025D-CIPHER: Dynamic Collaborative Intelligent Multi-Agent System with Planner and Heterogeneous Executors for Offensive Security15 Feb 2025
- 2024NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security8 Jun 2024