mlsanityData to 7 Oct 2026

SoK: DARPA's AI Cyber Challenge (AIxCC): Competition Design, Architectures, and Lessons Learned

arXiv 2602.07666 ↗First posted 7 Feb 2026cs.CR cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

DARPA's AI Cyber Challenge (AIxCC, 2023--2025) is the largest competition to date for building fully autonomous cyber reasoning systems (CRSs) that leverage recent advances in AI -- particularly large language models (LLMs) -- to discover and remediate vulnerabilities in real-world open-source software. This paper presents the first systematic analysis of AIxCC. Drawing on design documents, source code, execution traces, and discussions with organizers and competing teams, we examine the competition's structure and key design decisions, characterize the architectural approaches of finalist CRSs, and analyze competition results beyond the final scoreboard. Our analysis reveals the factors that truly drove CRS performance, identifies genuine technical advances achieved by teams, and exposes limitations that remain open for future research. We conclude with lessons for organizing future competitions and broader insights toward deploying autonomous CRSs in practice.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 10 of its 69 references that are in the map. First posted on arXiv 7 Feb 2026.

Builds on

10 of 69 references.

References · 10

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  6. 2024A Survey on LLM-as-a-Judgecited by 1,384
  7. 2025ATLANTIS: AI-driven Threat Localization, Analysis, and Triage Intelligence Systemcited by 9
  8. 2023autofz: Automated Fuzzer Composition at Runtimecited by 3
  9. 2025BandFuzz: An ML-powered Collaborative Fuzzing Frameworkcited by 2
  10. 2026PatchIsland: Orchestration of LLM Agents for Continuous Vulnerability Repaircited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.