Toward Scalable Automated Repository-Level Datasets for Software Vulnerability Detection
Not on the map. Why?
Abstract (arXiv)
Software vulnerabilities continue to grow in volume and remain difficult to detect in practice. Although learning-based vulnerability detection has progressed, existing benchmarks are largely function-centric and fail to capture realistic, executable, interprocedural settings. Recent repo-level security benchmarks demonstrate the importance of realistic environments, but their manual curation limits scale. This doctoral research proposes an automated benchmark generator that injects realistic vulnerabilities into real-world repositories and synthesizes reproducible proof-of-vulnerability (PoV) exploits, enabling precisely labeled datasets for training and evaluating repo-level vulnerability detection agents. We further investigate an adversarial co-evolution loop between injection and detection agents to improve robustness under realistic constraints.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 11 references that are in the map. First posted on arXiv 18 Mar 2026.
Builds on
8 of 11 references.
References · 8
- 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 133
- 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilitiescited by 90
- 2025BountyBench: Dollar Impact of AI Agent Attackers and Defenders on Real-World Cybersecurity Systemscited by 37
- 2024ReposVul: A Repository-Level High-Quality Vulnerability Datasetcited by 35
- 2024Top Score on the Wrong Exam: On Benchmarking in Machine Learning for Vulnerability Detectioncited by 27
- 2025Frontier AI's Impact on the Cybersecurity Landscapecited by 21
- 2024VulEval: Towards Repository-Level Evaluation of Software Vulnerability Detectioncited by 18
- 2024Revisiting the Performance of Deep Learning-Based Vulnerability Detection on Realistic Datasetscited by 6
Built on by
Not cited yet.