CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Software
Not on the map. Why?
Abstract (arXiv)
Data-driven research on the automated discovery and repair of security vulnerabilities in source code requires comprehensive datasets of real-life vulnerable code and their fixes. To assist in such research, we propose a method to automatically collect and curate a comprehensive vulnerability dataset from Common Vulnerabilities and Exposures (CVE) records in the public National Vulnerability Database (NVD). We implement our approach in a fully automated dataset collection tool and share an initial release of the resulting vulnerability dataset named CVEfixes. The CVEfixes collection tool automatically fetches all available CVE records from the NVD, gathers the vulnerable code and corresponding fixes from associated open-source repositories, and organizes the collected information in a relational database. Moreover, the dataset is enriched with meta-data such as programming language, and detailed code and security metrics at five levels of abstraction. The collection can easily be repeated to keep up-to-date with newly discovered or patched vulnerabilities. The initial release of CVEfixes spans all published CVEs up to 9 June 2021, covering 5365 CVE records for 1754 open-source projects that were addressed in a total of 5495 vulnerability fixing commits. CVEfixes supports various types of data-driven software security research, such as vulnerability prediction, vulnerability classification, vulnerability severity prediction, analysis of vulnerability-related code changes, and automated vulnerability repair.
Key facts. Cited by 89 papers in the map (data through 7 Oct 2026). Builds on 14 of its 52 references that are in the map. First posted on arXiv 19 Jul 2021.
Builds on
14 of 52 references.
References · 14
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2019Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networkscited by 266
- 2018SequenceR: Sequence-to-Sequence Learning for End-to-End Program Repaircited by 144
- 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
- 2021D2A: A Dataset Built for AI-Based Vulnerability Detection Methods Using Differential Analysiscited by 48
- 2021Applying CodeBERT for Automated Program Repair of Java Simple Bugscited by 44
- 2019How Often Do Single-Statement Bugs Occur? The ManySStuBs4J Datasetcited by 35
- 2019A Manually-Curated Dataset of Fixes to Vulnerabilities of Open-Source Softwarecited by 28
- 2018A Practical Approach to the Automatic Classification of Security-Relevant Commitscited by 13
- 2017End-to-End Prediction of Buffer Overruns from Raw Source Code via Neural Memory Networkscited by 10
- 2020World of Code: Enabling a Research Workflow for Mining and Analyzing the Universe of Open Source VCS datacited by 7
- 2021On the Rise and Fall of Simple Stupid Bugs: a Life-Cycle Analysis of SStuBscited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 7; 2024: 15; 2025: 35; 2026: 30.
89 papers.
Sort:
By area:
- 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 149
- 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 133
- 2023DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detectioncited by 98
- 2025SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security Taskscited by 69
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 67
- 2023How Effective Are Neural Networks for Fixing Security Vulnerabilitiescited by 50
- 2025LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insightscited by 44
- 2024Finetuning Large Language Models for Vulnerability Detectioncited by 39
- 2024Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tuningcited by 30
- 2025Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineeringcited by 15
- 2024Enhanced Automated Code Vulnerability Repair using Large Language Modelscited by 10
- 2025CASTLE: Benchmarking Dataset for Static Code Analyzers and LLMs towards CWE Detectioncited by 10
38 more
- 2025Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferencescited by 10
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
- 2024Software Vulnerability Prediction in Low-Resource Languages: An Empirical Study of CodeBERT and ChatGPTcited by 8
- 2025A Systematic Literature Review on Detecting Software Vulnerabilities with Large Language Modelscited by 8
- 2026ARVO: Atlas of Reproducible Vulnerabilities for Open-Source Softwarecited by 8
- 2025Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overviewcited by 7
- 2025Agent That Debugs: Dynamic State-Guided Vulnerability Repaircited by 7
- 2024Your Instructions Are Not Always Helpful: Assessing the Efficacy of Instruction Fine-tuning for Software Vulnerability Detectioncited by 6
- 2024Automated Code-centric Software Vulnerability Assessment: How Far Are We? An Empirical Study in C/C++cited by 6
- 2024Automatic Data Labeling for Software Vulnerability Prediction Models: How Far Are We?cited by 6
- 2025CoQuIR: A Comprehensive Benchmark for Code Quality-Aware Information Retrievalcited by 6
- 2023The EarlyBIRD Catches the Bug: On Exploiting Early Layers of Encoder Models for More Efficient Code Classificationcited by 5
- 2025VADER: A Human-Evaluated Benchmark for Vulnerability Assessment, Detection, Explanation, and Remediationcited by 5
- 2026CVE-Factory: Scaling Expert-Level Agentic Tasks for Code Security Vulnerabilitycited by 5
- 2025DefenderBench: A Toolkit for Evaluating Language Agents in Cybersecurity Environmentscited by 4
- 2025Improving LLM Reasoning for Vulnerability Detection via Group Relative Policy Optimizationcited by 4
- 2025LLM-based Vulnerability Discovery through the Lens of Code Metricscited by 4
- 2026From SFT to RL: Demystifying the Post-Training Pipeline for LLM-based Vulnerability Detectioncited by 4
- 2023Challenging Bug Prediction and Repair Models with Synthetic Bugscited by 3
- 2024SCoPE: Evaluating LLMs for Software Vulnerability Detectioncited by 3
- 2024Can LLM Prompting Serve as a Proxy for Static Analysis in Vulnerability Detectioncited by 3
- 2025Benchmarking AI Models in Software Engineering: A Review, Search Tool, and Unified Approach for Elevating Benchmark Qualitycited by 3
- 2025Revisiting Pre-trained Language Models for Vulnerability Detectioncited by 3
- 2025VULPO: Context-Aware Vulnerability Detection via On-Policy LLM Optimizationcited by 3
- 2025Data and Context Matter: Towards Generalizing AI-based Software Vulnerability Detectioncited by 2
- 2025An Empirical Study of Vulnerabilities in Python Packages and Their Detectioncited by 2
- 2025What Challenges Do Developers Face in AI Agent Systems? An Empirical Study on Stack Overflow & GitHub Issuescited by 2
- 2025Llama-based source code vulnerability detection: Prompt engineering vs Fine tuningcited by 2
- 2026SastBench: A Benchmark for Testing Agentic SAST Triagecited by 2
- 2026EvoRepair: Enhancing Vulnerability Repair Agents Through Experience-Based Self-Evolutioncited by 2
- 2022Enabling Automatic Repair of Source Code Vulnerabilities Using Data-Driven Methodscited by 1
- 2024ARVO: Atlas of Reproducible Vulnerabilities for Open-Source Softwarecited by 1
- 2024ANVIL: Anomaly-based Vulnerability Identification without Labelled Training Datacited by 1
- 2024MVD: A Multi-Lingual Software Vulnerability Detection Frameworkcited by 1
- 2025Generative AI for Internet of Things Security: Challenges and Opportunitiescited by 1
- 2025PyResBugs: A Dataset of Residual Python Bugs for Natural Language-Driven Fault Injectioncited by 1
- 2025Accelerating Automatic Program Repair with Dual Retrieval-Augmented Fine-Tuning and Patch Generation on Large Language Modelscited by 1
- 2025Bridging Semantics & Structure for Software Vulnerability Detection using Hybrid Network Modelscited by 1
50 most cited of 89 All 89 (JSON)
- 2026Metrics Failure in LLM-Based Code Vulnerability Repair: An Empirical Study and a Change-Aware Screen22 Sep 2026
- 2026When LLM Decompilers Recompile More and Preserve Less4 Sep 2026
- 2026The History Is the Detector: Executing CVE Patch History, End-to-End4 Sep 2026
- 2026CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild24 Aug 2026
- 2026Large Language Models at the Intersection of Software Engineering and Software Security:An Evidence-Centered Structured Survey and Research Agenda21 Aug 2026
- 2026Benchmarking Automated Security Patch Backporting: How Far Are We?18 Aug 2026
- 2026AgenticRepair: Multi-Faceted Program Context Engineering for Agentic Vulnerability Repair31 Jul 2026
- 2026From Evaluation to Optimisation: Hierarchy-Aware Training Signals for CWE Prediction in Python23 Jul 2026
- 2026Beyond Refusal: A Same-Lineage Study of Aligned and Abliterated LLMs for Vulnerability Analysis7 Jul 2026
- 2026RustMizan: A Compilable, Contamination-Aware Benchmarking Framework for Rust Vulnerabilities6 Jul 2026
- 2026Neuro-Symbolic Reasoning for Vulnerability Detection4 Jul 2026
- 2026JavaVulBench: A Java Vulnerability Benchmark with Realistic Splits, a Unified Multi-Backend Harness, and a Leakage-Aware Evaluation Mode2 Jul 2026
38 more
- 2026When Passing Tests Hides Vulnerabilities: An Empirical Study of Silent Failures in Agentic Systems25 Jun 2026
- 2026RAVEN: Agentic RAG for Automated Vulnerability Repair21 Jun 2026
- 2026Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software18 Jun 2026
- 2026ARVO: Atlas of Reproducible Vulnerabilities for Open-Source Software15 Jun 2026
- 2026SEVRA-BENCH: Social Engineering of Vulnerabilities in Review Agents11 Jun 2026
- 2026EvoRepair: Enhancing Vulnerability Repair Agents Through Experience-Based Self-Evolution28 May 2026
- 2026ASSEMBLAGE-DEEPHISTORY: A Cross-Build Binary Dataset with Temporal Coverage20 May 2026
- 2026Benchmarking Mythos-Linked Bug Rediscovery17 May 2026
- 2026A Comprehensive Evaluation of Code Language Models for Security Patch Detection13 May 2026
- 2026LogicEval: A Systematic Framework for Evaluating Automated Repair Techniques for Logical Vulnerabilities in Real-World Software14 Apr 2026
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis12 Apr 2026
- 2026Software Vulnerability Detection Using a Lightweight Graph Neural Network31 Mar 2026
- 2026TOSSS: a CVE-based Software Security Benchmark for Large Language Models11 Mar 2026
- 2026Enhancing Continual Learning for Software Vulnerability Prediction: Addressing Catastrophic Forgetting via Hybrid-Confidence-Aware Selective Replay for Temporal LLM Fine-Tuning27 Feb 2026
- 2026From SFT to RL: Demystifying the Post-Training Pipeline for LLM-based Vulnerability Detection15 Feb 2026
- 2026CVE-Factory: Scaling Expert-Level Agentic Tasks for Code Security Vulnerability3 Feb 2026
- 2026Autoregressive, Yet Revisable: In Decoding Revision for Secure Code Generation1 Feb 2026
- 2026SastBench: A Benchmark for Testing Agentic SAST Triage6 Jan 2026
- 2025SoK: Understanding (New) Security Issues Across AI4Code Use Cases20 Dec 2025
- 2025From Lab to Reality: A Practical Evaluation of Deep Learning Models and LLMs for Vulnerability Detection11 Dec 2025
- 2025Llama-based source code vulnerability detection: Prompt engineering vs Fine tuning9 Dec 2025
- 2025VULPO: Context-Aware Vulnerability Detection via On-Policy LLM Optimization14 Nov 2025
- 2025What Challenges Do Developers Face in AI Agent Systems? An Empirical Study on Stack Overflow & GitHub Issues29 Oct 2025
- 2025Bridging Semantics & Structure for Software Vulnerability Detection using Hybrid Network Models11 Oct 2025
- 2025Distilling Lightweight Language Models for C/C++ Vulnerabilities8 Oct 2025
- 2025MulVuln: Enhancing Pre-trained LMs with Shared and Language-Specific Knowledge for Multilingual Vulnerability Detection5 Oct 2025
- 2025LLM-based Vulnerability Discovery through the Lens of Code Metrics23 Sep 2025
- 2025LLaVul: A Multimodal LLM for Interpretable Vulnerability Reasoning about Source Code22 Sep 2025
- 2025Weakly Supervised Vulnerability Localization via Multiple Instance Learning14 Sep 2025
- 2025Large Language Models for Security Operations Centers: A Comprehensive Survey13 Sep 2025
- 2025An Empirical Study of Vulnerabilities in Python Packages and Their Detection4 Sep 2025
- 2025AVIATOR: Towards AI-Agentic Vulnerability Injection Workflow for High-Fidelity, Large-Scale Code Security Dataset28 Aug 2025
- 2025Data and Context Matter: Towards Generalizing AI-based Software Vulnerability Detection14 Aug 2025
- 2025A Systematic Literature Review on Detecting Software Vulnerabilities with Large Language Models30 Jul 2025
- 2025Fine-Tuning Code Language Models to Detect Cross-Language Bugs29 Jul 2025
- 2025Revisiting Pre-trained Language Models for Vulnerability Detection22 Jul 2025
- 2025Accelerating Automatic Program Repair with Dual Retrieval-Augmented Fine-Tuning and Patch Generation on Large Language Models14 Jul 2025
- 2025Improving LLM Reasoning for Vulnerability Detection via Group Relative Policy Optimization3 Jul 2025
50 newest of 89 All 89 (JSON)
- 2025SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security Taskscited by 69
- 2025Agent That Debugs: Dynamic State-Guided Vulnerability Repaircited by 7
- 2026CVE-Factory: Scaling Expert-Level Agentic Tasks for Code Security Vulnerabilitycited by 5
- 2025DefenderBench: A Toolkit for Evaluating Language Agents in Cybersecurity Environmentscited by 4
- 2025What Challenges Do Developers Face in AI Agent Systems? An Empirical Study on Stack Overflow & GitHub Issuescited by 2
- 2026SastBench: A Benchmark for Testing Agentic SAST Triagecited by 2
- 2026EvoRepair: Enhancing Vulnerability Repair Agents Through Experience-Based Self-Evolutioncited by 2
- 2026SEVRA-BENCH: Social Engineering of Vulnerabilities in Review Agentscited by 1
- 2026RAVEN: Agentic RAG for Automated Vulnerability Repaircited by 1
- 2026RustMizan: A Compilable, Contamination-Aware Benchmarking Framework for Rust Vulnerabilitiescited by 1
- 2026AgenticRepair: Multi-Faceted Program Context Engineering for Agentic Vulnerability Repaircited by 1
- 2025AVIATOR: Towards AI-Agentic Vulnerability Injection Workflow for High-Fidelity, Large-Scale Code Security Datasetcited by 0
12 most cited of 15 All 15 (JSON)
- 2026CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild24 Aug 2026
- 2026AgenticRepair: Multi-Faceted Program Context Engineering for Agentic Vulnerability Repair31 Jul 2026
- 2026RustMizan: A Compilable, Contamination-Aware Benchmarking Framework for Rust Vulnerabilities6 Jul 2026
- 2026When Passing Tests Hides Vulnerabilities: An Empirical Study of Silent Failures in Agentic Systems25 Jun 2026
- 2026RAVEN: Agentic RAG for Automated Vulnerability Repair21 Jun 2026
- 2026SEVRA-BENCH: Social Engineering of Vulnerabilities in Review Agents11 Jun 2026
- 2026EvoRepair: Enhancing Vulnerability Repair Agents Through Experience-Based Self-Evolution28 May 2026
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis12 Apr 2026
- 2026CVE-Factory: Scaling Expert-Level Agentic Tasks for Code Security Vulnerability3 Feb 2026
- 2026SastBench: A Benchmark for Testing Agentic SAST Triage6 Jan 2026
- 2025What Challenges Do Developers Face in AI Agent Systems? An Empirical Study on Stack Overflow & GitHub Issues29 Oct 2025
- 2025AVIATOR: Towards AI-Agentic Vulnerability Injection Workflow for High-Fidelity, Large-Scale Code Security Dataset28 Aug 2025
12 newest of 15 All 15 (JSON)
- 2025Improving LLM Reasoning for Vulnerability Detection via Group Relative Policy Optimizationcited by 4
- 2025VULPO: Context-Aware Vulnerability Detection via On-Policy LLM Optimizationcited by 3
- 2025LLaVul: A Multimodal LLM for Interpretable Vulnerability Reasoning about Source Codecited by 0
- 2026Neuro-Symbolic Reasoning for Vulnerability Detectioncited by 0
- 2026Neuro-Symbolic Reasoning for Vulnerability Detection4 Jul 2026
- 2025VULPO: Context-Aware Vulnerability Detection via On-Policy LLM Optimization14 Nov 2025
- 2025LLaVul: A Multimodal LLM for Interpretable Vulnerability Reasoning about Source Code22 Sep 2025
- 2025Improving LLM Reasoning for Vulnerability Detection via Group Relative Policy Optimization3 Jul 2025
- 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 149
- 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 133
- 2023DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detectioncited by 98
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 67
- 2023How Effective Are Neural Networks for Fixing Security Vulnerabilitiescited by 50
- 2025LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insightscited by 44
- 2024Finetuning Large Language Models for Vulnerability Detectioncited by 39
- 2024Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tuningcited by 30
- 2025Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineeringcited by 15
- 2024Enhanced Automated Code Vulnerability Repair using Large Language Modelscited by 10
- 2025CASTLE: Benchmarking Dataset for Static Code Analyzers and LLMs towards CWE Detectioncited by 10
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
12 most cited of 66 All 66 (JSON)
- 2026Metrics Failure in LLM-Based Code Vulnerability Repair: An Empirical Study and a Change-Aware Screen22 Sep 2026
- 2026When LLM Decompilers Recompile More and Preserve Less4 Sep 2026
- 2026The History Is the Detector: Executing CVE Patch History, End-to-End4 Sep 2026
- 2026Large Language Models at the Intersection of Software Engineering and Software Security:An Evidence-Centered Structured Survey and Research Agenda21 Aug 2026
- 2026Benchmarking Automated Security Patch Backporting: How Far Are We?18 Aug 2026
- 2026From Evaluation to Optimisation: Hierarchy-Aware Training Signals for CWE Prediction in Python23 Jul 2026
- 2026Beyond Refusal: A Same-Lineage Study of Aligned and Abliterated LLMs for Vulnerability Analysis7 Jul 2026
- 2026JavaVulBench: A Java Vulnerability Benchmark with Realistic Splits, a Unified Multi-Backend Harness, and a Leakage-Aware Evaluation Mode2 Jul 2026
- 2026Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software18 Jun 2026
- 2026ARVO: Atlas of Reproducible Vulnerabilities for Open-Source Software15 Jun 2026
- 2026ASSEMBLAGE-DEEPHISTORY: A Cross-Build Binary Dataset with Temporal Coverage20 May 2026
- 2026Benchmarking Mythos-Linked Bug Rediscovery17 May 2026
12 newest of 66 All 66 (JSON)