mlsanityData to 14 Oct 2026

AVIATOR: Towards AI-Agentic Vulnerability Injection Workflow for High-Fidelity, Large-Scale Code Security Dataset

arXiv 2508.20866 ↗First posted 28 Aug 2025cs.CR cs.AIcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

The increasing complexity of software systems and the sophistication of cyber-attacks have underscored the need for reliable automated software vulnerability detection. Data-driven approaches using deep learning models show promise but critically depend on the availability of large, accurately labeled datasets. Yet existing datasets either suffer from noisy labels, limited vulnerability coverage, or fail to reflect vulnerabilities as they occur in real-world software. This also limits large-scale benchmarking of such solutions. Automated vulnerability injection provides a way to address these limitations, but existing techniques remain limited in coverage, contextual fidelity, or injection success. In this paper, we present AVIATOR, the first AI-agentic vulnerability injection framework. AVIATOR decomposes vulnerability injection into a coordinated workflow of specialized AI agents, tool-based analysis, and iterative self-correction, explicitly mirroring expert reasoning. It integrates RAG and lightweight LoRA-based fine-tuning to produce realistic, category-specific vulnerabilities without relying on handcrafted patterns. Across three benchmarks, AVIATOR achieves high injection fidelity (91-95%) surpassing existing injection techniques in both accuracy and vulnerability coverage. When used for data augmentation to train deep learning-based vulnerability detection (DLVD) models, AVIATOR provides the strongest downstream gains in vulnerability detection. Across models and base datasets, AVIATOR improves average F1 scores by +22% over no augmentation, +25% over VGX, holding the prior best injection success rate, and +3% over VulScribeR, the prior state-of-the-art LLM-based injection model, with +7% higher recall and no precision loss. Its augmented data exhibits the lowest distributional distortion and scales efficiently with <2% syntax rejection at 4.3x lower cost than VulScribeR.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 29 of its 55 references that are in the map. First posted on arXiv 28 Aug 2025.

Builds on

29 of 55 references.

References · 29

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  4. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
  5. 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 479
  6. 2019Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networkscited by 272
  7. 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 155
  8. 2020Deep Learning based Vulnerability Detection: Are We There Yet?cited by 144
  9. 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 139
  10. 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
  11. 2023DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detectioncited by 102
  12. 2018SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilitiescited by 92
17 more
  1. 2021CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Softwarecited by 91
  2. 2023Data Quality for Software Vulnerability Datasetscited by 51
  3. 2021D2A: A Dataset Built for AI-Based Vulnerability Detection Methods Using Differential Analysiscited by 49
  4. 2024Large Language Model for Vulnerability Detection and Repair: Literature Review and the Road Aheadcited by 42
  5. 2023The FormAI Dataset: Generative AI in Software Security Through the Lens of Formal Verificationcited by 34
  6. 2021Learning Structural Edits via Incremental Tree Transformationscited by 16
  7. 2024Code Security Vulnerability Repair Using Reinforcement Learning with Large Language Modelscited by 10
  8. 2025CASTLE: Benchmarking Dataset for Static Code Analyzers and LLMs towards CWE Detectioncited by 10
  9. 2023Towards Causal Deep Learning for Vulnerability Detectioncited by 9
  10. 2023VGX: Large-Scale Sample Generation for Boosting Learning-Based Software Vulnerability Analysescited by 9
  11. 2023When Less is Enough: Positive and Unlabeled Learning Model for Vulnerability Detectioncited by 8
  12. 2024DeepCode AI Fix: Fixing Security Vulnerabilities with Large Language Modelscited by 7
  13. 2024VulScribeR: Exploring RAG-based Vulnerability Augmentation with LLMscited by 7
  14. 2024Automatic Data Labeling for Software Vulnerability Prediction Models: How Far Are We?cited by 6
  15. 2020EvilCoder: Automated Bug Insertioncited by 2
  16. 2019Automated Customized Bug-Benchmark Generationcited by 1
  17. 2025How to Secure Existing C and C++ Software without Memory Safetycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Automated Vulnerability Validation and Verification: A Large Language Model Approach
  2. 2025"Your AI, My Shell": Demystifying Prompt Injection Attacks on Agentic AI Coding Editors
  3. 2026CVE-Factory: Scaling Expert-Level Agentic Tasks for Code Security Vulnerability
  4. 2026Code-Augur: Agentic Vulnerability Detection via Specification Inference
  5. 2024Direction for Detection: A Survey of Automated Vulnerability Detection and all of its Pain Points
  6. 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Management
  7. 2026Prompt Injection Attacks on Agentic Coding Assistants: A Systematic Analysis of Vulnerabilities in Skills, Tools, and Protocol Ecosystems
  8. 2025Breaking the Code: Security Assessment of AI Code Agents Through Systematic Jailbreaking Attacks