VulAgent: Hypothesis-Validation based Multi-Agent Vulnerability Detection
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
The application of language models to project-level vulnerability detection remains challenging, owing to the dual requirement of accurately localizing security-sensitive code and correctly correlating and reasoning over complex program context. We present VulAgent, a multi-agent vulnerability detection framework based on hypothesis validation. Our design is inspired by how human auditors review code: when noticing a sensitive operation, they form a hypothesis about a possible vulnerability, consider potential trigger paths, and then verify the hypothesis against the surrounding context. VulAgent implements a semantics-sensitive, multi-view detection pipeline: specialized agents, each aligned to a specific analysis perspective (e.g., memory, authorization), collaboratively surface and precisely localize sensitive code sites with higher coverage. Building on this, VulAgent adopts a hypothesis-validation paradigm: for each vulnerability report, it builds hypothesis conditions and a trigger path, steering the LLM to target the relevant program context and defensive checks during verification, which reduces false positives. On average across the two datasets, VulAgent improves overall accuracy by 6.6%, increases the correct identification rate of vulnerable--fixed code pairs by up to 450% (246% on average), and reduces the false positive rate by about 36% compared with state-of-the-art LLM-based baselines.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 25 of its 46 references that are in the map. First posted on arXiv 15 Sep 2025.
Builds on
25 of 46 references.
Closest ancestors · 3
Same direction, newest first
- 2025Let the Trial Begin: A Mock-Court Approach to Vulnerability Detection using LLM-Based Agents16 May
- 2024EvalSVA: Multi-Agent Evaluators for Next-Gen Software Vulnerability Assessment11 Dec
- 2024Combining Fine-Tuning and LLM-based Agents for Intuitive Smart Contract Auditing with Justifications24 Mar
Other references · 22
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 744
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 609
- 2022UniXcoder: Unified Cross-Modal Pre-training for Code Representationcited by 361
- 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 155
- 2020Deep Learning based Vulnerability Detection: Are We There Yet?cited by 144
- 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 139
- 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
- 2023LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarkscited by 97
- 2018SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilitiescited by 92
- 2023Prompt-Enhanced Software Vulnerability Detection Using ChatGPTcited by 51
- 2023Large Language Model-Powered Smart Contract Vulnerability Detection: New Perspectivescited by 48
10 more
- 2022Transformer-Based Language Models for Software Vulnerability Detectioncited by 39
- 2022SPT-Code: Sequence-to-Sequence Pre-Training for Learning Source Code Representationscited by 36
- 2021ReGVD: Revisiting Graph Neural Networks for Vulnerability Detectioncited by 32
- 2024Chain-of-Thought Prompting of Large Language Models for Discovering and Fixing Software Vulnerabilitiescited by 31
- 2024Multi-role Consensus through LLMs Discussions for Vulnerability Detectioncited by 19
- 2024Harnessing Large Language Models for Software Vulnerability Detection: A Comprehensive Benchmarking Studycited by 17
- 2017Automatic feature learning for vulnerability predictioncited by 10
- 2024LLM-SmartAudit: Advanced Smart Contract Vulnerability Detectioncited by 10
- 2025Boosting Vulnerability Detection of LLMs via Curriculum Preference Optimization with Synthetic Reasoning Datacited by 8
- 2021VulSPG: Vulnerability detection based on slice property graph representation learningcited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2026CodeHacker: Automated Test Case Generation for Detecting Vulnerabilities in Competitive Programming Solutionscited by 8
- 2026Antares: Foundation Models for Agentic Vulnerability Localizationcited by 2
- 2025From LLMs to Agents: A Comparative Evaluation of LLMs and LLM-based Agents in Security Patch Detectioncited by 1
- 2026PoC-Adapt: Semantic-Aware Automated Vulnerability Reproduction with LLM Multi-Agents and Reinforcement Learning-Driven Adaptive Policycited by 1
- 2026SPECA: Specification-to-Checklist Agentic Auditing for Multi-Implementation Systems -- A Case Study on Ethereum Clientscited by 0
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysiscited by 0
- 2026Refute-or-Promote: An Adversarial Stage-Gated Multi-Agent Review Methodology for High-Precision LLM-Assisted Defect Discoverycited by 0
- 2026Code-Augur: Agentic Vulnerability Detection via Specification Inferencecited by 0
- 2026Antares: Foundation Models for Agentic Vulnerability Localization3 Aug 2026
- 2026Code-Augur: Agentic Vulnerability Detection via Specification Inference17 Jun 2026
- 2026Refute-or-Promote: An Adversarial Stage-Gated Multi-Agent Review Methodology for High-Precision LLM-Assisted Defect Discovery21 Apr 2026
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis12 Apr 2026
- 2026PoC-Adapt: Semantic-Aware Automated Vulnerability Reproduction with LLM Multi-Agents and Reinforcement Learning-Driven Adaptive Policy8 Apr 2026
- 2026CodeHacker: Automated Test Case Generation for Detecting Vulnerabilities in Competitive Programming Solutions23 Feb 2026
- 2026SPECA: Specification-to-Checklist Agentic Auditing for Multi-Implementation Systems -- A Case Study on Ethereum Clients7 Feb 2026
- 2025From LLMs to Agents: A Comparative Evaluation of LLMs and LLM-based Agents in Security Patch Detection11 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Benchmarking LLMs and LLM-based Agents in Practical Vulnerability Detection for Code Repositories
- 2026Detecting Vulnerability-Inducing Commits via Multi-Stage Reasoning with LLM-Based Agents
- 2026CLEAR: Causal Context-Based Agentic Reasoning for Vulnerability Detection
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproduction
- 2026VulnAgent-R2: Evidence-Calibrated Multi-Agent Auditing for Repository-Level Vulnerability Detection
- 2026VulnGym: Benchmarking Coding Agents for Repository-Level Vulnerability Detection
- 2026VulTriage: Triple-Path Context Augmentation for LLM-Based Vulnerability Detection
- 2026Three Heads Are Better Than One: A Multi-perspective Reasoning Framework for Enhanced Vulnerability Detection