VCAO: Verifier-Centered Agentic Orchestration for Strategic OS Vulnerability Discovery
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
We formulate operating-system vulnerability discovery as a repeated Bayesian Stackelberg search game in which a Large Reasoning Model (LRM) orchestrator allocates analysis budget across kernel files, functions, and attack paths while external verifiers -- static analyzers, fuzzers, and sanitizers -- provide evidence. At each round, the orchestrator selects a target component, an analysis method, and a time budget; observes tool outputs; updates Bayesian beliefs over latent vulnerability states; and re-solves the game to minimize the strategic attacker's expected payoff. We introduce textscVCAO (Verifier-Centered Agentic Orchestration), a six-layer architecture comprising surface mapping, intra-kernel attack-graph construction, game-theoretic file/function ranking, parallel executor agents, cascaded verification, and a safety governor. Our DOBSS-derived MILP allocates budget optimally across heterogeneous analysis tools under resource constraints, with formal tildeO(√T) regret bounds from online Stackelberg learning. Experiments on five Linux kernel subsystems -- replaying 847 historical CVEs and running live discovery on upstream snapshots -- show that textscVCAO discovers 2.7× more validated vulnerabilities per unit budget than coverage-only fuzzing, 1.9× more than static-analysis-only baselines, and 1.4× more than non-game-theoretic multi-agent pipelines, while reducing false-positive rates reaching human reviewers by 68%. We release our simulation framework, synthetic attack-graph generator, and evaluation harness as open-source artifacts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 5 of its 31 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
5 of 31 references.
References · 5
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 324
- 2024IRIS: LLM-Assisted Static Analysis for Detecting Security Vulnerabilitiescited by 103
- 2023KernelGPT: Enhanced Kernel Fuzzing via Large Language Modelscited by 17
- 2016Efficient Attack Graph Analysis through Approximate Inferencecited by 2
- 2024MEGA-PT: A Meta-Game Framework for Agile Penetration Testingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Cheap to Hypothesize, Costly to Verify: The Defense Surface of Agentic Vulnerability Discovery
- 2026PrimSynth: An Agentic Approach to Discover, Validate, and Synthesize Exploit Primitives for Linux Kernel Vulnerabilities
- 2026Graph Is the Verifier: Agentic Reinforcement Learning for Interprocedural Vulnerability Detection
- 2026Argus: Reorchestrating Static Analysis via a Multi-Agent Ensemble for Full-Chain Security Vulnerability Detection
- 2026LITMUS: Benchmarking Behavioral Jailbreaks of LLM Agents in Real OS Environments
- 2026Transferable Self-Evolving Playbooks for Agentic Security Auditing
- 2026Strategic Heterogeneous Multi-Agent Architecture for Cost-Effective Code Vulnerability Detection
- 2026Veritas: Grounding LLM Agents for Reliable Vulnerability Reasoning over Stripped Binaries