Veritas: Grounding LLM Agents for Reliable Vulnerability Reasoning over Stripped Binaries
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Frontier LLM agents are increasingly capable of localizing suspicious code, but vulnerability reasoning requires more than access to program artifacts. An agent must carry forward the evidence that actually decides whether a vulnerability exists. Otherwise, safety-relevant facts may be present in the artifact but absent from the reasoning used to justify the claim, creating a semantic gap between available program facts and the evidence used by the agent. This problem is especially acute for stripped binaries, where source-level cues are removed and relevant evidence is fragmented across noisy lifted IR and lossy decompiled views. We formulate stripped-binary vulnerability reasoning as a semantic grounding problem and present Veritas, a three-stage framework for reliable analysis. First, a static-analysis Slicer recovers witness-backed source-to-sink flows from lifted LLVM IR. Second, an LLM-based Discover stage aligns decompiled code with IR witnesses to construct vulnerability claims. Third, a multi-agent Validator checks these claims through guided debugging and runtime oracles. Together, these stages turn fragmented binary views into checkable claims rather than relying on direct agent inference. We instantiate Veritas for out-of-bounds vulnerabilities and evaluate it on a curated benchmark with flow-level annotations. Veritas achieves 90% recall, outperforms static, dynamic, binary-analysis, and agentic baselines, and reports no false positives among 623 exhaustively validated candidates and only two observed false positives in sampled audits. In a real-world case study, Veritas discovered a previously unknown Apple vulnerability that was confirmed and assigned a CVE, demonstrating that grounded reasoning can produce actionable findings beyond the curated benchmark.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 16 of its 62 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
16 of 62 references.
Closest ancestors · 5
Same direction, newest first
- 2025VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detection8 Dec
- 2025Boosting Vulnerability Detection of LLMs via Curriculum Preference Optimization with Synthetic Reasoning Data9 Jun
- 2025Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMs26 Feb
- 2024To Err is Machine: Vulnerability Detection Challenges LLM Reasoning25 Mar
- 2024Reasoning Runtime Behavior of a Program with LLM: How Far Are We?25 Mar
Other references · 11
- 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 139
- 2024IRIS: LLM-Assisted Static Analysis for Detecting Security Vulnerabilitiescited by 103
- 2025SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security Taskscited by 75
- 2024EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security Vulnerabilitiescited by 52
- 2025RepoAudit: An Autonomous LLM-Agent for Repository-Level Code Auditingcited by 49
- 2025CRAKEN: Cybersecurity LLM Agent with Knowledge-Based Executioncited by 14
- 2023Harnessing the Power of LLM to Support Binary Taint Analysiscited by 13
- 2025BugScope: Learn to Find Bugs Like Humancited by 5
- 2025VulBinLLM: LLM-powered Vulnerability Detection for Stripped Binariescited by 4
- 2025LLM-based Vulnerability Discovery through the Lens of Code Metricscited by 4
- 2024ARVO: Atlas of Reproducible Vulnerabilities for Open-Source Softwarecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Execution-State-Aware LLM Reasoning for Automated Proof-of-Vulnerability Generation
- 2025Benchmarking LLMs and LLM-based Agents in Practical Vulnerability Detection for Code Repositories
- 2026Antaeus: Hunting Repository-Level Logic Vulnerabilities via Context-Grounded LLM Reasoning ↗
- 2026Correct Verdicts, Flawed Reasoning: Structured Auditing of LLM-based Vulnerability Reasoning
- 2025Let the Trial Begin: A Mock-Court Approach to Vulnerability Detection using LLM-Based Agents
- 2026Cheap to Hypothesize, Costly to Verify: The Defense Surface of Agentic Vulnerability Discovery
- 2026From Runnable to Verifiable: An Independent Reproducibility Study of LLM/Agent-Driven Vulnerability Validation Artifacts
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis