IRIS: LLM-Assisted Static Analysis for Detecting Security Vulnerabilities
Not on the map. Why?
Cited by 43 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Software is prone to security vulnerabilities. Program analysis tools to detect them have limited effectiveness in practice due to their reliance on human labeled specifications. Large language models (or LLMs) have shown impressive code generation capabilities but they cannot do complex reasoning over code to detect such vulnerabilities especially since this task requires whole-repository analysis. We propose IRIS, a neuro-symbolic approach that systematically combines LLMs with static analysis to perform whole-repository reasoning for security vulnerability detection. Specifically, IRIS leverages LLMs to infer taint specifications and perform contextual analysis, alleviating needs for human specifications and inspection. For evaluation, we curate a new dataset, CWE-Bench-Java, comprising 120 manually validated security vulnerabilities in real-world Java projects. A state-of-the-art static analysis tool CodeQL detects only 27 of these vulnerabilities whereas IRIS with GPT-4 detects 55 (+28) and improves upon CodeQL's average false discovery rate by 5% points. Furthermore, IRIS identifies 4 previously unknown vulnerabilities which cannot be found by existing tools. IRIS is available publicly at https://github.com/iris-sast/iris.
Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 May 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 11; 2025: 47; 2026: 42.
100 papers.
Sort:
By area:
- 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 173
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 67
- 2025RepoAudit: An Autonomous LLM-Agent for Repository-Level Code Auditingcited by 47
- 2025LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insightscited by 44
- 2024Human-In-the-Loop Software Development Agentscited by 42
- 2025Repo2Run: Automated Building Executable Environment for Code Repository at Scalecited by 39
- 2025BaxBench: Can LLMs Generate Correct and Secure Backends?cited by 38
- 2025AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunitiescited by 26
- 2025KNighter: Transforming Static Analysis with LLM-Synthesized Checkerscited by 22
- 2025Frontier AI's Impact on the Cybersecurity Landscapecited by 21
- 2025A Survey on Agentic Security: Applications, Threats and Defensescited by 17
- 2025Understanding Automated Program Repair Agents Through the Lens of Traceability: An Empirical Studycited by 16
38 more
- 2025Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineeringcited by 15
- 2024SECURE: Benchmarking Large Language Models for Cybersecuritycited by 13
- 2025FaultLine: Automated Proof-of-Vulnerability Generation Using LLM Agentscited by 11
- 2025VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detectioncited by 11
- 2025A Contemporary Survey of Large Language Model Assisted Program Analysiscited by 10
- 2025CASTLE: Benchmarking Dataset for Static Code Analyzers and LLMs towards CWE Detectioncited by 10
- 2025Rethinking the Evaluation of Secure Code Generationcited by 10
- 2024From Vulnerabilities to Remediation: A Systematic Literature Review of LLMs in Code Securitycited by 9
- 2024LProtector: An LLM-driven Vulnerability Detection Systemcited by 8
- 2025OSVBench: Benchmarking LLMs on Specification Generation Tasks for Operating System Verificationcited by 8
- 2025Locus: Agentic Predicate Synthesis for Directed Fuzzingcited by 8
- 2024Enhancing Automated Loop Invariant Generation for Complex Programs with Large Language Modelscited by 7
- 2025Reasoning with LLMs for Zero-Shot Vulnerability Detectioncited by 7
- 2025RFCAudit: An LLM Agent for Functional Bug Detection in Network Protocolscited by 7
- 2025A Comprehensive Empirical Evaluation of Agent Frameworks on Code-centric Software Engineering Taskscited by 7
- 2024Harnessing the Power of LLMs in Source Code Vulnerability Detectioncited by 6
- 2024Helping LLMs Improve Code Generation Using Feedback from Testing and Static Analysiscited by 6
- 2025CodeVisionary: An Agent-based Framework for Evaluating Large Language Models in Code Generationcited by 6
- 2025QLPro: Automated Code Vulnerability Discovery via LLM and Static Code Analysis Integrationcited by 6
- 2025One Bug, Hundreds Behind: LLMs for Large-Scale Bug Discoverycited by 6
- 2026When Agents Do Not Stop: Uncovering Infinite Agentic Loops in LLM Agentscited by 6
- 2025PredicateFix: Repairing Static Analysis Alerts with Bridging Predicatescited by 5
- 2025Large Language Models for Validating Network Protocol Parserscited by 5
- 2025Trace Gadgets: Minimizing Code Context for Machine Learning-Based Vulnerability Predictioncited by 5
- 2025How Safe Are AI-Generated Patches? A Large-scale Study on Security Risks in LLM and Agentic Automated Program Repair on SWE-benchcited by 5
- 2026Reducing False Positives in Static Bug Detection with LLMs: An Empirical Study in Industrycited by 5
- 2026Sifting the Noise: A Comparative Study of LLM Agents in Vulnerability False Positive Filteringcited by 5
- 2025XOXO: Stealthy Cross-Origin Context Poisoning Attacks against AI Coding Assistantscited by 4
- 2025Lobster: A GPU-Accelerated Framework for Neurosymbolic Programmingcited by 4
- 2025The Hitchhiker's Guide to Program Analysis, Part II: Deep Thoughts by LLMscited by 4
- 2025Benchmarking LLM-Assisted Blue Teaming via Standardized Threat Huntingcited by 4
- 2025LLM Agents for Automated Web Vulnerability Reproduction: Are We There Yet?cited by 4
- 2025ESCA: Contextualizing Embodied Agents via Scene-Graph Generationcited by 4
- 2025AthenaBench: A Dynamic Benchmark for Evaluating LLMs in Cyber Threat Intelligencecited by 4
- 2025VulInstruct: Teaching LLMs Root-Cause Reasoning for Vulnerability Detection via Security Specificationscited by 4
- 2025AutoBaxBuilder: Bootstrapping Code Security Benchmarkingcited by 4
- 2026OpenSage: Self-programming Agent Generation Enginecited by 4
- 2026AnyPoC: Universal Proof-of-Concept Test Generation for Scalable LLM-Based Bug Detectioncited by 4
50 most cited of 100 All 100 (JSON)
- 2026Vulnerability Localization Benchmark: Measuring Agentic Security Analysis at Repository Scale14 Sep 2026
- 2026TyPatch: Transforming Patches into Typestate Rules for Kernel Bug Detection12 Sep 2026
- 2026The History Is the Detector: Executing CVE Patch History, End-to-End4 Sep 2026
- 2026FuzzingBrain-Bench V1: Evaluating Open-Ended Bug Discovery by LLMs25 Aug 2026
- 2026On Predicting Vulnerability Severity Using In-Context Learning: An Industrial Case Study22 Aug 2026
- 2026ARQ: Agentic CodeQL Query Refinement for C/C++ Vulnerability Detection21 Aug 2026
- 2026VICBench: A Multi-Language Benchmark for Code Vulnerability Detection12 Aug 2026
- 2026ALIBI: Adaptive Agentic Attacks on LLM-Based Vulnerability Detectors via Adversarial Code Comments27 Jul 2026
- 2026RECEIPT: Deterministic, Reward-Hacking-Resistant Verification for White-Box Agentic XSS Discovery20 Jul 2026
- 2026AutoTrace: From Patches to Triggers via Agentic Interprocedural Exploration13 Jul 2026
- 2026FlowArk: Boosting Agentic Data-flow Analysis for Android Apps via Context-Aware Knowledge Reuse13 Jul 2026
- 2026When Agents Do Not Stop: Uncovering Infinite Agentic Loops in LLM Agents2 Jul 2026
38 more
- 2026Revelio: Cost-Efficient Agentic Memory Safety Vulnerability Detection For Repository-Scale Codebases20 Jun 2026
- 2026Code-Augur: Agentic Vulnerability Detection via Specification Inference17 Jun 2026
- 2026Transferable Self-Evolving Playbooks for Agentic Security Auditing15 Jun 2026
- 2026An Organization-Scoped LLM Agent Runtime Architecture for Regulated Cybersecurity Operations28 May 2026
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproduction20 May 2026
- 2026VIPER-MCP: Detecting and Exploiting Taint-Style Vulnerabilities in Model Context Protocol Servers20 May 2026
- 2026Three Heads Are Better Than One: A Multi-perspective Reasoning Framework for Enhanced Vulnerability Detection18 May 2026
- 2026Detecting Privilege Escalation in Polyglot Microservices via Agentic Program Analysis15 May 2026
- 2026Veritas: Grounding LLM Agents for Reliable Vulnerability Reasoning over Stripped Binaries14 May 2026
- 2026Do Coding Agents Understand Least-Privilege Authorization?14 May 2026
- 2026CoT-Guard: Small Models for Strong Monitoring12 May 2026
- 2026Agentic Interpretation: Lattice-Structured Evidence for LLM-Based Program Analysis12 May 2026
- 2026CyberAId: AI-Driven Cybersecurity for Financial Service Providers3 May 2026
- 2026BODHI: Precise OS Kernel Specification Inference22 Apr 2026
- 2026Refute-or-Promote: An Adversarial Stage-Gated Multi-Agent Review Methodology for High-Precision LLM-Assisted Defect Discovery21 Apr 2026
- 2026RAVEN: Retrieval-Augmented Vulnerability Exploration Network for Memory Corruption Analysis in User Code and Binary Programs20 Apr 2026
- 2026AnyPoC: Universal Proof-of-Concept Test Generation for Scalable LLM-Based Bug Detection13 Apr 2026
- 2026VCAO: Verifier-Centered Agentic Orchestration for Strategic OS Vulnerability Discovery9 Apr 2026
- 2026Argus: Reorchestrating Static Analysis via a Multi-Agent Ensemble for Full-Chain Security Vulnerability Detection8 Apr 2026
- 2026PoC-Adapt: Semantic-Aware Automated Vulnerability Reproduction with LLM Multi-Agents and Reinforcement Learning-Driven Adaptive Policy8 Apr 2026
- 2026Seclens: Role-specific Evaluation of LLM's for security vulnerablity detection2 Apr 2026
- 2026Reachability Across the NL/PL Boundary: A Taxonomy-Driven Dataflow Model for LLM-Integrated Applications30 Mar 2026
- 2026Detecting Data Poisoning in Code Generation LLMs via Black-Box, Vulnerability-Oriented Scanning17 Mar 2026
- 2026OpenSage: Self-programming Agent Generation Engine18 Feb 2026
- 2026VulReaD: Knowledge-Graph-guided Software Vulnerability Reasoning and Detection11 Feb 2026
- 2026SPECA: Specification-to-Checklist Agentic Auditing for Multi-Implementation Systems -- A Case Study on Ethereum Clients7 Feb 2026
- 2026OmniCode: A Benchmark for Evaluating Software Engineering Agents2 Feb 2026
- 2026Sifting the Noise: A Comparative Study of LLM Agents in Vulnerability False Positive Filtering30 Jan 2026
- 2026Reducing False Positives in Static Bug Detection with LLMs: An Empirical Study in Industry26 Jan 2026
- 2026Multi-Agent Taint Specification Extraction for Vulnerability Detection15 Jan 2026
- 2025AutoBaxBuilder: Bootstrapping Code Security Benchmarking24 Dec 2025
- 2025Diverse LLMs vs. Vulnerabilities: Who Detects and Fixes Them Better?14 Dec 2025
- 2025VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detection8 Dec 2025
- 2025VulInstruct: Teaching LLMs Root-Cause Reasoning for Vulnerability Detection via Security Specifications6 Nov 2025
- 2025AthenaBench: A Dynamic Benchmark for Evaluating LLMs in Cyber Threat Intelligence3 Nov 2025
- 2025A Comprehensive Empirical Evaluation of Agent Frameworks on Code-centric Software Engineering Tasks2 Nov 2025
- 2025Is Your Prompt Poisoning Code? Defect Induction Rates and Security Mitigation Strategies27 Oct 2025
- 2025LLM Agents for Automated Web Vulnerability Reproduction: Are We There Yet?16 Oct 2025
50 newest of 100 All 100 (JSON)
- 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 173
- 2025RepoAudit: An Autonomous LLM-Agent for Repository-Level Code Auditingcited by 47
- 2024Human-In-the-Loop Software Development Agentscited by 42
- 2025AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunitiescited by 26
- 2025A Survey on Agentic Security: Applications, Threats and Defensescited by 17
- 2025Understanding Automated Program Repair Agents Through the Lens of Traceability: An Empirical Studycited by 16
- 2025FaultLine: Automated Proof-of-Vulnerability Generation Using LLM Agentscited by 11
- 2025Locus: Agentic Predicate Synthesis for Directed Fuzzingcited by 8
- 2025RFCAudit: An LLM Agent for Functional Bug Detection in Network Protocolscited by 7
- 2025A Comprehensive Empirical Evaluation of Agent Frameworks on Code-centric Software Engineering Taskscited by 7
- 2025CodeVisionary: An Agent-based Framework for Evaluating Large Language Models in Code Generationcited by 6
- 2026When Agents Do Not Stop: Uncovering Infinite Agentic Loops in LLM Agentscited by 6
12 most cited of 39 All 39 (JSON)
- 2026Vulnerability Localization Benchmark: Measuring Agentic Security Analysis at Repository Scale14 Sep 2026
- 2026ARQ: Agentic CodeQL Query Refinement for C/C++ Vulnerability Detection21 Aug 2026
- 2026ALIBI: Adaptive Agentic Attacks on LLM-Based Vulnerability Detectors via Adversarial Code Comments27 Jul 2026
- 2026RECEIPT: Deterministic, Reward-Hacking-Resistant Verification for White-Box Agentic XSS Discovery20 Jul 2026
- 2026AutoTrace: From Patches to Triggers via Agentic Interprocedural Exploration13 Jul 2026
- 2026FlowArk: Boosting Agentic Data-flow Analysis for Android Apps via Context-Aware Knowledge Reuse13 Jul 2026
- 2026When Agents Do Not Stop: Uncovering Infinite Agentic Loops in LLM Agents2 Jul 2026
- 2026Revelio: Cost-Efficient Agentic Memory Safety Vulnerability Detection For Repository-Scale Codebases20 Jun 2026
- 2026Code-Augur: Agentic Vulnerability Detection via Specification Inference17 Jun 2026
- 2026Transferable Self-Evolving Playbooks for Agentic Security Auditing15 Jun 2026
- 2026An Organization-Scoped LLM Agent Runtime Architecture for Regulated Cybersecurity Operations28 May 2026
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproduction20 May 2026
12 newest of 39 All 39 (JSON)
- 2025VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detectioncited by 11
- 2025Reasoning with LLMs for Zero-Shot Vulnerability Detectioncited by 7
- 2025Lobster: A GPU-Accelerated Framework for Neurosymbolic Programmingcited by 4
- 2025VulInstruct: Teaching LLMs Root-Cause Reasoning for Vulnerability Detection via Security Specificationscited by 4
- 2026Argus: Reorchestrating Static Analysis via a Multi-Agent Ensemble for Full-Chain Security Vulnerability Detectioncited by 1
- 2026Veritas: Grounding LLM Agents for Reliable Vulnerability Reasoning over Stripped Binariescited by 1
- 2026Three Heads Are Better Than One: A Multi-perspective Reasoning Framework for Enhanced Vulnerability Detectioncited by 1
- 2026VulReaD: Knowledge-Graph-guided Software Vulnerability Reasoning and Detectioncited by 0
- 2026CoT-Guard: Small Models for Strong Monitoringcited by 0
- 2026Three Heads Are Better Than One: A Multi-perspective Reasoning Framework for Enhanced Vulnerability Detection18 May 2026
- 2026Veritas: Grounding LLM Agents for Reliable Vulnerability Reasoning over Stripped Binaries14 May 2026
- 2026CoT-Guard: Small Models for Strong Monitoring12 May 2026
- 2026Argus: Reorchestrating Static Analysis via a Multi-Agent Ensemble for Full-Chain Security Vulnerability Detection8 Apr 2026
- 2026VulReaD: Knowledge-Graph-guided Software Vulnerability Reasoning and Detection11 Feb 2026
- 2025VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detection8 Dec 2025
- 2025VulInstruct: Teaching LLMs Root-Cause Reasoning for Vulnerability Detection via Security Specifications6 Nov 2025
- 2025Lobster: A GPU-Accelerated Framework for Neurosymbolic Programming27 Mar 2025
- 2025Reasoning with LLMs for Zero-Shot Vulnerability Detection22 Mar 2025
- 2025AutoBaxBuilder: Bootstrapping Code Security Benchmarkingcited by 4
- 2025AutoBaxBuilder: Bootstrapping Code Security Benchmarking24 Dec 2025
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 67
- 2025LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insightscited by 44
- 2025Repo2Run: Automated Building Executable Environment for Code Repository at Scalecited by 39
- 2025BaxBench: Can LLMs Generate Correct and Secure Backends?cited by 38
- 2025KNighter: Transforming Static Analysis with LLM-Synthesized Checkerscited by 22
- 2025Frontier AI's Impact on the Cybersecurity Landscapecited by 21
- 2025Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineeringcited by 15
- 2024SECURE: Benchmarking Large Language Models for Cybersecuritycited by 13
- 2025A Contemporary Survey of Large Language Model Assisted Program Analysiscited by 10
- 2025CASTLE: Benchmarking Dataset for Static Code Analyzers and LLMs towards CWE Detectioncited by 10
- 2025Rethinking the Evaluation of Secure Code Generationcited by 10
- 2024From Vulnerabilities to Remediation: A Systematic Literature Review of LLMs in Code Securitycited by 9
12 most cited of 47 All 47 (JSON)
- 2026TyPatch: Transforming Patches into Typestate Rules for Kernel Bug Detection12 Sep 2026
- 2026The History Is the Detector: Executing CVE Patch History, End-to-End4 Sep 2026
- 2026FuzzingBrain-Bench V1: Evaluating Open-Ended Bug Discovery by LLMs25 Aug 2026
- 2026On Predicting Vulnerability Severity Using In-Context Learning: An Industrial Case Study22 Aug 2026
- 2026VICBench: A Multi-Language Benchmark for Code Vulnerability Detection12 Aug 2026
- 2026CyberAId: AI-Driven Cybersecurity for Financial Service Providers3 May 2026
- 2026BODHI: Precise OS Kernel Specification Inference22 Apr 2026
- 2026Seclens: Role-specific Evaluation of LLM's for security vulnerablity detection2 Apr 2026
- 2026Reachability Across the NL/PL Boundary: A Taxonomy-Driven Dataflow Model for LLM-Integrated Applications30 Mar 2026
- 2026Reducing False Positives in Static Bug Detection with LLMs: An Empirical Study in Industry26 Jan 2026
- 2025Diverse LLMs vs. Vulnerabilities: Who Detects and Fixes Them Better?14 Dec 2025
- 2025AthenaBench: A Dynamic Benchmark for Evaluating LLMs in Cyber Threat Intelligence3 Nov 2025
12 newest of 47 All 47 (JSON)