Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overview
Not on the map. Why?
Abstract (arXiv)
Software testing and verification are critical for ensuring the reliability and security of modern software systems. Traditionally, formal verification techniques, such as model checking and theorem proving, have provided rigorous frameworks for detecting bugs and vulnerabilities. However, these methods often face scalability challenges when applied to complex, real-world programs. Recently, the advent of Large Language Models (LLMs) has introduced a new paradigm for software analysis, leveraging their ability to understand insecure coding practices. Although LLMs demonstrate promising capabilities in tasks such as bug prediction and invariant generation, they lack the formal guarantees of classical methods. This paper presents a comprehensive study of state-of-the-art software testing and verification, focusing on three key approaches: classical formal methods, LLM-based analysis, and emerging hybrid techniques, which combine their strengths. We explore each approach's strengths, limitations, and practical applications, highlighting the potential of hybrid systems to address the weaknesses of standalone methods. We analyze whether integrating formal rigor with LLM-driven insights can enhance the effectiveness and scalability of software verification, exploring their viability as a pathway toward more robust and adaptive testing frameworks.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 37 of its 58 references that are in the map. First posted on arXiv 13 Mar 2025.
Builds on
37 of 58 references.
References · 37
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 155
- 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 139
- 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
- 2023DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detectioncited by 102
- 2023LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarkscited by 97
- 2018SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilitiescited by 92
- 2021CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Softwarecited by 91
- 2022VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detectioncited by 51
- 2023Lemur: Integrating Large Language Models in Automated Program Verificationcited by 49
- 2023A New Era in Software Security: Towards Self-Healing Software via Large Language Models and Formal Verificationcited by 42
- 2024Large Language Model for Vulnerability Detection and Repair: Literature Review and the Road Aheadcited by 42
25 more
- 2020VulDeeLocator: A Deep Learning-based Fine-grained Vulnerability Detectorcited by 37
- 2024PropertyGPT: LLM-driven Formal Verification of Smart Contracts through Retrieval-Augmented Property Generationcited by 37
- 2024Automatic Programming: Large Language Models and Beyondcited by 36
- 2023(Security) Assertions by Large Language Modelscited by 32
- 2023Uncovering the Limits of Machine Learning for Automatic Vulnerability Detectioncited by 30
- 2024Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tuningcited by 30
- 2019A Manually-Curated Dataset of Fixes to Vulnerabilities of Open-Source Softwarecited by 28
- 2023How Far Have We Gone in Vulnerability Detection Using Large Language Modelscited by 27
- 2024Toward Secure Code Generation: Bridging Correctness and Security via Task-Adaptive Vulnerability Modeling and Execution-Based Benchmarkingcited by 27
- 2024How secure is AI-generated Code: A Large-Scale Comparison of Large Language Modelscited by 24
- 2024LLMs in Web Development: Evaluating LLM-Generated PHP Code Unveiling Vulnerabilities and Limitationscited by 22
- 2024FVEL: Interactive Formal Verification Environment with Large Language Models via Theorem Provingcited by 22
- 2025Agentic AI Software Engineers: Programming with Trustcited by 20
- 2020SmartBugs: A Framework to Analyze Solidity Smart Contractscited by 18
- 2024To Err is Machine: Vulnerability Detection Challenges LLM Reasoningcited by 18
- 2020Magma: A Ground-Truth Fuzzing Benchmarkcited by 16
- 2023SecureFalcon: Are We There Yet in Automated Software Vulnerability Detection with LLMs?cited by 13
- 2024Investigating Large Language Models for Code Vulnerability Detection: An Experimental Studycited by 12
- 2024When Fuzzing Meets LLMs: Challenges and Opportunitiescited by 8
- 2023ESBMC v7.4: Harnessing the Power of Intervalscited by 6
- 2024Assessing the Effectiveness of LLMs in Android Application Vulnerability Analysiscited by 6
- 2024Dynamic Intelligence Assessment: Benchmarking LLMs on the Road to AGI with a Focus on Model Confidencecited by 5
- 2024ESBMC-Python: A Bounded Model Checker for Python Programscited by 4
- 2024Verifying components of Arm(R) Confidential Computing Architecture with ESBMCcited by 1
- 2024CryptoFormalEval: Integrating LLMs and Formal Verification for Automated Cryptographic Protocol Vulnerability Detectioncited by 1
Built on by
Citing papers per year: 2025: 5; 2026: 2.
7 papers.
- 2025Systematization of Knowledge: Security and Safety in the Model Context Protocol Ecosystemcited by 16
- 2025Bridging LLM Planning Agents and Formal Methods: A Case Study in Plan Verificationcited by 7
- 2025Towards Automated Formal Verification of Backend Systems with LLMscited by 1
- 2025From LLMs to Agents: A Comparative Evaluation of LLMs and LLM-based Agents in Security Patch Detectioncited by 1
- 2025The 4/δ Bound: Designing Predictable LLM-Verifier Systems for Formal Method Guaranteecited by 1
- 2026OOM-RL: Out-of-Money Reinforcement Learning Market-Driven Alignment for LLM-Based Multi-Agent Systemscited by 1
- 2026When Passing Tests Hides Vulnerabilities: An Empirical Study of Silent Failures in Agentic Systemscited by 1
- 2026When Passing Tests Hides Vulnerabilities: An Empirical Study of Silent Failures in Agentic Systems25 Jun 2026
- 2026OOM-RL: Out-of-Money Reinforcement Learning Market-Driven Alignment for LLM-Based Multi-Agent Systems13 Apr 2026
- 2025Systematization of Knowledge: Security and Safety in the Model Context Protocol Ecosystem9 Dec 2025
- 2025The 4/δ Bound: Designing Predictable LLM-Verifier Systems for Formal Method Guarantee30 Nov 2025
- 2025From LLMs to Agents: A Comparative Evaluation of LLMs and LLM-based Agents in Security Patch Detection11 Nov 2025
- 2025Bridging LLM Planning Agents and Formal Methods: A Case Study in Plan Verification3 Oct 2025
- 2025Towards Automated Formal Verification of Backend Systems with LLMs13 Apr 2025