Large Language Model for Vulnerability Detection and Repair: Literature Review and the Road Ahead
Not on the map. Why?
Abstract (arXiv)
The significant advancements in Large Language Models (LLMs) have resulted in their widespread adoption across various tasks within Software Engineering (SE), including vulnerability detection and repair. Numerous studies have investigated the application of LLMs to enhance vulnerability detection and repair tasks. Despite the increasing research interest, there is currently no existing survey that focuses on the utilization of LLMs for vulnerability detection and repair. In this paper, we aim to bridge this gap by offering a systematic literature review of approaches aimed at improving vulnerability detection and repair through the utilization of LLMs. The review encompasses research work from leading SE, AI, and Security conferences and journals, encompassing 43 papers published across 25 distinct venues, along with 15 high-quality preprint papers, bringing the total to 58 papers. By answering three key research questions, we aim to (1) summarize the LLMs employed in the relevant literature, (2) categorize various LLM adaptation techniques in vulnerability detection, and (3) classify various LLM adaptation techniques in vulnerability repair. Based on our findings, we have identified a series of limitations of existing studies. Additionally, we have outlined a roadmap highlighting potential opportunities that we believe are pertinent and crucial for future research endeavors.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Apr 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 5; 2025: 19; 2026: 17.
41 papers.
Sort:
By area:
- 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilitiescited by 90
- 2024When LLMs Meet Cybersecurity: A Systematic Literature Reviewcited by 70
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 67
- 2025Frontier AI's Impact on the Cybersecurity Landscapecited by 21
- 2025A Contemporary Survey of Large Language Model Assisted Program Analysiscited by 10
- 2024From Vulnerabilities to Remediation: A Systematic Literature Review of LLMs in Code Securitycited by 9
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
- 2025A Systematic Literature Review on Detecting Software Vulnerabilities with Large Language Modelscited by 8
- 2025Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overviewcited by 7
- 2025Human-AI Experience in Integrated Development Environments: A Systematic Literature Reviewcited by 5
- 2026Reducing False Positives in Static Bug Detection with LLMs: An Empirical Study in Industrycited by 5
- 2025Improving LLM Reasoning for Vulnerability Detection via Group Relative Policy Optimizationcited by 4
29 more
- 2025SecureFixAgent: A Hybrid LLM Agent for Automated Python Static Vulnerability Repaircited by 3
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproductioncited by 3
- 2026DREA: Decoupled Reasoning and Exploration Agents for Repository-Level Vulnerability Detectioncited by 3
- 2024Generative transformations and patterns in LLM-native approaches for software verification and falsificationcited by 2
- 2025POLAR: Automating Cyber Threat Prioritization through LLM-Powered Assessmentcited by 2
- 2025Llama-based source code vulnerability detection: Prompt engineering vs Fine tuningcited by 2
- 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Managementcited by 2
- 2026EvoRepair: Enhancing Vulnerability Repair Agents Through Experience-Based Self-Evolutioncited by 2
- 2025LibVulnWatch: A Deep Assessment Agent System and Leaderboard for Uncovering Hidden Vulnerabilities in Open-Source AI Librariescited by 1
- 2025Repairing vulnerabilities without invisible hands. A differentiated replication study on LLMscited by 1
- 2026Multi-task Code LLMs: Data Mix or Model Merge?cited by 1
- 2026Red-MIRROR: Agentic LLM-based Autonomous Penetration Testing with Reflective Verification and Knowledge-augmented Interactioncited by 1
- 2024Direction for Detection: A Survey of Automated Vulnerability Detection and all of its Pain Pointscited by 0
- 2025To Patch or Not to Patch: Motivations, Challenges, and Implications for Cybersecuritycited by 0
- 2025AVIATOR: Towards AI-Agentic Vulnerability Injection Workflow for High-Fidelity, Large-Scale Code Security Datasetcited by 0
- 2025ArchISMiner: A Framework for Automatic Mining of Architectural Issue-Solution Pairs from Online Developer Communitiescited by 0
- 2025On the Difficulty of Selecting Few-Shot Examples for Effective LLM-based Vulnerability Detectioncited by 0
- 2025From Lab to Reality: A Practical Evaluation of Deep Learning Models and LLMs for Vulnerability Detectioncited by 0
- 2025A Dataset and Preliminary Study of Using GPT-5 for Code-change Impact Analysiscited by 0
- 2026Detecting Data Poisoning in Code Generation LLMs via Black-Box, Vulnerability-Oriented Scanningcited by 0
- 2026Fine-grained Approaches for Confidence Calibration of LLMs in Automated Code Revisioncited by 0
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysiscited by 0
- 2026A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repaircited by 0
- 2026Needles at Scale: LLM-Assisted Target Selection for Windows Vulnerability Researchcited by 0
- 2026SoK: AI Secure Code Generation: Progress, Pitfalls, and Paths Forwardcited by 0
- 2026Words Speak Louder Than Code: Investigating Cognitive Heuristics in LLM-Based Code Vulnerability Detectioncited by 0
- 2026Knowledge-Enhanced Agentic Vulnerability Repaircited by 0
- 2026Mastermind: Strategy-grounded Learning for Repository-Scale Vulnerability Reproductioncited by 0
- 2026Large Language Models at the Intersection of Software Engineering and Software Security:An Evidence-Centered Structured Survey and Research Agendacited by 0
- 2026Large Language Models at the Intersection of Software Engineering and Software Security:An Evidence-Centered Structured Survey and Research Agenda21 Aug 2026
- 2026DREA: Decoupled Reasoning and Exploration Agents for Repository-Level Vulnerability Detection15 Jul 2026
- 2026Mastermind: Strategy-grounded Learning for Repository-Scale Vulnerability Reproduction2 Jul 2026
- 2026Knowledge-Enhanced Agentic Vulnerability Repair1 Jul 2026
- 2026Words Speak Louder Than Code: Investigating Cognitive Heuristics in LLM-Based Code Vulnerability Detection29 Jun 2026
- 2026SoK: AI Secure Code Generation: Progress, Pitfalls, and Paths Forward23 Jun 2026
- 2026Needles at Scale: LLM-Assisted Target Selection for Windows Vulnerability Research31 May 2026
- 2026EvoRepair: Enhancing Vulnerability Repair Agents Through Experience-Based Self-Evolution28 May 2026
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproduction20 May 2026
- 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Management3 May 2026
- 2026A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repair23 Apr 2026
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis12 Apr 2026
29 more
- 2026Fine-grained Approaches for Confidence Calibration of LLMs in Automated Code Revision8 Apr 2026
- 2026Red-MIRROR: Agentic LLM-based Autonomous Penetration Testing with Reflective Verification and Knowledge-augmented Interaction28 Mar 2026
- 2026Detecting Data Poisoning in Code Generation LLMs via Black-Box, Vulnerability-Oriented Scanning17 Mar 2026
- 2026Multi-task Code LLMs: Data Mix or Model Merge?28 Jan 2026
- 2026Reducing False Positives in Static Bug Detection with LLMs: An Empirical Study in Industry26 Jan 2026
- 2025A Dataset and Preliminary Study of Using GPT-5 for Code-change Impact Analysis22 Dec 2025
- 2025From Lab to Reality: A Practical Evaluation of Deep Learning Models and LLMs for Vulnerability Detection11 Dec 2025
- 2025Llama-based source code vulnerability detection: Prompt engineering vs Fine tuning9 Dec 2025
- 2025On the Difficulty of Selecting Few-Shot Examples for Effective LLM-based Vulnerability Detection31 Oct 2025
- 2025ArchISMiner: A Framework for Automatic Mining of Architectural Issue-Solution Pairs from Online Developer Communities24 Oct 2025
- 2025POLAR: Automating Cyber Threat Prioritization through LLM-Powered Assessment2 Oct 2025
- 2025SecureFixAgent: A Hybrid LLM Agent for Automated Python Static Vulnerability Repair18 Sep 2025
- 2025Large Language Models for Security Operations Centers: A Comprehensive Survey13 Sep 2025
- 2025AVIATOR: Towards AI-Agentic Vulnerability Injection Workflow for High-Fidelity, Large-Scale Code Security Dataset28 Aug 2025
- 2025A Systematic Literature Review on Detecting Software Vulnerabilities with Large Language Models30 Jul 2025
- 2025Repairing vulnerabilities without invisible hands. A differentiated replication study on LLMs28 Jul 2025
- 2025Improving LLM Reasoning for Vulnerability Detection via Group Relative Policy Optimization3 Jul 2025
- 2025LibVulnWatch: A Deep Assessment Agent System and Leaderboard for Uncovering Hidden Vulnerabilities in Open-Source AI Libraries13 May 2025
- 2025Frontier AI's Impact on the Cybersecurity Landscape7 Apr 2025
- 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilities21 Mar 2025
- 2025Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overview13 Mar 2025
- 2025Human-AI Experience in Integrated Development Environments: A Systematic Literature Review8 Mar 2025
- 2025To Patch or Not to Patch: Motivations, Challenges, and Implications for Cybersecurity24 Feb 2025
- 2025A Contemporary Survey of Large Language Model Assisted Program Analysis5 Feb 2025
- 2024From Vulnerabilities to Remediation: A Systematic Literature Review of LLMs in Code Security19 Dec 2024
- 2024Direction for Detection: A Survey of Automated Vulnerability Detection and all of its Pain Points15 Dec 2024
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAG17 Jun 2024
- 2024When LLMs Meet Cybersecurity: A Systematic Literature Review6 May 2024
- 2024Generative transformations and patterns in LLM-native approaches for software verification and falsification14 Apr 2024
- 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilitiescited by 90
- 2025SecureFixAgent: A Hybrid LLM Agent for Automated Python Static Vulnerability Repaircited by 3
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproductioncited by 3
- 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Managementcited by 2
- 2026EvoRepair: Enhancing Vulnerability Repair Agents Through Experience-Based Self-Evolutioncited by 2
- 2025LibVulnWatch: A Deep Assessment Agent System and Leaderboard for Uncovering Hidden Vulnerabilities in Open-Source AI Librariescited by 1
- 2026Multi-task Code LLMs: Data Mix or Model Merge?cited by 1
- 2026Red-MIRROR: Agentic LLM-based Autonomous Penetration Testing with Reflective Verification and Knowledge-augmented Interactioncited by 1
- 2025AVIATOR: Towards AI-Agentic Vulnerability Injection Workflow for High-Fidelity, Large-Scale Code Security Datasetcited by 0
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysiscited by 0
- 2026SoK: AI Secure Code Generation: Progress, Pitfalls, and Paths Forwardcited by 0
- 2026Knowledge-Enhanced Agentic Vulnerability Repaircited by 0
- 2026Knowledge-Enhanced Agentic Vulnerability Repair1 Jul 2026
- 2026SoK: AI Secure Code Generation: Progress, Pitfalls, and Paths Forward23 Jun 2026
- 2026EvoRepair: Enhancing Vulnerability Repair Agents Through Experience-Based Self-Evolution28 May 2026
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproduction20 May 2026
- 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Management3 May 2026
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis12 Apr 2026
- 2026Red-MIRROR: Agentic LLM-based Autonomous Penetration Testing with Reflective Verification and Knowledge-augmented Interaction28 Mar 2026
- 2026Multi-task Code LLMs: Data Mix or Model Merge?28 Jan 2026
- 2025SecureFixAgent: A Hybrid LLM Agent for Automated Python Static Vulnerability Repair18 Sep 2025
- 2025AVIATOR: Towards AI-Agentic Vulnerability Injection Workflow for High-Fidelity, Large-Scale Code Security Dataset28 Aug 2025
- 2025LibVulnWatch: A Deep Assessment Agent System and Leaderboard for Uncovering Hidden Vulnerabilities in Open-Source AI Libraries13 May 2025
- 2025CVE-Bench: A Benchmark for AI Agents' Ability to Exploit Real-World Web Application Vulnerabilities21 Mar 2025
- 2024When LLMs Meet Cybersecurity: A Systematic Literature Reviewcited by 70
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 67
- 2025Frontier AI's Impact on the Cybersecurity Landscapecited by 21
- 2025A Contemporary Survey of Large Language Model Assisted Program Analysiscited by 10
- 2024From Vulnerabilities to Remediation: A Systematic Literature Review of LLMs in Code Securitycited by 9
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
- 2025A Systematic Literature Review on Detecting Software Vulnerabilities with Large Language Modelscited by 8
- 2025Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overviewcited by 7
- 2025Human-AI Experience in Integrated Development Environments: A Systematic Literature Reviewcited by 5
- 2026Reducing False Positives in Static Bug Detection with LLMs: An Empirical Study in Industrycited by 5
- 2024Generative transformations and patterns in LLM-native approaches for software verification and falsificationcited by 2
- 2025POLAR: Automating Cyber Threat Prioritization through LLM-Powered Assessmentcited by 2
12 most cited of 26 All 26 (JSON)
- 2026Large Language Models at the Intersection of Software Engineering and Software Security:An Evidence-Centered Structured Survey and Research Agenda21 Aug 2026
- 2026Mastermind: Strategy-grounded Learning for Repository-Scale Vulnerability Reproduction2 Jul 2026
- 2026Words Speak Louder Than Code: Investigating Cognitive Heuristics in LLM-Based Code Vulnerability Detection29 Jun 2026
- 2026Needles at Scale: LLM-Assisted Target Selection for Windows Vulnerability Research31 May 2026
- 2026A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repair23 Apr 2026
- 2026Fine-grained Approaches for Confidence Calibration of LLMs in Automated Code Revision8 Apr 2026
- 2026Reducing False Positives in Static Bug Detection with LLMs: An Empirical Study in Industry26 Jan 2026
- 2025A Dataset and Preliminary Study of Using GPT-5 for Code-change Impact Analysis22 Dec 2025
- 2025From Lab to Reality: A Practical Evaluation of Deep Learning Models and LLMs for Vulnerability Detection11 Dec 2025
- 2025Llama-based source code vulnerability detection: Prompt engineering vs Fine tuning9 Dec 2025
- 2025On the Difficulty of Selecting Few-Shot Examples for Effective LLM-based Vulnerability Detection31 Oct 2025
- 2025ArchISMiner: A Framework for Automatic Mining of Architectural Issue-Solution Pairs from Online Developer Communities24 Oct 2025
12 newest of 26 All 26 (JSON)