Large Language Models for Cyber Security: A Systematic Literature Review
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of Large Language Models (LLMs) has opened up new opportunities for leveraging artificial intelligence in a variety of application domains, including cybersecurity. As the volume and sophistication of cyber threats continue to grow, there is an increasing need for intelligent systems that can automatically detect vulnerabilities, analyze malware, and respond to attacks. In this survey, we conduct a comprehensive review of the literature on the application of LLMs in cybersecurity~(LLM4Security). By comprehensively collecting over 40K relevant papers and systematically analyzing 185 papers from top security and software engineering venues, we aim to provide a holistic view of how LLMs are being used to solve diverse problems across the cybersecurity domain. Through our analysis, we identify several key findings. First, we observe that LLMs are being applied to an expanding range of cybersecurity tasks, including vulnerability detection, malware analysis, and network intrusion detection. Second, we analyze application trends of different LLM architectures (such as encoder-only, encoder-decoder, and decoder-only) across security domains. Third, we identify increasingly sophisticated techniques for adapting LLMs to cybersecurity, such as advanced fine-tuning, prompt engineering, and external augmentation strategies. A significant emerging trend is the use of LLM-based autonomous agents, which represent a paradigm shift from single-task execution to orchestrating complex, multi-step security workflows.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). Builds on 157 of its 235 references that are in the map. First posted on arXiv 8 May 2024.
Builds on
157 of 235 references.
References · 157
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
38 more
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
- 2019How Can We Know What Language Models Know?cited by 953
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 876
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
- 2022A Survey on In-context Learningcited by 717
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2021Deduplicating Training Data Makes Language Models Bettercited by 705
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
- 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
- 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
- 2019How to Fine-Tune BERT for Text Classification?cited by 409
- 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 409
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
- 2020Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stoppingcited by 377
- 2021Unified Pre-training for Program Understanding and Generationcited by 361
- 2023Data-centric Artificial Intelligence: A Surveycited by 202
50 most cited of 157 All 157 (JSON)
Built on by
Citing papers per year: 2024: 9; 2025: 22; 2026: 34.
65 papers.
Sort:
By area:
- 2025Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Reportcited by 28
- 2025Llama-3.1-FoundationAI-SecurityLLM-8B-Instruct Technical Reportcited by 21
- 2025Multi-Agent Penetration Testing AI for the Webcited by 19
- 2025Benchmarking Practices in LLM-driven Offensive Security: Testbeds, Metrics, and Experiment Designcited by 13
- 2024Towards Explainable Network Intrusion Detection using Large Language Modelscited by 12
- 2025Semantic Attacks on Tool-Augmented LLMs: Securing the Model Context Protocol Against Descriptor-Level Manipulationcited by 12
- 2024Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directionscited by 10
- 2025A Contemporary Survey of Large Language Model Assisted Program Analysiscited by 10
- 2025A Systematic Literature Review on Detecting Software Vulnerabilities with Large Language Modelscited by 8
- 2024The Use of Large Language Models (LLM) for Cyber Threat Intelligence (CTI) in Cybercrime Forumscited by 6
- 2024DomURLs_BERT: Pre-trained BERT-based Model for Malicious Domains and URLs Detection and Classificationcited by 5
- 2025Hiding in the AI Traffic: Abusing MCP for LLM-Powered Agentic Red Teamingcited by 4
38 more
- 2026Retrieval-Augmented LLMs for Security Incident Analysiscited by 4
- 2024HULLMI: Human vs LLM identification with explainabilitycited by 3
- 2025AutoBnB-RAG: Enhancing Multi-Agent Incident Response with Retrieval-Augmented Generationcited by 3
- 2025Cloud Investigation Automation Framework (CIAF): An AI-Driven Approach to Cloud Forensicscited by 3
- 2025Toward Cybersecurity-Expert Small Language Modelscited by 3
- 2026CTFusion: A CTF-based Benchmark for LLM Agent Evaluationcited by 3
- 2026RepoMirage: Probing Repository Context Reasoning in Code Agents with Perturbationscited by 3
- 2024Blockchain Meets LLMs: A Living Survey on Bidirectional Integrationcited by 2
- 2025Adapting Large Language Models to Emerging Cybersecurity using Retrieval Augmented Generationcited by 2
- 2025The Evolution of Agentic AI in Cybersecurity: From Single LLM Reasoners to Multi-Agent Systems and Autonomous Pipelinescited by 2
- 2026A Decompilation-Driven Framework for Malware Detection with Large Language Modelscited by 2
- 2026Minerva: Reinforcement Learning with Verifiable Rewards for Cyber Threat Intelligence LLMscited by 2
- 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Managementcited by 2
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Modelscited by 1
- 2024Decoding BACnet Packets: A Large Language Model Approach for Packet Interpretationcited by 1
- 2025Can LLMs Assist Computer Education? an Empirical Case Study of DeepSeekcited by 1
- 2025Interpretable Anomaly-Based DDoS Detection in AI-RAN with XAI and LLMscited by 1
- 2025Unified Threat Detection and Mitigation Framework (UTDMF): Combating Prompt Injection, Deception, and Bias in Enterprise-Scale Transformerscited by 1
- 2025A Novel GPT-Based Framework for Anomaly Detection in System Logscited by 1
- 2025CryptoQA: A Large-scale Question-answering Dataset for AI-assisted Cryptographycited by 1
- 2026Tri-LLM Cooperative Federated Zero-Shot Intrusion Detection with Semantic Disagreement and Trust-Aware Aggregationcited by 1
- 2026To Defend Against Cyber Attacks, We Must Teach AI Agents to Hackcited by 1
- 2026Buy versus Build an LLM: A Decision Framework for Governmentscited by 1
- 2026LanG -- A Governance-Aware Agentic AI Platform for Unified Security Operationscited by 1
- 2026ORBIT: Guided Agentic Orchestration for Autonomous C-to-Rust Transpilationcited by 1
- 2026AI Native Asset Intelligencecited by 1
- 2026Small, Free, and Effective: Orchestrating Open-Weight Small Language Models to Outperform Single LLM for Malware Analysiscited by 1
- 2026Post-Hoc Trajectory-Risk Certification for Modular LLM-Based Security Agentscited by 1
- 2024Considerations Influencing Offense-Defense Dynamics From Artificial Intelligencecited by 0
- 2025On Automating Security Policies with Contemporary LLMscited by 0
- 2025Large Language Models in Cybersecurity: Applications, Vulnerabilities, and Defense Techniquescited by 0
- 2025Sentra-Guard: A Real-Time Multilingual Defense Against Adversarial LLM Promptscited by 0
- 2025The Road of Adaptive AI for Precision in Cybersecuritycited by 0
- 2026RiskBridge: Turning CVEs into Business-Aligned Patch Prioritiescited by 0
- 2026From Incomplete Architecture to Quantified Risk: Multimodal LLM-Driven Security Assessment for Cyber-Physical Systemscited by 0
- 2026Attribution-Driven Explainable Intrusion Detection with Encoder-Based Large Language Modelscited by 0
- 2026Is Vibe Coding the Future? An Empirical Assessment of LLM Generated Codes for Construction Safetycited by 0
- 2026A Quasi-Experimental Developer Study of Security Training in LLM-Assisted Web Application Developmentcited by 0
50 most cited of 65 All 65 (JSON)
- 2026Reasoning Topology Matters: A Controlled Study of LLM-Based Cybersecurity Analysis21 Sep 2026
- 2026BlueSTAR: Tiered Agentic Architecture for Autonomous Cyber Defense10 Sep 2026
- 2026Cost-Aware Hierarchical Multi-Agent Ransomware Detection and Family Attribution4 Sep 2026
- 2026Large Language Models at the Intersection of Software Engineering and Software Security:An Evidence-Centered Structured Survey and Research Agenda21 Aug 2026
- 2026LLMs for Zero-Shot Threat Detection via Structured Risk Indicators17 Aug 2026
- 2026SysEvolve: An AI-native, safe, autonomous adversarial attack-defense co-evolutionary system15 Aug 2026
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models11 Aug 2026
- 2026Post-Hoc Trajectory-Risk Certification for Modular LLM-Based Security Agents4 Aug 2026
- 2026From Chasing Ghosts to Missed Attacks: Perspectives and Perceptions of SOC Practitioners on LLM Integration, Risks, and Readiness1 Aug 2026
- 2026Beyond Heavy Log Curation: Perplexity-Based APT Detection via Unsupervised, Context-Augmented Language Models23 Jul 2026
- 2026Small, Free, and Effective: Orchestrating Open-Weight Small Language Models to Outperform Single LLM for Malware Analysis22 Jul 2026
- 2026Words Speak Louder Than Code: Investigating Cognitive Heuristics in LLM-Based Code Vulnerability Detection29 Jun 2026
38 more
- 2026Can Open-Source LLM Agents Replace Static Application Security Testing Tools? An Empirical Assessment10 Jun 2026
- 2026RepoMirage: Probing Repository Context Reasoning in Code Agents with Perturbations25 May 2026
- 2026A Multi-Layer Cloud-IDS Pipeline with LLM and Adaptive Q-Learning Calibration15 May 2026
- 2026CTFusion: A CTF-based Benchmark for LLM Agent Evaluation12 May 2026
- 2026Threat Modelling using Domain-Adapted Language Models: Empirical Evaluation and Insights11 May 2026
- 2026When Prompts Become Payloads: A Framework for Mitigating SQL Injection Attacks in Large Language Model-Driven Applications11 May 2026
- 2026AI Native Asset Intelligence9 May 2026
- 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Management3 May 2026
- 2026XekRung Technical Report30 Apr 2026
- 2026A Quasi-Experimental Developer Study of Security Training in LLM-Assisted Web Application Development20 Apr 2026
- 2026Is Vibe Coding the Future? An Empirical Assessment of LLM Generated Codes for Construction Safety14 Apr 2026
- 2026ORBIT: Guided Agentic Orchestration for Autonomous C-to-Rust Transpilation13 Apr 2026
- 2026Attribution-Driven Explainable Intrusion Detection with Encoder-Based Large Language Models7 Apr 2026
- 2026From Incomplete Architecture to Quantified Risk: Multimodal LLM-Driven Security Assessment for Cyber-Physical Systems7 Apr 2026
- 2026LanG -- A Governance-Aware Agentic AI Platform for Unified Security Operations7 Apr 2026
- 2026Retrieval-Augmented LLMs for Security Incident Analysis18 Mar 2026
- 2026Buy versus Build an LLM: A Decision Framework for Governments13 Feb 2026
- 2026To Defend Against Cyber Attacks, We Must Teach AI Agents to Hack1 Feb 2026
- 2026Minerva: Reinforcement Learning with Verifiable Rewards for Cyber Threat Intelligence LLMs31 Jan 2026
- 2026Tri-LLM Cooperative Federated Zero-Shot Intrusion Detection with Semantic Disagreement and Trust-Aware Aggregation30 Jan 2026
- 2026A Decompilation-Driven Framework for Malware Detection with Large Language Models14 Jan 2026
- 2026RiskBridge: Turning CVEs into Business-Aligned Patch Priorities8 Jan 2026
- 2025The Evolution of Agentic AI in Cybersecurity: From Single LLM Reasoners to Multi-Agent Systems and Autonomous Pipelines7 Dec 2025
- 2025Semantic Attacks on Tool-Augmented LLMs: Securing the Model Context Protocol Against Descriptor-Level Manipulation6 Dec 2025
- 2025The Road of Adaptive AI for Precision in Cybersecurity5 Dec 2025
- 2025CryptoQA: A Large-scale Question-answering Dataset for AI-assisted Cryptography2 Dec 2025
- 2025Hiding in the AI Traffic: Abusing MCP for LLM-Powered Agentic Red Teaming20 Nov 2025
- 2025Adapting Large Language Models to Emerging Cybersecurity using Retrieval Augmented Generation31 Oct 2025
- 2025Sentra-Guard: A Real-Time Multilingual Defense Against Adversarial LLM Prompts26 Oct 2025
- 2025A Novel GPT-Based Framework for Anomaly Detection in System Logs16 Oct 2025
- 2025Toward Cybersecurity-Expert Small Language Models15 Oct 2025
- 2025Unified Threat Detection and Mitigation Framework (UTDMF): Combating Prompt Injection, Deception, and Bias in Enterprise-Scale Transformers6 Oct 2025
- 2025Cloud Investigation Automation Framework (CIAF): An AI-Driven Approach to Cloud Forensics1 Oct 2025
- 2025Multi-Agent Penetration Testing AI for the Web28 Aug 2025
- 2025AutoBnB-RAG: Enhancing Multi-Agent Incident Response with Retrieval-Augmented Generation18 Aug 2025
- 2025Llama-3.1-FoundationAI-SecurityLLM-8B-Instruct Technical Report1 Aug 2025
- 2025A Systematic Literature Review on Detecting Software Vulnerabilities with Large Language Models30 Jul 2025
- 2025Interpretable Anomaly-Based DDoS Detection in AI-RAN with XAI and LLMs27 Jul 2025
50 newest of 65 All 65 (JSON)
- 2025Multi-Agent Penetration Testing AI for the Webcited by 19
- 2025Semantic Attacks on Tool-Augmented LLMs: Securing the Model Context Protocol Against Descriptor-Level Manipulationcited by 12
- 2025Hiding in the AI Traffic: Abusing MCP for LLM-Powered Agentic Red Teamingcited by 4
- 2026CTFusion: A CTF-based Benchmark for LLM Agent Evaluationcited by 3
- 2025The Evolution of Agentic AI in Cybersecurity: From Single LLM Reasoners to Multi-Agent Systems and Autonomous Pipelinescited by 2
- 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Managementcited by 2
- 2026LanG -- A Governance-Aware Agentic AI Platform for Unified Security Operationscited by 1
- 2026ORBIT: Guided Agentic Orchestration for Autonomous C-to-Rust Transpilationcited by 1
- 2026Post-Hoc Trajectory-Risk Certification for Modular LLM-Based Security Agentscited by 1
- 2026Can Open-Source LLM Agents Replace Static Application Security Testing Tools? An Empirical Assessmentcited by 0
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Modelscited by 0
- 2026Cost-Aware Hierarchical Multi-Agent Ransomware Detection and Family Attributioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026BlueSTAR: Tiered Agentic Architecture for Autonomous Cyber Defense10 Sep 2026
- 2026Cost-Aware Hierarchical Multi-Agent Ransomware Detection and Family Attribution4 Sep 2026
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models11 Aug 2026
- 2026Post-Hoc Trajectory-Risk Certification for Modular LLM-Based Security Agents4 Aug 2026
- 2026Can Open-Source LLM Agents Replace Static Application Security Testing Tools? An Empirical Assessment10 Jun 2026
- 2026CTFusion: A CTF-based Benchmark for LLM Agent Evaluation12 May 2026
- 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Management3 May 2026
- 2026ORBIT: Guided Agentic Orchestration for Autonomous C-to-Rust Transpilation13 Apr 2026
- 2026LanG -- A Governance-Aware Agentic AI Platform for Unified Security Operations7 Apr 2026
- 2025The Evolution of Agentic AI in Cybersecurity: From Single LLM Reasoners to Multi-Agent Systems and Autonomous Pipelines7 Dec 2025
- 2025Semantic Attacks on Tool-Augmented LLMs: Securing the Model Context Protocol Against Descriptor-Level Manipulation6 Dec 2025
- 2025Hiding in the AI Traffic: Abusing MCP for LLM-Powered Agentic Red Teaming20 Nov 2025
12 newest of 13 All 13 (JSON)
- 2025Unified Threat Detection and Mitigation Framework (UTDMF): Combating Prompt Injection, Deception, and Bias in Enterprise-Scale Transformerscited by 1
- 2026To Defend Against Cyber Attacks, We Must Teach AI Agents to Hackcited by 1
- 2025Sentra-Guard: A Real-Time Multilingual Defense Against Adversarial LLM Promptscited by 0
- 2026When Prompts Become Payloads: A Framework for Mitigating SQL Injection Attacks in Large Language Model-Driven Applicationscited by 0
- 2026When Prompts Become Payloads: A Framework for Mitigating SQL Injection Attacks in Large Language Model-Driven Applications11 May 2026
- 2026To Defend Against Cyber Attacks, We Must Teach AI Agents to Hack1 Feb 2026
- 2025Sentra-Guard: A Real-Time Multilingual Defense Against Adversarial LLM Prompts26 Oct 2025
- 2025Unified Threat Detection and Mitigation Framework (UTDMF): Combating Prompt Injection, Deception, and Bias in Enterprise-Scale Transformers6 Oct 2025
- 2025Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Reportcited by 28
- 2025Llama-3.1-FoundationAI-SecurityLLM-8B-Instruct Technical Reportcited by 21
- 2025Benchmarking Practices in LLM-driven Offensive Security: Testbeds, Metrics, and Experiment Designcited by 13
- 2024Towards Explainable Network Intrusion Detection using Large Language Modelscited by 12
- 2024Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directionscited by 10
- 2025A Contemporary Survey of Large Language Model Assisted Program Analysiscited by 10
- 2025A Systematic Literature Review on Detecting Software Vulnerabilities with Large Language Modelscited by 8
- 2024The Use of Large Language Models (LLM) for Cyber Threat Intelligence (CTI) in Cybercrime Forumscited by 6
- 2024DomURLs_BERT: Pre-trained BERT-based Model for Malicious Domains and URLs Detection and Classificationcited by 5
- 2024HULLMI: Human vs LLM identification with explainabilitycited by 3
- 2025Cloud Investigation Automation Framework (CIAF): An AI-Driven Approach to Cloud Forensicscited by 3
- 2025Toward Cybersecurity-Expert Small Language Modelscited by 3
12 most cited of 44 All 44 (JSON)
- 2026Large Language Models at the Intersection of Software Engineering and Software Security:An Evidence-Centered Structured Survey and Research Agenda21 Aug 2026
- 2026LLMs for Zero-Shot Threat Detection via Structured Risk Indicators17 Aug 2026
- 2026SysEvolve: An AI-native, safe, autonomous adversarial attack-defense co-evolutionary system15 Aug 2026
- 2026From Chasing Ghosts to Missed Attacks: Perspectives and Perceptions of SOC Practitioners on LLM Integration, Risks, and Readiness1 Aug 2026
- 2026Beyond Heavy Log Curation: Perplexity-Based APT Detection via Unsupervised, Context-Augmented Language Models23 Jul 2026
- 2026Small, Free, and Effective: Orchestrating Open-Weight Small Language Models to Outperform Single LLM for Malware Analysis22 Jul 2026
- 2026Words Speak Louder Than Code: Investigating Cognitive Heuristics in LLM-Based Code Vulnerability Detection29 Jun 2026
- 2026RepoMirage: Probing Repository Context Reasoning in Code Agents with Perturbations25 May 2026
- 2026A Multi-Layer Cloud-IDS Pipeline with LLM and Adaptive Q-Learning Calibration15 May 2026
- 2026Threat Modelling using Domain-Adapted Language Models: Empirical Evaluation and Insights11 May 2026
- 2026AI Native Asset Intelligence9 May 2026
- 2026XekRung Technical Report30 Apr 2026
12 newest of 44 All 44 (JSON)