The Art, Science, and Engineering of Fuzzing: A Survey
Not on the map. Why?
Abstract (arXiv)
Among the many software vulnerability discovery techniques available today, fuzzing has remained highly popular due to its conceptual simplicity, its low barrier to deployment, and its vast amount of empirical evidence in discovering real-world software vulnerabilities. At a high level, fuzzing refers to a process of repeatedly running a program with generated inputs that may be syntactically or semantically malformed. While researchers and practitioners alike have invested a large and diverse effort towards improving fuzzing in recent years, this surge of work has also made it difficult to gain a comprehensive and coherent view of fuzzing. To help preserve and bring coherence to the vast literature of fuzzing, this paper presents a unified, general-purpose model of fuzzing together with a taxonomy of the current fuzzing literature. We methodically explore the design decisions at every stage of our model fuzzer by surveying the related literature and innovations in the art, science, and engineering that make modern-day fuzzers effective.
Key facts. Cited by 62 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 6; 2023: 4; 2024: 7; 2025: 15; 2026: 25.
62 papers.
Sort:
By area:
- 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 155
- 2023FuzzLLM: A Novel and Universal Fuzzing Framework for Proactively Discovering Jailbreak Vulnerabilities in Large Language Modelscited by 51
- 2022NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilerscited by 30
- 2026ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?cited by 29
- 2025AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunitiescited by 28
- 2024Security Vulnerability Detection with Multitask Self-Instructed Fine-Tuning of Large Language Modelscited by 14
- 2025Rethinking Verification for LLM Code Generation: From Generation to Testingcited by 14
- 2022Search-Based Testing of Reinforcement Learningcited by 13
- 2024VulDetectBench: Evaluating the Deep Capability of Vulnerability Detection with Large Language Modelscited by 11
- 2022Coverage-Guided Tensor Compiler Fuzzing with Joint IR-Pass Mutationcited by 10
- 2024Multi-Programming Language Sandbox for LLMscited by 10
- 2024VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patchingcited by 9
38 more
- 2021Detecting Multi-Sensor Fusion Errors in Advanced Driver-Assistance Systemscited by 8
- 2024LProtector: An LLM-driven Vulnerability Detection Systemcited by 8
- 2023Exploring the Limits of ChatGPT in Software Security Applicationscited by 6
- 2025Can You Really Trust Code Copilots? Evaluating Large Language Models from a Code Security Perspectivecited by 6
- 2021On managing vulnerabilities in AI/ML systemscited by 5
- 2023BertRLFuzzer: A BERT and Reinforcement Learning Based Fuzzercited by 5
- 2021Towards Making Deep Learning-based Vulnerability Detectors Robustcited by 4
- 2024On the Challenges of Fuzzing Techniques via Large Language Modelscited by 4
- 2021State Selection Algorithms and Their Impact on The Performance of Stateful Network Protocol Fuzzingcited by 3
- 2025LibLMFuzz: LLM-Augmented Fuzz Target Generation for Black-box Librariescited by 3
- 2026Large Language Models Hack Rewards, and Societycited by 3
- 2021Literature review on vulnerability detection using NLP technologycited by 2
- 2022Testing Deep Learning Models: A First Comparative Study of Multiple Testing Techniquescited by 2
- 2024FuzzCoder: Byte-level Fuzzing Test via Large Language Modelcited by 2
- 2025FalseCrashReducer: Mitigating False Positive Crashes in OSS-Fuzz-Gen Using Agentic AIcited by 2
- 2026VulnResolver: A Hybrid Agent Framework for LLM-Based Automated Vulnerability Issue Resolutioncited by 2
- 2026Evaluating LLM-Based Test Generation Under Software Evolutioncited by 2
- 2026SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplacescited by 2
- 2025Harden and Catch for Just-in-Time Assured LLM-Based Software Testing: Open Research Challengescited by 1
- 2025SeedAIchemy: LLM-Driven Seed Corpus Generation for Fuzzingcited by 1
- 2026Just-in-Time Catching Test Generation at Metacited by 1
- 2026NAAMSE: Framework for Evolutionary Security Evaluation of Agentscited by 1
- 2026KQFuzz: Knowledge-Guided Fuzzing for Quantum Libraries via Large Language Modelscited by 1
- 2026The Greatness of Science Cannot Be Planned: Agentic Auto-Research is Fuzz Testingcited by 1
- 2022Learning Failure-Inducing Models for Testing Software-Defined Networkscited by 0
- 2022Quality-diversity in dissimilarity spacescited by 0
- 2025Towards Reliable LLM-Driven Fuzz Testing: Vision and Road Aheadcited by 0
- 2025Verification-Guided Falsification for Safe RL via Explainable Abstraction and Risk-Aware Explorationcited by 0
- 2025LLMs and Fuzzing in Tandem: A New Approach to Automatically Generating Weakest Preconditionscited by 0
- 2025MultiFuzz: A Dense Retrieval-based Multi-Agent System for Network Protocol Fuzzingcited by 0
- 2025LLMs are All You Need? Improving Fuzz Testing for MOJO with Large Language Modelscited by 0
- 2025Learning to Triage Vulnerability Reports from Program Analysis: An Empirical Study in Node.jscited by 0
- 2025On the Difficulty of Selecting Few-Shot Examples for Effective LLM-based Vulnerability Detectioncited by 0
- 2025From Coverage to Causes: Data-Centric Fuzzing for JavaScript Enginescited by 0
- 2026Testing Storage-System Correctness: Challenges, Fuzzing Limitations, and AI-Augmented Opportunitiescited by 0
- 2026AutoEG: Exploiting Known Third-Party Vulnerabilities in Black-Box Web Applicationscited by 0
- 2026Fuzzing with Agents? Generators Are All You Needcited by 0
- 2026A Multi-Agent Framework for Automated Exploit Generation with Constraint-Guided Comprehension and Reflectioncited by 0
50 most cited of 62 All 62 (JSON)
- 2026Cheap to Hypothesize, Costly to Verify: The Defense Surface of Agentic Vulnerability Discovery28 Sep 2026
- 2026Ajar: Measuring Open Privilege in Agent Defenses22 Sep 2026
- 2026Reality Is the Final Verifier: On Two Key Gaps in Agentic Software Engineering10 Sep 2026
- 2026NeuronFuzz: Safety Neuron Guided Fuzzing for LLM Safety Evaluation26 Aug 2026
- 2026AI Slop and Hallucinations in Vulnerability Assessment: A Survey on Reasoning Failures and Trustworthy Mitigation26 Aug 2026
- 2026LLM-Assisted Dynamic Threat Analysis for Attacker-Reachable Software Weaknesses in Autonomous Vehicles13 Aug 2026
- 2026The Greatness of Science Cannot Be Planned: Agentic Auto-Research is Fuzz Testing10 Aug 2026
- 2026Agentic Method for Deterministic Validation of Legacy Code Migration30 Jul 2026
- 2026KQFuzz: Knowledge-Guided Fuzzing for Quantum Libraries via Large Language Models28 Jul 2026
- 2026SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplaces2 Jul 2026
- 2026Evaluation-as-Search: Adaptive Discovery of Grounding Failures in Meeting Assistants30 Jun 2026
- 2026Library-Aware Doubles and Iterative Repair for Large Language Model-Generated Unit Tests in OpenSIL Firmware18 Jun 2026
38 more
- 2026Large Language Models Hack Rewards, and Society2 Jun 2026
- 2026ContraFix: Skill-Enhanced Contrastive Runtime Analysis for Vulnerability Repair17 May 2026
- 2026FuzzAgent: Multi-Agent System for Evolutionary Library Fuzzing14 May 2026
- 2026Adversarial SQL Injection Generation with LLM-Based Architectures11 May 2026
- 2026ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?11 May 2026
- 2026A Multi-Agent Framework for Automated Exploit Generation with Constraint-Guided Comprehension and Reflection6 Apr 2026
- 2026Fuzzing with Agents? Generators Are All You Need1 Apr 2026
- 2026AutoEG: Exploiting Known Third-Party Vulnerabilities in Black-Box Web Applications1 Apr 2026
- 2026Evaluating LLM-Based Test Generation Under Software Evolution24 Mar 2026
- 2026NAAMSE: Framework for Evolutionary Security Evaluation of Agents7 Feb 2026
- 2026Testing Storage-System Correctness: Challenges, Fuzzing Limitations, and AI-Augmented Opportunities2 Feb 2026
- 2026Just-in-Time Catching Test Generation at Meta30 Jan 2026
- 2026VulnResolver: A Hybrid Agent Framework for LLM-Based Automated Vulnerability Issue Resolution20 Jan 2026
- 2025From Coverage to Causes: Data-Centric Fuzzing for JavaScript Engines19 Dec 2025
- 2025SeedAIchemy: LLM-Driven Seed Corpus Generation for Fuzzing16 Nov 2025
- 2025On the Difficulty of Selecting Few-Shot Examples for Effective LLM-based Vulnerability Detection31 Oct 2025
- 2025Learning to Triage Vulnerability Reports from Program Analysis: An Empirical Study in Node.js23 Oct 2025
- 2025LLMs are All You Need? Improving Fuzz Testing for MOJO with Large Language Models11 Oct 2025
- 2025FalseCrashReducer: Mitigating False Positive Crashes in OSS-Fuzz-Gen Using Agentic AI2 Oct 2025
- 2025MultiFuzz: A Dense Retrieval-based Multi-Agent System for Network Protocol Fuzzing19 Aug 2025
- 2025AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunities15 Aug 2025
- 2025LibLMFuzz: LLM-Augmented Fuzz Target Generation for Black-box Libraries20 Jul 2025
- 2025Rethinking Verification for LLM Code Generation: From Generation to Testing9 Jul 2025
- 2025LLMs and Fuzzing in Tandem: A New Approach to Automatically Generating Weakest Preconditions3 Jul 2025
- 2025Verification-Guided Falsification for Safe RL via Explainable Abstraction and Risk-Aware Exploration4 Jun 2025
- 2025Can You Really Trust Code Copilots? Evaluating Large Language Models from a Code Security Perspective15 May 2025
- 2025Harden and Catch for Just-in-Time Assured LLM-Based Software Testing: Open Research Challenges23 Apr 2025
- 2025Towards Reliable LLM-Driven Fuzz Testing: Vision and Road Ahead2 Mar 2025
- 2024LProtector: An LLM-driven Vulnerability Detection System10 Nov 2024
- 2024Multi-Programming Language Sandbox for LLMs30 Oct 2024
- 2024VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patching16 Sep 2024
- 2024FuzzCoder: Byte-level Fuzzing Test via Large Language Model3 Sep 2024
- 2024VulDetectBench: Evaluating the Deep Capability of Vulnerability Detection with Large Language Models11 Jun 2024
- 2024Security Vulnerability Detection with Multitask Self-Instructed Fine-Tuning of Large Language Models9 Jun 2024
- 2024On the Challenges of Fuzzing Techniques via Large Language Models1 Feb 2024
- 2023Exploring the Limits of ChatGPT in Software Security Applications8 Dec 2023
- 2023FuzzLLM: A Novel and Universal Fuzzing Framework for Proactively Discovering Jailbreak Vulnerabilities in Large Language Models11 Sep 2023
- 2023BertRLFuzzer: A BERT and Reinforcement Learning Based Fuzzer21 May 2023
50 newest of 62 All 62 (JSON)
- 2026ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?cited by 29
- 2025AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunitiescited by 28
- 2025FalseCrashReducer: Mitigating False Positive Crashes in OSS-Fuzz-Gen Using Agentic AIcited by 2
- 2026VulnResolver: A Hybrid Agent Framework for LLM-Based Automated Vulnerability Issue Resolutioncited by 2
- 2026NAAMSE: Framework for Evolutionary Security Evaluation of Agentscited by 1
- 2026The Greatness of Science Cannot Be Planned: Agentic Auto-Research is Fuzz Testingcited by 1
- 2025MultiFuzz: A Dense Retrieval-based Multi-Agent System for Network Protocol Fuzzingcited by 0
- 2026Fuzzing with Agents? Generators Are All You Needcited by 0
- 2026A Multi-Agent Framework for Automated Exploit Generation with Constraint-Guided Comprehension and Reflectioncited by 0
- 2026FuzzAgent: Multi-Agent System for Evolutionary Library Fuzzingcited by 0
- 2026Agentic Method for Deterministic Validation of Legacy Code Migrationcited by 0
- 2026Reality Is the Final Verifier: On Two Key Gaps in Agentic Software Engineeringcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Cheap to Hypothesize, Costly to Verify: The Defense Surface of Agentic Vulnerability Discovery28 Sep 2026
- 2026Ajar: Measuring Open Privilege in Agent Defenses22 Sep 2026
- 2026Reality Is the Final Verifier: On Two Key Gaps in Agentic Software Engineering10 Sep 2026
- 2026The Greatness of Science Cannot Be Planned: Agentic Auto-Research is Fuzz Testing10 Aug 2026
- 2026Agentic Method for Deterministic Validation of Legacy Code Migration30 Jul 2026
- 2026FuzzAgent: Multi-Agent System for Evolutionary Library Fuzzing14 May 2026
- 2026ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?11 May 2026
- 2026A Multi-Agent Framework for Automated Exploit Generation with Constraint-Guided Comprehension and Reflection6 Apr 2026
- 2026Fuzzing with Agents? Generators Are All You Need1 Apr 2026
- 2026NAAMSE: Framework for Evolutionary Security Evaluation of Agents7 Feb 2026
- 2026VulnResolver: A Hybrid Agent Framework for LLM-Based Automated Vulnerability Issue Resolution20 Jan 2026
- 2025FalseCrashReducer: Mitigating False Positive Crashes in OSS-Fuzz-Gen Using Agentic AI2 Oct 2025
12 newest of 14 All 14 (JSON)
- 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 155
- 2022NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilerscited by 30
- 2022Search-Based Testing of Reinforcement Learningcited by 13
- 2024VulDetectBench: Evaluating the Deep Capability of Vulnerability Detection with Large Language Modelscited by 11
- 2022Coverage-Guided Tensor Compiler Fuzzing with Joint IR-Pass Mutationcited by 10
- 2024Multi-Programming Language Sandbox for LLMscited by 10
- 2024VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patchingcited by 9
- 2021Detecting Multi-Sensor Fusion Errors in Advanced Driver-Assistance Systemscited by 8
- 2024LProtector: An LLM-driven Vulnerability Detection Systemcited by 8
- 2023Exploring the Limits of ChatGPT in Software Security Applicationscited by 6
- 2025Can You Really Trust Code Copilots? Evaluating Large Language Models from a Code Security Perspectivecited by 6
- 2021On managing vulnerabilities in AI/ML systemscited by 5
12 most cited of 42 All 42 (JSON)
- 2026LLM-Assisted Dynamic Threat Analysis for Attacker-Reachable Software Weaknesses in Autonomous Vehicles13 Aug 2026
- 2026KQFuzz: Knowledge-Guided Fuzzing for Quantum Libraries via Large Language Models28 Jul 2026
- 2026SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplaces2 Jul 2026
- 2026Evaluation-as-Search: Adaptive Discovery of Grounding Failures in Meeting Assistants30 Jun 2026
- 2026Library-Aware Doubles and Iterative Repair for Large Language Model-Generated Unit Tests in OpenSIL Firmware18 Jun 2026
- 2026Large Language Models Hack Rewards, and Society2 Jun 2026
- 2026ContraFix: Skill-Enhanced Contrastive Runtime Analysis for Vulnerability Repair17 May 2026
- 2026Adversarial SQL Injection Generation with LLM-Based Architectures11 May 2026
- 2026AutoEG: Exploiting Known Third-Party Vulnerabilities in Black-Box Web Applications1 Apr 2026
- 2026Evaluating LLM-Based Test Generation Under Software Evolution24 Mar 2026
- 2026Testing Storage-System Correctness: Challenges, Fuzzing Limitations, and AI-Augmented Opportunities2 Feb 2026
- 2026Just-in-Time Catching Test Generation at Meta30 Jan 2026
12 newest of 42 All 42 (JSON)