Fuzzing with Agents? Generators Are All You Need
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Modern generator-based fuzzing techniques combine lightweight input generators with coverage-guided mutation as a method of exploring deep execution paths in a target program. A complimentary approach in prior research focuses on creating highly customized, domain-specific generators that encode structural and semantic logic sufficient enough to reach deep program states; the challenge comes from the overhead of writing and testing these complex generators. We investigate whether AI coding agents can automatically synthesize such target-specific generators, and whether the resulting generators are strong enough to obviate the need for coverage guidance and mutation entirely. Our approach, Gentoo, is comprised of an LLM coding agent (provided terminal access and source code of the fuzz target and its library) instructed to iteratively synthesize and refine an input generator, and optionally provided fine-grained predicate-level coverage feedback. We evaluate three configurations of Gentoo against human-written generators on fuzz targets for 7 real-world Java libraries. Our findings show that agent-synthesized generators achieve statistically significantly higher branch coverage than human-written baseline generators on 4 of 7 benchmarks. Critically, the use of coverage guidance and mutation strategies is not statistically significantly beneficial for agent-synthesized generators, but is significant for all human-written generators, suggesting that structural and semantic logic encoded in the agent generators makes coverage guidance largely unnecessary.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 24 of its 62 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
24 of 62 references.
Closest ancestors · 4
Same direction, newest first
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?17 Nov
- 2025Agentic Property-Based Testing: Finding Bugs Across the Python Ecosystem10 Oct
- 2025A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic System10 Oct
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
Other references · 20
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2023An Empirical Evaluation of Using Large Language Models for Automated Unit Test Generationcited by 193
- 2024Automated Unit Test Improvement using Large Language Models at Metacited by 73
- 2018The Art, Science, and Engineering of Fuzzing: A Surveycited by 61
- 2022Interactive Code Generation via Test-Driven User-Intent Formalizationcited by 50
- 2022Code Generation Tools (Almost) for Free? A Study of Few-Shot, Pre-Trained Language Models on Codecited by 39
- 2023WhiteFox: White-Box Compiler Fuzzing Empowered by Large Language Modelscited by 37
- 2023Can Large Language Models Write Good Property-Based Tests?cited by 30
- 2018Evaluating Fuzz Testingcited by 29
- 2023CAT-LM: Training Language Models on Aligned Code And Testscited by 28
- 2023Prompt Fuzzing for Fuzz Driver Generationcited by 27
- 2017FairFuzz: Targeting Rare Branches to Rapidly Increase Greybox Fuzz Testing Coveragecited by 20
8 more
- 2018Angora: Efficient Fuzzing by Principled Searchcited by 15
- 2025ELFuzz: Efficient Input Generation via LLM-driven Synthesis Over Fuzzer Spacecited by 15
- 2021An Empirical Study of OSS-Fuzz Bugscited by 7
- 2024DiffSpec: Differential Testing with LLMs using Natural Language Specifications and Code Artifactscited by 5
- 2022BeDivFuzz: Integrating Behavioral Diversity into Generator-based Fuzzingcited by 3
- 2023Testing Database Engines via Query Plan Guidancecited by 2
- 2021Growing a Test Corpus with Bonsai Fuzzingcited by 1
- 2026Automatic, Expressive, and Scalable Fuzzing with Stitchingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Agentic Fuzzing: Opportunities and Challenges
- 2026Coverage-Guided Multi-Agent Harness Generation for Java Library Fuzzing
- 2025Locus: Agentic Predicate Synthesis for Directed Fuzzing
- 2025Fuzzwise: Intelligent Initial Corpus Generation for Fuzzing
- 2026FuzzAgent: Multi-Agent System for Evolutionary Library Fuzzing
- 2024AutoSafeCoder: A Multi-Agent Framework for Securing LLM Code Generation through Static Analysis and Fuzz Testing
- 2026SeedSmith: LLM-Driven Seed Synthesis for Directed Fuzzing ↗
- 2026Code Generation by Differential Test Time Scaling