HarnessAgent: Scaling Automatic Fuzzing Harness Construction with Tool-Augmented LLM Pipelines
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Large language model (LLM)-based techniques have achieved notable progress in generating harnesses for program fuzzing. However, applying them to arbitrary functions (especially internal functions) textitat scale remains challenging due to the requirement of sophisticated contextual information, such as specification, dependencies, and usage examples. State-of-the-art methods heavily rely on static or incomplete context provisioning, causing failure of generating functional harnesses. Furthermore, LLMs tend to exploit harness validation metrics, producing plausible yet logically useless code. % Therefore, harness generation across large and diverse projects continues to face challenges in reliable compilation, robust code retrieval, and comprehensive validation. To address these challenges, we present HarnessAgent, a tool-augmented agentic framework that achieves fully automated, scalable harness construction over hundreds of OSS-Fuzz targets. HarnessAgent introduces three key innovations: 1) a rule-based strategy to identify and minimize various compilation errors; 2) a hybrid tool pool for precise and robust symbol source code retrieval; and 3) an enhanced harness validation pipeline that detects fake definitions. We evaluate HarnessAgent on 243 target functions from OSS-Fuzz projects (65 C projects and 178 C++ projects). It improves the three-shot success rate by approximately 20% compared to state-of-the-art techniques, reaching 87% for C and 81% for C++. Our one-hour fuzzing results show that more than 75% of the harnesses generated by HarnessAgent increase the target function coverage, surpassing the baselines by over 10%. In addition, the hybrid tool-pool system of HarnessAgent achieves a response rate of over 90% for source code retrieval, outperforming Fuzz Introspector by more than 30%.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 36 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
9 of 36 references.
References · 9
- 2025Qwen3 Technical Reportcited by 8,195
- 2025A Survey of Context Engineering for Large Language Modelscited by 120
- 2022Large Language Models are Zero-Shot Fuzzers: Fuzzing Deep-Learning Libraries via Large Language Modelscited by 102
- 2023Prompt Fuzzing for Fuzz Driver Generationcited by 27
- 2023How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generationcited by 21
- 2021RULF: Rust Library Fuzzing via API Dependency Graph Traversalcited by 5
- 2023HOPPER: Interpretative Fuzzing for Librariescited by 4
- 2021IntelliGen: Automatic Driver Synthesis for FuzzTestingcited by 3
- 2023Automated Fuzzing Harness Generation for Library APIs and Binary Protocol Parserscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025PBFuzz: Agentic Directed Fuzzing for PoV Generationcited by 4
- 2026Execution-State-Aware LLM Reasoning for Automated Proof-of-Vulnerability Generationcited by 3
- 2026Agentic Separation Logic Specification Synthesiscited by 0
- 2026SyzHarness: Patch-Based Kernel Bug Reproduction with LLM-Synthesized Fuzzing Harnessescited by 0
- 2026SyzHarness: Patch-Based Kernel Bug Reproduction with LLM-Synthesized Fuzzing Harnesses20 Sep 2026
- 2026Agentic Separation Logic Specification Synthesis26 May 2026
- 2026Execution-State-Aware LLM Reasoning for Automated Proof-of-Vulnerability Generation14 Feb 2026
- 2025PBFuzz: Agentic Directed Fuzzing for PoV Generation4 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2026Thinking More, Harnessing Better: State Machine Guided Harness Automatic Generation with Project Digestion and Workflow Decomposition
- 2026Coverage-Guided Multi-Agent Harness Generation for Java Library Fuzzing
- 2026Agentic Harness for Real-World Compilers
- 2026Meta-Harness: End-to-End Optimization of Model Harnesses
- 2026Harness Engineering: Anatomy, Architecture, and Evolution of Coding Agents -- A Source-Code Study of Eleven Systems
- 2026Composing Task-specific Agent Harnesses at Test Time with Reusable Primitives
- 2025LibLMFuzz: LLM-Augmented Fuzz Target Generation for Black-box Libraries
- 2026Quality-Assured Fuzz Harness Generation via the Four Principles Framework