Orion: Fuzzing Workflow Automation
Not on the map. Why?
Abstract (arXiv)
Fuzz testing is one of the most effective techniques for finding software vulnerabilities. While modern fuzzers can generate inputs and monitor executions automatically, the overall workflow, from analyzing a codebase, to configuring harnesses, to triaging results, still requires substantial manual effort. Prior attempts focused on single stages such as harness synthesis or input minimization, leaving researchers to manually connect the pieces into a complete fuzzing campaign. We introduce Orion, a framework that automates the the manual bottlenecks of fuzzing by integrating LLM reasoning with traditional tools, allowing campaigns to scale to settings where human effort alone was impractical. Orion uses LLMs for code reasoning and semantic guidance, while relying on deterministic tools for verification, iterative refinement, and tasks that require precision. Across our benchmark suite, Orion reduces human effort by 46-204x depending on the workflow stage, and we demonstrate its effectiveness through the discovery of two previously unknown vulnerabilities in the widely used open-source clib library.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 49 references that are in the map. First posted on arXiv 18 Sep 2025.
Builds on
16 of 49 references.
References · 16
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 139
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 68
- 2023Prompt Fuzzing for Fuzz Driver Generationcited by 27
- 2025KNighter: Transforming Static Analysis with LLM-Synthesized Checkerscited by 24
- 2023How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generationcited by 21
- 2025ELFuzz: Efficient Input Generation via LLM-driven Synthesis Over Fuzzer Spacecited by 15
- 2024SoK: Prudent Evaluation Practices for Fuzzingcited by 8
- 2024Fixing Security Vulnerabilities with AI in OSS-Fuzzcited by 5
4 more
- 2024Large Language Model assisted Hybrid Fuzzingcited by 4
- 2018SmartSeed: Smart Seed Generation for Efficient Fuzzingcited by 3
- 2025LibLMFuzz: LLM-Augmented Fuzz Target Generation for Black-box Librariescited by 3
- 2025May the Feedback Be with You! Unlocking the Power of Feedback-Driven Deep Learning Framework Fuzzing via LLMscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Hybrid Fuzzing with LLM-Guided Input Mutation and Semantic Feedback
- 2025Locus: Agentic Predicate Synthesis for Directed Fuzzing
- 2026ChainFuzzer: Greybox Fuzzing for Workflow-Level Multi-Tool Vulnerabilities in LLM Agents
- 2026Agentic Fuzzing: Opportunities and Challenges
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproduction
- 2026Large Language Models for Fuzz Testing in Microservices: A Systematic Literature Review ↗
- 2026Quality-Assured Fuzz Harness Generation via the Four Principles Framework
- 2026SyzHarness: Patch-Based Kernel Bug Reproduction with LLM-Synthesized Fuzzing Harnesses