Implicit Patterns in LLM-Based Binary Analysis
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Binary vulnerability analysis is increasingly performed by LLM-based agents in an iterative, multi-pass manner, with the model as the core decision-maker. However, how such systems organize exploration over hundreds of reasoning steps remains poorly understood, due to limited context windows and implicit token-level behaviors. We present the first large-scale, trace-level study showing that multi-pass LLM reasoning gives rise to structured, token-level implicit patterns. Analyzing 521 binaries with 99,563 reasoning steps, we identify four dominant patterns: early pruning, path-dependent lock-in, targeted backtracking, and knowledge-guided prioritization that emerge implicitly from reasoning traces. These token-level implicit patterns serve as an abstraction of LLM reasoning: instead of explicit control-flow or predefined heuristics, exploration is organized through implicit decisions regulating path selection, commitment, and revision. Our analysis shows these patterns form a stable, structured system with distinct temporal roles and measurable characteristics. Our results provide the first systematic characterization of LLM-driven binary analysis and a foundation for more reliable analysis systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 6 of its 32 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
6 of 32 references.
References · 6
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
- 2025LocAgent: Graph-Guided LLM Agents for Code Localizationcited by 82
- 2021Snipuzz: Black-box Fuzzing of IoT Firmware via Message Snippet Inferencecited by 6
- 2025VulBinLLM: LLM-powered Vulnerability Detection for Stripped Binariescited by 4
- 2022μAFL: Non-intrusive Feedback-driven Fuzzing for Microcontroller Firmwarecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RAFFLES: Reasoning-based Attribution of Faults for LLM Systems
- 2026Veritas: Grounding LLM Agents for Reliable Vulnerability Reasoning over Stripped Binaries
- 2025From Implicit Exploration to Structured Reasoning: Leveraging Guideline and Refinement for LLMs
- 2026Integrated and Cross-Architecture Interpretation of LLM Reasoning
- 2026PetriBench: Benchmarking LLM Reasoning over Dynamic State Spaces
- 2025LLM Driven Processes to Foster Explainable AI
- 2026When Tools Fail: Benchmarking Dynamic Replanning and Anomaly Recovery in LLM Agents
- 2026A2RBench: An Automatic Paradigm for Formally Verifiable Abstract Reasoning Benchmark Generation