mlsanityData to 14 Oct 2026

LLMs as Firmware Experts: A Runtime-Grown Tree-of-Agents Framework

arXiv 2511.18438 ↗First posted 23 Nov 2025cs.CR cs.SEcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Large Language Models (LLMs) and their agent systems have recently demonstrated strong potential in automating code reasoning and vulnerability detection. However, when applied to large-scale firmware, their performance degrades due to the binary nature of firmware, complex dependency structures, and heterogeneous components. To address this challenge, this paper presents FIRMHIVE, a recursive agent hive that enables LLMs to act as autonomous firmware security analysts. FIRMHIVE introduces two key mechanisms: (1) transforming delegation into a per-agent, executable primitive and (2) constructing a runtime Tree of Agents (ToA) for decentralized coordination. We evaluate FIRMHIVE using real-world firmware images obtained from publicly available datasets, covering five representative security analysis tasks. Compared with existing LLM-agent baselines, FIRMHIVE performs deeper (about 16x more reasoning steps) and broader (about 2.3x more files inspected) cross-file exploration, resulting in about 5.6x more alerts per firmware. Compared to state-of-the-art (SOTA) security tools, FIRMHIVE identifies about 1.5x more vulnerabilities (1,802 total) and achieves 71% precision, representing significant improvements in both yield and fidelity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 27 of its 58 references that are in the map. First posted on arXiv 23 Nov 2025.

Builds on

27 of 58 references.

References · 27

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  8. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  9. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  10. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  11. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  12. 2023Teaching Large Language Models to Self-Debugcited by 988
15 more
  1. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
  2. 2022Large Language Models Can Self-Improvecited by 664
  3. 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 356
  4. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
  5. 2023AutoAgents: A Framework for Automatic Agent Generationcited by 216
  6. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 205
  7. 2021Examining Zero-Shot Vulnerability Repair with Large Language Modelscited by 105
  8. 2023LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarkscited by 97
  9. 2023The Hitchhiker's Guide to Program Analysis: A Journey with Large Language Modelscited by 18
  10. 2022Pop Quiz! Can a Large Language Model Help With Reverse Engineering?cited by 14
  11. 2019P2IM: Scalable and Hardware-independent Firmware Testing via Automatic Peripheral Interface Modeling (extended version)cited by 5
  12. 2023UVSCAN: Detecting Third-Party Component Usage Violations in IoT Firmwarecited by 3
  13. 2022Towards Reliable and Scalable Linux Kernel CVE Attribution in Automated Static Firmware Analysescited by 2
  14. 2015Automated Dynamic Firmware Analysis at Scale: A Case Study on Embedded Web Interfacescited by 1
  15. 2022Modx: Binary Level Partial Imported Third-Party Library Detection through Program Modularization and Semantic Matchingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026LLM-Based Agents for Software and Systems Security: Approaches, Applications, and Assessment
  2. 2025From LLMs to Agents: A Comparative Evaluation of LLMs and LLM-based Agents in Security Patch Detection
  3. 2025Securing LLM-Generated Embedded Firmware through AI Agent-Driven Validation and Patching
  4. 2025The Dark Side of LLMs: Agent-based Attack Vectors for System-level Compromise
  5. 2025SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security Tasks
  6. 2024AutoSafeCoder: A Multi-Agent Framework for Securing LLM Code Generation through Static Analysis and Fuzz Testing
  7. 2026Beyond Predefined Sinks: Security-Aware Dependency Analysis for LLM Agents
  8. 2026Many Hands Make Light Work: An LLM-based Multi-Agent System for Detecting Malicious PyPI Packages