BRA-Audit: Budgeted Runtime Auditing for LLM Multi-Agent Systems via Cumulative-Exposure Audit-Point Placement
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
LLM-based multi-agent systems (LLM-MAS) solve complex tasks through specialized collaboration, but inter-agent dependencies can propagate hallucinated or malicious outputs into system-level failures. Auditor agents mitigate these risks, yet existing strategies face an efficiency dilemma: end-only auditing reviews long trajectories and final outputs, potentially weakening audit effectiveness and enlarging rollback scope, while auditing every agent each round improves detection and localization at high token cost. How can guard performance be preserved while minimizing token cost? To address this problem, we propose BRA-Audit, a budget-aware runtime auditing framework that models MAS execution as a dynamic dependency graph and formulates audit scheduling as audit-point placement under a fixed audit-call budget to minimize cumulative unchecked exposure. Its greedy scheduler prioritizes influential and long-unaudited regions, while trusted audit points enable localized recovery. Across structured coordination, complex reasoning, and open-ended tasks, BRA-Audit restores performance close to the clean setting, remains competitive with heavy guard methods and reduces end-to-end token consumption by (17.2%)--(40.6%).
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 17 of its 27 references that are in the map. First posted on arXiv 2 Aug 2026.
Builds on
17 of 27 references.
Closest ancestors · 5
Same direction, newest first
- 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attacks11 Aug
- 2025PeerGuard: Defending Multi-Agent Systems Against Backdoor Attacks Through Mutual Reasoning16 May
- 2025Multi-Agent Systems Execute Arbitrary Malicious Code15 Mar
- 2025Red-Teaming LLM Multi-Agent Systems via Communication Attacks20 Feb
- 2024Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communities10 Jul
Other references · 12
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 438
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 178
- 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMscited by 31
- 2026Auditing Multi-Agent LLM Reasoning Trees Outperforms Majority Vote and LLM-as-Judgecited by 18
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Towards Security-Auditable LLM Agents: A Unified Graph Representation
- 2026AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systems
- 2026VulnAgent-R2: Evidence-Calibrated Multi-Agent Auditing for Repository-Level Vulnerability Detection
- 2025Verifiability-First Agents: Provable Observability and Lightweight Audit Agents for Controlling Autonomous LLM Systems
- 2026BLADE: Auditing Information Use for Failure Attribution in LLM Multi-Agent Systems
- 2026AgentTrace: A Structured Logging Framework for Agent System Observability
- 2026Iterative Audit Convergence in LLM-Managed Multi-Agent Systems: A Case Study in Prompt-Engineering Quality Assurance
- 2026Agent Audit: A Security Analysis System for LLM Agent Applications