BLADE: Auditing Information Use for Failure Attribution in LLM Multi-Agent Systems
On the map: LLM agents and tool use → Software engineering coding agents also fits: Agent threats, guardrails and governance
Abstract (arXiv)
Large language model multi-agent systems extend individual agents' capabilities through collaboration across specialized roles, tools, and workflows. Yet collaboration makes failures harder to diagnose: one agent may misinterpret a correct result while others carry the mistake forward. Failure attribution therefore seeks to identify the responsible agent and decisive error step. Recent methods trace dependencies, but knowing where information came from is not the same as knowing where it went wrong. We introduce BLADE (Blame Localization via Audited Dependency Evidence), a training-free framework that moves beyond tracing information to auditing its use. Using Jev for structured probabilistic judgments, BLADE uses dependency probabilities to select relevant source-decision handoffs for auditing. At these handoffs, it examines whether receiving decisions use their sources faithfully and within task requirements, distinguishing error introduction, propagation, and repair. These findings inform a global diagnosis that considers all execution steps. Without reference answers, BLADE achieves the best or tied-best step accuracy among eight strategies under a shared Jev decision interface on 1,228 failed runs across five Who&When and Who&When Pro subsets, outperforming All-at-once by 2.2-11.1 percentage points. Making responsibility evidence explicit offers a path toward more interpretable and reliable agentic systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 27 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
17 of 27 references.
Closest ancestors · 11
Same direction, newest first
- 2026DeFA: Dependency-Guided Failure Attribution for LLM Agents1 Oct
- 2026DCFA: Dual-view Causal-inspired Attribution for Failure Reasoning in LLM-based Multi-agent Systems4 Sep
- 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories6 Aug
- 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?10 Jul
- 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Search30 May
- 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems24 Apr
- 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systems19 Apr
- 2026From Flat Logs to Causal Graphs: Hierarchical Failure Attribution for LLM-based Multi-Agent Systems27 Feb
- 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectories2 Feb
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?3 Sep
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
Other references · 6
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 290
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
- 2024Adaptive In-conversation Team Building for Language Model Agentscited by 39
- 2025UltraHorizon: Benchmarking Agent Capabilities in Ultra Long-Horizon Scenarioscited by 26
- 2025AgentAsk: Multi-Agent Systems Need to Askcited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systems
- 2026Finding Where the Buck Stops: An Automated Failure Attribution-Based Reflection Framework for Multi-Agent Collaboration
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems
- 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluation
- 2026StepFinder: A Temporal Semantic Framework for Failure Attribution in Multi-Agent Systems
- 2026Adaptive Influence Graphs for Failure Attribution in Multi-Agent Systems
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems
- 2026Error-Propagation Modeling for Failure Attribution in LLM-Based Multi-Agent Systems