DeFA: Dependency-Guided Failure Attribution for LLM Agents
On the map: LLM agents and tool use → Software engineering coding agents also fits: Agent threats, guardrails and governance
Abstract (arXiv)
Errors in LLM agent executions and their visible consequences can be separated by many steps, making decisive-error localization a matter of understanding both step content and step dependencies. We introduce DeFA, a dependency-guided framework for agent failure attribution. DeFA first combines protocol relations and semantic dependencies into an event dependency graph spanning the trajectory. It then identifies events that may violate task requirements and traces their sources and subsequent effects to construct a failure propagation graph. Finally, DeFA uses step evidence and the steps' roles in failure propagation to identify the decisive error, responsible agent, and error category. To support long trajectories, DeFA partitions executions into segments and combines the current segment's detailed content with summaries of the other segments, giving local diagnosis access to global execution context. Across Who and When and the Who and When Pro text subset, DeFA achieves the highest responsible-agent and exact step accuracy with all evaluated backbones, and the highest failure-mode accuracy among taxonomy-aligned methods on Pro. Further experiments on image and video trajectories demonstrate its applicability to multimodal failure attribution. Ablations support the contributions of segmentation, the event dependency graph, and the failure propagation graph. Using DeFA's diagnostic feedback for skill evolution in Trace2Skill improves downstream task accuracy by 6-15 percentage points over the native pipeline, showing that the diagnoses can also support agent improvement on subsequent tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 26 of its 28 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
26 of 28 references.
Closest ancestors · 14
Same direction, newest first
- 2026EDGE: Error Dependency Graph-Guided Multi-Error Attribution in Multi-Agent LLM Systems1 Sep
- 2026AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents21 Jul
- 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?10 Jul
- 2026Failure as a Process: An Anatomy of CLI Coding Agent Trajectories10 Jul
- 2026REFLECT: Intervention-Supported Error Attribution for Silent Failures in LLM Agent Traces8 Jun
- 2026CausalFlow: Causal Attribution and Counterfactual Repair for LLM Agent Failures25 May
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems17 May
- 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systems19 Apr
- 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectories2 Feb
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?3 Sep
- 2025TRAIL: Trace Reasoning and Agentic Issue Localization13 May
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems30 Apr
2 more
Other references · 12
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
- 2024ProcessBench: Identifying Process Errors in Mathematical Reasoningcited by 277
- 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 223
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 161
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
- 2026CockpitHAT: Dependency-Graph-Driven Hierarchical Attribution for Embodied Multi-Agent Cockpitscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Search
- 2026DAAF: From Failure Localization to Editable System Assets in LLM Agents
- 2026StepFinder: A Temporal Semantic Framework for Failure Attribution in Multi-Agent Systems
- 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems
- 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluation
- 2026Adaptive Influence Graphs for Failure Attribution in Multi-Agent Systems
- 2026Detect Before You Attribute: Cascade Failure Attribution for Multi-Agent Systems
- 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories