mlsanityData to 7 Oct 2026

DeFA: Dependency-Guided Failure Attribution for LLM Agents

arXiv 2610.01256 ↗First posted 1 Oct 2026cs.AIcited by 0

On the map: LLM agents and tool use → Software engineering coding agents also fits: Agent threats, guardrails and governance

Abstract (arXiv)

Errors in LLM agent executions and their visible consequences can be separated by many steps, making decisive-error localization a matter of understanding both step content and step dependencies. We introduce DeFA, a dependency-guided framework for agent failure attribution. DeFA first combines protocol relations and semantic dependencies into an event dependency graph spanning the trajectory. It then identifies events that may violate task requirements and traces their sources and subsequent effects to construct a failure propagation graph. Finally, DeFA uses step evidence and the steps' roles in failure propagation to identify the decisive error, responsible agent, and error category. To support long trajectories, DeFA partitions executions into segments and combines the current segment's detailed content with summaries of the other segments, giving local diagnosis access to global execution context. Across Who and When and the Who and When Pro text subset, DeFA achieves the highest responsible-agent and exact step accuracy with all evaluated backbones, and the highest failure-mode accuracy among taxonomy-aligned methods on Pro. Further experiments on image and video trajectories demonstrate its applicability to multimodal failure attribution. Ablations support the contributions of segmentation, the event dependency graph, and the failure propagation graph. Using DeFA's diagnostic feedback for skill evolution in Trace2Skill improves downstream task accuracy by 6-15 percentage points over the native pipeline, showing that the diagnoses can also support agent improvement on subsequent tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 26 of its 28 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

26 of 28 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026EDGE: Error Dependency Graph-Guided Multi-Error Attribution in Multi-Agent LLM Systems1 Sep
  2. 2026AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents21 Jul
  3. 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?10 Jul
  4. 2026Failure as a Process: An Anatomy of CLI Coding Agent Trajectories10 Jul
  5. 2026REFLECT: Intervention-Supported Error Attribution for Silent Failures in LLM Agent Traces8 Jun
  6. 2026CausalFlow: Causal Attribution and Counterfactual Repair for LLM Agent Failures25 May
  7. 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems17 May
  8. 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systems19 Apr
  9. 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectories2 Feb
  10. 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?3 Sep
  11. 2025TRAIL: Trace Reasoning and Agentic Issue Localization13 May
  12. 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems30 Apr
2 more
  1. 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
  2. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug

Other references · 12

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2023Let's Verify Step by Stepcited by 3,598
  5. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  7. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
  8. 2024ProcessBench: Identifying Process Errors in Mathematical Reasoningcited by 277
  9. 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 223
  10. 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 161
  11. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
  12. 2026CockpitHAT: Dependency-Graph-Driven Hierarchical Attribution for Embodied Multi-Agent Cockpitscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Search
  2. 2026DAAF: From Failure Localization to Editable System Assets in LLM Agents
  3. 2026StepFinder: A Temporal Semantic Framework for Failure Attribution in Multi-Agent Systems
  4. 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems
  5. 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluation
  6. 2026Adaptive Influence Graphs for Failure Attribution in Multi-Agent Systems
  7. 2026Detect Before You Attribute: Cascade Failure Attribution for Multi-Agent Systems
  8. 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories