AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
LLM agent failures are difficult to debug because the step where an error surfaces is often not the one that caused it. Existing observability tools replay execution traces but provide little support for identifying the root cause or translating diagnosis into recovery. We present AgentDebugX, an open-source debugging framework that organizes debugging as a closed loop of Detect, Attribute, Recover, and Rerun. At its core, DeepDebug performs multi-turn root-cause diagnosis through global trajectory understanding, structure-guided investigation, and cross-examination. On the Who and When benchmark, DeepDebug achieves the best strict attribution accuracy among the evaluated methods on both tested open-weight backbones, reaching 28.8 percent exact agent-and-step accuracy on qwen3.5-9b versus 21.7 percent for the strongest single-pass baseline. On GAIA, DeepDebug repairs 13 of 73 failed tasks in a single rerun, compared with 4 to 6 for three decoupled self-correction baselines, improving overall accuracy from 55.8 percent to 63.6 percent. AgentDebugX exposes this workflow through a Python library, CLI, web console, and installable agentic skill, and provides an opt-in Error Hub for sharing scrubbed failure-diagnosis-repair bundles and reusing them as debugging memory.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 10 of its 16 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
10 of 16 references.
Closest ancestors · 4
Same direction, newest first
- 2025Where LLM Agents Fail and How They can Learn From Failures29 Sep
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?3 Sep
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
- 2024AgentOps: Enabling Observability of LLM Agents8 Nov
Other references · 6
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2024AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learningcited by 52
- 2025METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scalingcited by 33
- 2025A Survey on Large Language Models for Automated Planningcited by 17
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026CatchBench: When Can an Agent Failure Be Caught?cited by 2
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gapscited by 1
- 2026Evidence-Calibrated Runtime Reconstruction for Agent Skills Across Heterogeneous Coding Agentscited by 1
- 2026DENSE: Distilling Agent Trajectories into Evidence-Grounded Shortcut Trees for Self-Refinementcited by 0
- 2026DAAF: From Failure Localization to Editable System Assets in LLM Agentscited by 0
- 2026Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Trainingcited by 0
- 2026DeFA: Dependency-Guided Failure Attribution for LLM Agentscited by 0
- 2026DeFA: Dependency-Guided Failure Attribution for LLM Agents1 Oct 2026
- 2026Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Training30 Sep 2026
- 2026DAAF: From Failure Localization to Editable System Assets in LLM Agents26 Sep 2026
- 2026DENSE: Distilling Agent Trajectories into Evidence-Grounded Shortcut Trees for Self-Refinement18 Sep 2026
- 2026CatchBench: When Can an Agent Failure Be Caught?24 Aug 2026
- 2026Evidence-Calibrated Runtime Reconstruction for Agent Skills Across Heterogeneous Coding Agents9 Aug 2026
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gaps27 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Repair or Resample? Rethinking Failure Debugging in LLM Multi-Agent Systems
- 2025DoVer: Intervention-Driven Auto Debugging for LLM Multi-Agent Systems
- 2026AgentFixer: From Failure Detection to Fix Recommendations in LLM Agentic Systems
- 2026Evaluating Agentic Code Repair Capabilities in Distributed Systems
- 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems
- 2026AgentRewind: Recoverable Execution for Long-Horizon LLM Agents
- 2026When Agentic Executions Fail: Detecting and Localizing Runtime Faults from Telemetry