mlsanityData to 14 Oct 2026

TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories

arXiv 2608.06346 ↗First posted 6 Aug 2026cs.AIcited by 8

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

LLM-based agentic systems have shown remarkable capabilities in complex domains, while suffering from cascading errors and difficulty in debugging. Critical error detection aims to locate the earliest error step in a failed trajectory that is responsible for the final failure. However, progress faces two main challenges. First, long trajectories make it difficult to identify individual errors, since the evidence for judging a step may be scattered across distant instructions, observations, and prior context. Second, failed trajectories often contain multiple local errors with different downstream effects, only some of which remain responsible for the final failure. In this work, we propose TrajDebug, an error-lifecycle tracing framework that addresses long-trajectory error discovery with multi-granularity history compression and evidence-based error identification, and supports critical attribution by tracing each error's resolution status and terminal impact. We further construct TrajErrBench, a benchmark of 486 manually annotated failed trajectories from Tau2Bench and SWE-Bench Pro, covering realistic tool-use and coding scenarios. Experiments across diverse agent benchmarks show that TrajDebug achieves the best overall performance over existing baselines, and application studies further demonstrate that its diagnoses provide actionable feedback for improving downstream agent success. We will release the codes and data to facilitate further research.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 77 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

18 of 77 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems24 Apr
  2. 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluation26 Mar
  3. 2026AgentTrace: Causal Graph Tracing for Root Cause Analysis in Deployed Multi-Agent Systems16 Mar
  4. 2026AgentFixer: From Failure Detection to Fix Recommendations in LLM Agentic Systems18 Feb
  5. 2026GLM-5: from Vibe Coding to Agentic Engineering17 Feb
  6. 2025Where Did It All Go Wrong? A Hierarchical Look into Multi-Agent Error Attribution6 Oct
  7. 2025Where LLM Agents Fail and How They can Learn From Failures29 Sep
  8. 2025Who is Introducing the Failure? Automatically Attributing Failures of Multi-Agent Systems via Spectrum Analysis17 Sep
  9. 2025TRAIL: Trace Reasoning and Agentic Issue Localization13 May
  10. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
  11. 2024AgentLens: Visual Analysis for Agent Behaviors in LLM-based Autonomous Systems14 Feb

Other references · 7

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  3. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  4. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  5. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 339
  6. 2025AgentPRM: Process Reward Models for LLM Agents via Step-Wise Promise and Progresscited by 77
  7. 2025GraphTracer: Graph-Guided Failure Tracing in LLM Agents for Robust Multi-Turn Deep Searchcited by 23

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Leveraging Trajectory Graphs for Pre-Execution Error Diagnosis in Agentic LLM Systems
  2. 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectories
  3. 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Search
  4. 2026Tracing Agentic Failure from the Flow of Success
  5. 2026Coherence Collapse: Diagnosing Why Code Agents Fail After Reaching the Right Code
  6. 2026DeFA: Dependency-Guided Failure Attribution for LLM Agents
  7. 2025CORRECT: COndensed eRror RECognition via knowledge Transfer in multi-agent systems
  8. 2026TrajAudit: Automated Failure Diagnosis for Agentic Coding Systems