GraphTracer: Graph-Guided Failure Tracing in LLM Agents for Robust Multi-Turn Deep Search
Not on the map. Why?
Abstract (arXiv)
Multi-agent systems powered by Large Language Models excel at complex tasks through coordinated collaboration, yet they face high failure rates in multi-turn deep search scenarios. Existing temporal attribution methods struggle to accurately diagnose root causes, particularly when errors propagate across multiple agents. Attempts to automate failure attribution by analyzing action sequences remain ineffective due to their inability to account for information dependencies that span agents. This paper identifies two core challenges: textit(i) distinguishing symptoms from root causes in multi-agent error propagation, and textit(ii) tracing information dependencies beyond temporal order. To address these issues, we introduce GraphTracer, a framework that redefines failure attribution through information flow analysis. GraphTracer constructs Information Dependency Graphs (IDGs) to explicitly capture how agents reference and build on prior outputs. It localizes root causes by tracing through these dependency structures instead of relying on temporal sequences. GraphTracer also uses graph-aware synthetic data generation to target critical nodes, creating realistic failure scenarios. Evaluations on the Who&When benchmark and integration into production systems demonstrate that GraphTracer-8B achieves up to 18.18% higher attribution accuracy compared to state-of-the-art models and enables 4.8% to 14.2% performance improvements in deployed multi-agent frameworks, establishing a robust solution for multi-agent system debugging.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Oct 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 2; 2026: 21.
23 papers.
Sort:
By area:
- 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systemscited by 27
- 2025DoVer: Intervention-Driven Auto Debugging for LLM Multi-Agent Systemscited by 24
- 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluationcited by 24
- 2026From Flat Logs to Causal Graphs: Hierarchical Failure Attribution for LLM-based Multi-Agent Systemscited by 19
- 2026CausalFlow: Causal Attribution and Counterfactual Repair for LLM Agent Failurescited by 18
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 15
- 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Searchcited by 12
- 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactionscited by 11
- 2026Tracing Agentic Failure from the Flow of Successcited by 8
- 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectoriescited by 8
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systemscited by 6
- 2026MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systemscited by 6
11 more
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systemscited by 5
- 2026When Only the Final Text Survives: Implicit Execution Tracing for Multi-Agent Auditingcited by 3
- 2026CASPIAN: Online Detection and Attribution of Cascade Attacks in LLM Multi-Agent Systems via Cross-Channel Causal Monitoringcited by 3
- 2026Confidence Laundering in Agent Systems: Why Uncertainty Needs a Latent Carriercited by 1
- 2026Learning to Recommend Multi-Agent Subgraphs from Calling Treescited by 0
- 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysiscited by 0
- 2026Agent System Operations: Categorization, Challenges, and Future Directionscited by 0
- 2026Diagnosis-Driven Automatic Repair for Agentic Workflow via Symbolic Inferencecited by 0
- 2026Beyond LLM-Based Reasoning: Lightweight GNNs for Agent Failure Attributioncited by 0
- 2026Localizing Emergent Failures in Agentic AI: Recovering Minimal Repair Families via Counterfactual Replaycited by 0
- 2026Can Failed Trajectories Reveal Where Agents Go Wrong? Agentic Failure Attribution Without Step-Level Labelscited by 0
- 2026Can Failed Trajectories Reveal Where Agents Go Wrong? Agentic Failure Attribution Without Step-Level Labels9 Oct 2026
- 2026Localizing Emergent Failures in Agentic AI: Recovering Minimal Repair Families via Counterfactual Replay29 Aug 2026
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces24 Aug 2026
- 2026Beyond LLM-Based Reasoning: Lightweight GNNs for Agent Failure Attribution19 Aug 2026
- 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories6 Aug 2026
- 2026Tracing Agentic Failure from the Flow of Success14 Jul 2026
- 2026Diagnosis-Driven Automatic Repair for Agentic Workflow via Symbolic Inference3 Jul 2026
- 2026Confidence Laundering in Agent Systems: Why Uncertainty Needs a Latent Carrier9 Jun 2026
- 2026Agent System Operations: Categorization, Challenges, and Future Directions1 Jun 2026
- 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Search30 May 2026
- 2026MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems27 May 2026
- 2026CausalFlow: Causal Attribution and Counterfactual Repair for LLM Agent Failures25 May 2026
11 more
- 2026CASPIAN: Online Detection and Attribution of Cascade Attacks in LLM Multi-Agent Systems via Cross-Channel Causal Monitoring19 May 2026
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems17 May 2026
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems14 May 2026
- 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems24 Apr 2026
- 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluation26 Mar 2026
- 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysis20 Mar 2026
- 2026When Only the Final Text Survives: Implicit Execution Tracing for Multi-Agent Auditing18 Mar 2026
- 2026From Flat Logs to Causal Graphs: Hierarchical Failure Attribution for LLM-based Multi-Agent Systems27 Feb 2026
- 2026Learning to Recommend Multi-Agent Subgraphs from Calling Trees29 Jan 2026
- 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactions7 Dec 2025
- 2025DoVer: Intervention-Driven Auto Debugging for LLM Multi-Agent Systems7 Dec 2025
- 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systemscited by 27
- 2025DoVer: Intervention-Driven Auto Debugging for LLM Multi-Agent Systemscited by 24
- 2026From Flat Logs to Causal Graphs: Hierarchical Failure Attribution for LLM-based Multi-Agent Systemscited by 19
- 2026CausalFlow: Causal Attribution and Counterfactual Repair for LLM Agent Failurescited by 18
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 15
- 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactionscited by 11
- 2026Tracing Agentic Failure from the Flow of Successcited by 8
- 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectoriescited by 8
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systemscited by 6
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systemscited by 5
- 2026CASPIAN: Online Detection and Attribution of Cascade Attacks in LLM Multi-Agent Systems via Cross-Channel Causal Monitoringcited by 3
- 2026Diagnosis-Driven Automatic Repair for Agentic Workflow via Symbolic Inferencecited by 0
12 most cited of 14 All 14 (JSON)
- 2026Can Failed Trajectories Reveal Where Agents Go Wrong? Agentic Failure Attribution Without Step-Level Labels9 Oct 2026
- 2026Localizing Emergent Failures in Agentic AI: Recovering Minimal Repair Families via Counterfactual Replay29 Aug 2026
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces24 Aug 2026
- 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories6 Aug 2026
- 2026Tracing Agentic Failure from the Flow of Success14 Jul 2026
- 2026Diagnosis-Driven Automatic Repair for Agentic Workflow via Symbolic Inference3 Jul 2026
- 2026CausalFlow: Causal Attribution and Counterfactual Repair for LLM Agent Failures25 May 2026
- 2026CASPIAN: Online Detection and Attribution of Cascade Attacks in LLM Multi-Agent Systems via Cross-Channel Causal Monitoring19 May 2026
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems17 May 2026
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems14 May 2026
- 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems24 Apr 2026
- 2026From Flat Logs to Causal Graphs: Hierarchical Failure Attribution for LLM-based Multi-Agent Systems27 Feb 2026
12 newest of 14 All 14 (JSON)
- 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluationcited by 24
- 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Searchcited by 12
- 2026MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systemscited by 6
- 2026Agent System Operations: Categorization, Challenges, and Future Directionscited by 0
- 2026Beyond LLM-Based Reasoning: Lightweight GNNs for Agent Failure Attributioncited by 0
- 2026Beyond LLM-Based Reasoning: Lightweight GNNs for Agent Failure Attribution19 Aug 2026
- 2026Agent System Operations: Categorization, Challenges, and Future Directions1 Jun 2026
- 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Search30 May 2026
- 2026MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems27 May 2026
- 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluation26 Mar 2026