AgentTrace: Causal Graph Tracing for Root Cause Analysis in Deployed Multi-Agent Systems
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
As multi-agent AI systems are increasingly deployed in real-world settings - from automated customer support to DevOps remediation - failures become harder to diagnose due to cascading effects, hidden dependencies, and long execution traces. We present AgentTrace, a lightweight causal tracing framework for post-hoc failure diagnosis in deployed multi-agent workflows. AgentTrace reconstructs causal graphs from execution logs, traces backward from error manifestations, and ranks candidate root causes using interpretable structural and positional signals - without requiring LLM inference at debugging time. Across a diverse benchmark of multi-agent failure scenarios designed to reflect common deployment patterns, AgentTrace localizes root causes with high accuracy and sub-second latency, significantly outperforming both heuristic and LLM-based baselines. Our results suggest that causal tracing provides a practical foundation for improving the reliability and trustworthiness of agentic systems in the wild.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 15 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
9 of 15 references.
Closest ancestors · 2
Same direction, newest first
- 2024Exploring LLM-based Agents for Root Cause Analysis7 Mar
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
Other references · 7
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2021Anomaly Detection and Failure Root Cause Analysis in (Micro)Service-Based Cloud Applications: A Surveycited by 47
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Temporary Authority, Permanent Effects: Commit-Time Authorization for LLM Agentscited by 17
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systemscited by 5
- 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectoriescited by 5
- 2026How Much Coordination Gain Is Real? A Paired Noise-Floor Protocol for Multi-Agent LLM Benchmarkscited by 2
- 2026AuditRepairBench: A Paired-Execution Trace Corpus for Evaluator-Channel Ranking Instability in Agent Repaircited by 0
- 2026Hearsay: Can an Auditor Trust the Record a Deployed Agent Harness Writes?cited by 0
- 2026MAADBench: The Refreshable Paradigm for Anomaly Detection in Multi-Agent Systemscited by 0
- 2026MAADBench: The Refreshable Paradigm for Anomaly Detection in Multi-Agent Systems29 Sep 2026
- 2026Hearsay: Can an Auditor Trust the Record a Deployed Agent Harness Writes?26 Sep 2026
- 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories6 Aug 2026
- 2026Temporary Authority, Permanent Effects: Commit-Time Authorization for LLM Agents11 Jul 2026
- 2026How Much Coordination Gain Is Real? A Paired Noise-Floor Protocol for Multi-Agent LLM Benchmarks15 Jun 2026
- 2026Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems14 May 2026
- 2026AuditRepairBench: A Paired-Execution Trace Corpus for Evaluator-Channel Ranking Instability in Agent Repair6 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026From Anomalies to Failures: Constructing Causal Error Graphs for Agentic Trace Diagnosis
- 2026Adaptive Influence Graphs for Failure Attribution in Multi-Agent Systems
- 2026TraceSIR: A Multi-Agent Framework for Structured Analysis and Reporting of Agentic Execution Traces
- 2026Seeing the Whole Elephant: A Benchmark for Failure Attribution in LLM-based Multi-Agent Systems
- 2026From Flat Logs to Causal Graphs: Hierarchical Failure Attribution for LLM-based Multi-Agent Systems
- 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectories
- 2026CausalFlow: Causal Attribution and Counterfactual Repair for LLM Agent Failures
- 2025TRAIL: Trace Reasoning and Agentic Issue Localization