Leveraging Trajectory Graphs for Pre-Execution Error Diagnosis in Agentic LLM Systems
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Large Language Model~(LLM)-based agents have demonstrated exceptional performance across a wide range of complex interactive tasks. However, they often struggle with long-horizon interactive tasks common in domains, such as embodied AI. The complexity and vast action spaces in these settings lead to compounding errors, where a single suboptimal action can derail an entire trajectory, causing the agent to exhaust its limited step budget on inefficient or unrecoverable paths. To overcome this without costly fine-tuning, we draw inspiration from software debugging, where execution logs are analyzed to preemptively catch errors. We propose textitTrajectory Graph Copilot, a novel framework that acts as a ``copilot'' for LLM agents by diagnosing potential action errors before they are executed. At its core,textitGraph Debugger models historical trajectories as a probabilistic graph and uses a Graph Neural Network to identify sequential action patterns that frequently lead to failure. Functioning as a proactive diagnostic sandbox, our method provides early warnings on potentially flawed actions, prompting the agent to self-correct. This pre-action error diagnosis prevents costly mistakes, significantly enhancing the agent's ability to complete long-horizon tasks successfully. The extensive experiments on four benchmarks with three LLM agents demonstrate a 14.69% pass ratio improvement on average.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 68 of its 81 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
68 of 81 references.
Closest ancestors · 4
Same direction, newest first
- 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solving18 May
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges14 Jan
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
- 2023ChatDev: Communicative Agents for Software Development16 Jul
Other references · 64
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
38 more
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2025Gemma 3 Technical Reportcited by 1,686
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2023Reasoning with Language Model is Planning with World Modelcited by 846
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
- 2018VirtualHome: Simulating Household Activities via Programscited by 411
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 385
- 2018Graph Convolutional Networks for Text Classificationcited by 345
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 319
- 2018TextWorld: A Learning Environment for Text-based Gamescited by 304
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 298
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2023FireAct: Toward Language Agent Fine-tuningcited by 247
- 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
- 2020MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformerscited by 240
- 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 220
- 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
- 2022Active Example Selection for In-Context Learningcited by 195
- 2024Trial and Error: Exploration-Based Trajectory Optimization for LLM Agentscited by 194
- 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 193
- 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 142
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Modelscited by 123
- 2023ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Searchcited by 103
- 2021RnG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answeringcited by 86
- 2024Watch Every Step! LLM Agent Learning via Iterative Step-Level Process Refinementcited by 86
- 2020A Survey on Text Classification: From Shallow to Deep Learningcited by 80
- 2024RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agentscited by 80
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Trainingcited by 74
- 2023Agent Lumos: Unified and Modular Training for Open-Source Language Agentscited by 72
- 2021Complex Knowledge Base Question Answering: A Surveycited by 52
- 2024Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inferencecited by 51
50 most cited of 64 All 64 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories
- 2025Where LLM Agents Fail and How They can Learn From Failures
- 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Search
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?
- 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectories
- 2026The Long-Horizon Task Mirage? Diagnosing Where and Why Agentic Systems Break
- 2026AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents
- 2026Lightweight, Rubric-Guided Trajectory Evaluation for Production AI Agents