mlsanityData to 7 Oct 2026

Leveraging Trajectory Graphs for Pre-Execution Error Diagnosis in Agentic LLM Systems

arXiv 2607.27443 ↗First posted 29 Jul 2026cs.AIcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Large Language Model~(LLM)-based agents have demonstrated exceptional performance across a wide range of complex interactive tasks. However, they often struggle with long-horizon interactive tasks common in domains, such as embodied AI. The complexity and vast action spaces in these settings lead to compounding errors, where a single suboptimal action can derail an entire trajectory, causing the agent to exhaust its limited step budget on inefficient or unrecoverable paths. To overcome this without costly fine-tuning, we draw inspiration from software debugging, where execution logs are analyzed to preemptively catch errors. We propose textitTrajectory Graph Copilot, a novel framework that acts as a ``copilot'' for LLM agents by diagnosing potential action errors before they are executed. At its core,textitGraph Debugger models historical trajectories as a probabilistic graph and uses a Graph Neural Network to identify sequential action patterns that frequently lead to failure. Functioning as a proactive diagnostic sandbox, our method provides early warnings on potentially flawed actions, prompting the agent to self-correct. This pre-action error diagnosis prevents costly mistakes, significantly enhancing the agent's ability to complete long-horizon tasks successfully. The extensive experiments on four benchmarks with three LLM agents demonstrate a 14.69% pass ratio improvement on average.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 68 of its 81 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

68 of 81 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solving18 May
  2. 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges14 Jan
  3. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
  4. 2023ChatDev: Communicative Agents for Software Development16 Jul

Other references · 64

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  7. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  8. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  9. 2024Qwen2.5 Technical Reportcited by 4,713
  10. 2018How Powerful are Graph Neural Networks?cited by 4,355
  11. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  12. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
38 more
  1. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  2. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  3. 2025Gemma 3 Technical Reportcited by 1,686
  4. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  5. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  6. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  7. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  8. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  9. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  10. 2023Reasoning with Language Model is Planning with World Modelcited by 846
  11. 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
  12. 2018VirtualHome: Simulating Household Activities via Programscited by 411
  13. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 385
  14. 2018Graph Convolutional Networks for Text Classificationcited by 345
  15. 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
  16. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 319
  17. 2018TextWorld: A Learning Environment for Text-based Gamescited by 304
  18. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 298
  19. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
  20. 2023FireAct: Toward Language Agent Fine-tuningcited by 247
  21. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
  22. 2020MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformerscited by 240
  23. 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 220
  24. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
  25. 2022Active Example Selection for In-Context Learningcited by 195
  26. 2024Trial and Error: Exploration-Based Trajectory Optimization for LLM Agentscited by 194
  27. 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 193
  28. 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 142
  29. 2023Language Models Meet World Models: Embodied Experiences Enhance Language Modelscited by 123
  30. 2023ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Searchcited by 103
  31. 2021RnG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answeringcited by 86
  32. 2024Watch Every Step! LLM Agent Learning via Iterative Step-Level Process Refinementcited by 86
  33. 2020A Survey on Text Classification: From Shallow to Deep Learningcited by 80
  34. 2024RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agentscited by 80
  35. 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Trainingcited by 74
  36. 2023Agent Lumos: Unified and Modular Training for Open-Source Language Agentscited by 72
  37. 2021Complex Knowledge Base Question Answering: A Surveycited by 52
  38. 2024Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inferencecited by 51

50 most cited of 64 All 64 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories
  2. 2025Where LLM Agents Fail and How They can Learn From Failures
  3. 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Search
  4. 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?
  5. 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectories
  6. 2026The Long-Horizon Task Mirage? Diagnosing Where and Why Agentic Systems Break
  7. 2026AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents
  8. 2026Lightweight, Rubric-Guided Trajectory Evaluation for Production AI Agents