mlsanityData to 14 Oct 2026

GRADE: Graph Representation of LLM Agent Dependency and Execution

arXiv 2606.22741 ↗First posted 22 Jun 2026cs.LGcited by 4

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

Traces record what LLM agents did, leaving implicit what each step relied on. GRADE holds both in one graph; six published graph views are its projections. Execution edges come free; each costly dependency edge is graded as observed in the trace, declared by added logging, or inferred under an assumption, a schema we test one grade at a time. We recover the dependency layer from six tool-use, coding, and web corpora and measure its failure-prediction gain over run size. First, over a linear run-size baseline, it improves prediction on three corpora, but the gain depends on the learner and task sampling. On held-out corpora the layer stays above chance where run size does not, under one learner, with the same task-sampling caveat. Second, structure can pass for signal it does not carry: a layer inferred under full history restates run size. Within a corpus, a preregistered test does not separate the recovered layer from a degree-matched counterfeit that rewires each step's dependencies but keeps their number. The recovered layer's largest transfer lead over it reverses when the held-out corpus's task family is withheld. Before crediting structure, grade each edge, keep a run-size baseline, and score degree-matched attachment controls.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 32 of its 58 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

32 of 58 references.

References · 32

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2018How Powerful are Graph Neural Networks?cited by 4,393
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  4. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  5. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  6. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  7. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  8. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 728
  9. 2019Designing and Interpreting Probes with Control Taskscited by 640
  10. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  11. 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
  12. 2020Heterogeneous Graph Transformercited by 582
20 more
  1. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 336
  2. 2019Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networkscited by 272
  3. 2019Representation Learning for Dynamic Graphs: A Surveycited by 265
  4. 2017Learning to Represent Programs with Graphscited by 220
  5. 2025AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectoriescited by 108
  6. 2025Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectoriescited by 81
  7. 2024AgentOps: Enabling Observability of LLM Agentscited by 46
  8. 2025AgentArmor: Enforcing Program Analysis on Agent Runtime Trace to Defend Against Prompt Injectioncited by 46
  9. 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agentscited by 37
  10. 2025GUARDIAN: Safeguarding LLM Multi-Agent Collaborations with Temporal Graph Modelingcited by 36
  11. 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 24
  12. 2025DyFlow: Dynamic Workflow Framework for Agentic Reasoningcited by 23
  13. 2025GNNs as Predictors of Agentic Workflow Performancescited by 17
  14. 2018On Tree-Based Neural Sentence Modelingcited by 16
  15. 2026CodeTracer: Towards Traceable Agent Statescited by 16
  16. 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Searchcited by 12
  17. 2025Topology Matters: Measuring Memory Leakage in Multi-Agent LLMscited by 11
  18. 2025Few-Shot Graph Out-of-Distribution Detection with LLMscited by 6
  19. 2026When Only the Final Text Survives: Implicit Execution Tracing for Multi-Agent Auditingcited by 3
  20. 2026Tool-Call Dependency Structure is Linearly Decodable in LLM Agent Residual Streamscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Insights Generator: Systematic Corpus-Level Trace Diagnostics for LLM Agents
  2. 2026Skills Are Not Islands: Measuring Dependency and Risk in Agent Skill Supply Chains
  3. 2026Which Models Are Our Models Built On? Auditing Invisible Dependencies in Modern LLMs
  4. 2026EDGE: Error Dependency Graph-Guided Multi-Error Attribution in Multi-Agent LLM Systems
  5. 2026TraceLab: Characterizing Coding Agent Workloads for LLM Serving
  6. 2026AllocBench: Measuring Online Tool Allocation Capability in LLM Agents
  7. 2026Grading the Grader: Lessons from Evaluating an Agentic Data Analysis System
  8. 2026Skill-Use: Can LLMs Actually Use Skills in Agentic Harnesses?