Shepherd: Enabling Programmable Meta-Agents via Reversible Agentic Execution Traces
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
As LLM agent systems take on more complex tasks, they increasingly rely on meta-agents: higher-order agents that create, operate on and manage other agents. Meta-agent operations such as coordinating agents, halting risky actions before execution, or repairing failed runs, require runtime manipulation of agentic execution. Yet existing agentic substrates make this difficult: they expose only transcripts and environment snapshots, forcing meta-agents to build ad hoc tooling to reconstruct and operate over full execution state. Therefore, we introduce Shepherd, a Python substrate grounded in functional programming principles, where an agent's execution is itself a first-class object that a meta-agent can easily inspect and transform. Every model action, tool call, and environment change becomes a structured event in a reversible, Git-like execution trace, where any past state can be reverted 5x faster than docker commit and fork. Three example use cases show Shepherd's versatility: (1) a supervisor meta-agent prevents conflicts among parallel coding agents, lifting pair-coding pass rate from 28.8% to 54.7% on CooperBench; (2) a counterfactual optimization meta-agent repairs agent workflows by proposing edits and replaying runs from the point of changed behavior, outperforming MetaHarness on Terminal-Bench 2.0 by 12.8% with 58% lower wall-clock; (3) a training meta-agent picks fork points during rollouts to improve credit assignment in long-horizon agentic RL, doubling GRPO's uplift on Terminal-Bench 2.0. We open-source Shepherd to enable principled and efficient operations over agentic execution for both users and meta-agents.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 38 of its 52 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
38 of 52 references.
Closest ancestors · 5
Same direction, newest first
- 2026AgentSPEX: An Agent SPecification and EXecution Language14 Apr
- 2025AgentGit: A Version Control Framework for Reliable and Scalable LLM-Powered Multi-Agent Systems1 Nov
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?3 Sep
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
Other references · 33
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
21 more
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
- 2024Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learningcited by 238
- 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
- 2025Generalizing Verifiable Instruction Followingcited by 178
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
- 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 100
- 2025Tree Search for LLM Agent Reinforcement Learningcited by 73
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 68
- 2024Trace is the Next AutoDiff: Generative Optimization with Rich Feedback, Execution Traces, and LLMscited by 62
- 2026Hindsight Credit Assignment for Long-Horizon LLM Agentscited by 51
- 2026Endless Terminals: Scaling RL Environments for Terminal Agentscited by 43
- 2026Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharingcited by 32
- 2025How to Train Your Advisor: Steering Black-Box LLMs with Advisor Modelscited by 20
- 2026CooperBench: Why Coding Agents Cannot be Your Teammates Yetcited by 20
- 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Taskscited by 18
- 2025Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systemscited by 11
- 2026Scaling Test-Time Compute for Agentic Codingcited by 11
- 2026Combee: Scaling Prompt Learning for Self-Improving Language Model Agentscited by 8
- 2019Interaction Trees: Representing Recursive and Impure Programs in Coqcited by 7
- 2026Fork, Explore, Commit: OS Primitives for Agentic Explorationcited by 5
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Safe to Resume? Breaking Execution Continuity of Agent Execution via Rollbackcited by 2
- 2026Claim Plane: Enforceable Change Intents and Dynamic Scope for Parallel Coding Agentscited by 1
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gapscited by 1
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Modelcited by 1
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 1
- 2026Dalek: A Constructive Agent Machinecited by 0
- 2026When Tool Calls Succeed but Workflows Fail: Anomalies at the Agent-Tool Boundarycited by 0
- 2026OpenCollab: A Multi-Agent Coding Framework with Programmable Collaboration and Controllable Runtimecited by 0
- 2026OpenCollab: A Multi-Agent Coding Framework with Programmable Collaboration and Controllable Runtime29 Sep 2026
- 2026When Tool Calls Succeed but Workflows Fail: Anomalies at the Agent-Tool Boundary14 Sep 2026
- 2026Dalek: A Constructive Agent Machine3 Sep 2026
- 2026Safe to Resume? Breaking Execution Continuity of Agent Execution via Rollback29 Aug 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Model14 Aug 2026
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gaps27 Jul 2026
- 2026Claim Plane: Enforceable Change Intents and Dynamic Scope for Parallel Coding Agents24 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026LACUNA: Safe Agents as Recursive Program Holes
- 2026CaveAgent: Transforming LLMs into Stateful Runtime Operators
- 2026AgentFactory: A Self-Evolving Framework Through Executable Subagent Accumulation and Reuse
- 2026ROMA: Recursive Open Meta-Agent Framework for Long-Horizon Multi-Agent Systems
- 2026Cordon: Semantic Transactions for Tool-Using LLM Agents
- 2026From Agent Loops to Structured Graphs:A Scheduler-Theoretic Framework for LLM Agent Execution
- 2026AgentForge: Execution-Grounded Multi-Agent LLM Framework for Autonomous Software Engineering
- 2026openJiuwen: Beyond Static Harnesses for Long-Horizon Coding Agents