mlsanityData to 7 Oct 2026

Shepherd: Enabling Programmable Meta-Agents via Reversible Agentic Execution Traces

arXiv 2605.10913 ↗First posted 11 May 2026cs.AI cs.PL cs.SEcited by 8

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

As LLM agent systems take on more complex tasks, they increasingly rely on meta-agents: higher-order agents that create, operate on and manage other agents. Meta-agent operations such as coordinating agents, halting risky actions before execution, or repairing failed runs, require runtime manipulation of agentic execution. Yet existing agentic substrates make this difficult: they expose only transcripts and environment snapshots, forcing meta-agents to build ad hoc tooling to reconstruct and operate over full execution state. Therefore, we introduce Shepherd, a Python substrate grounded in functional programming principles, where an agent's execution is itself a first-class object that a meta-agent can easily inspect and transform. Every model action, tool call, and environment change becomes a structured event in a reversible, Git-like execution trace, where any past state can be reverted 5x faster than docker commit and fork. Three example use cases show Shepherd's versatility: (1) a supervisor meta-agent prevents conflicts among parallel coding agents, lifting pair-coding pass rate from 28.8% to 54.7% on CooperBench; (2) a counterfactual optimization meta-agent repairs agent workflows by proposing edits and replaying runs from the point of changed behavior, outperforming MetaHarness on Terminal-Bench 2.0 by 12.8% with 58% lower wall-clock; (3) a training meta-agent picks fork points during rollouts to improve credit assignment in long-horizon agentic RL, doubling GRPO's uplift on Terminal-Bench 2.0. We open-source Shepherd to enable principled and efficient operations over agentic execution for both users and meta-agents.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 38 of its 52 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

38 of 52 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026AgentSPEX: An Agent SPecification and EXecution Language14 Apr
  2. 2025AgentGit: A Version Control Framework for Reliable and Scalable LLM-Powered Multi-Agent Systems1 Nov
  3. 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?3 Sep
  4. 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
  5. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug

Other references · 33

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  5. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  7. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
  8. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  9. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
  10. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  11. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  12. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
21 more
  1. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
  2. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  3. 2024Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learningcited by 238
  4. 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
  5. 2025Generalizing Verifiable Instruction Followingcited by 178
  6. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
  7. 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 100
  8. 2025Tree Search for LLM Agent Reinforcement Learningcited by 73
  9. 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 68
  10. 2024Trace is the Next AutoDiff: Generative Optimization with Rich Feedback, Execution Traces, and LLMscited by 62
  11. 2026Hindsight Credit Assignment for Long-Horizon LLM Agentscited by 51
  12. 2026Endless Terminals: Scaling RL Environments for Terminal Agentscited by 43
  13. 2026Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharingcited by 32
  14. 2025How to Train Your Advisor: Steering Black-Box LLMs with Advisor Modelscited by 20
  15. 2026CooperBench: Why Coding Agents Cannot be Your Teammates Yetcited by 20
  16. 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Taskscited by 18
  17. 2025Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systemscited by 11
  18. 2026Scaling Test-Time Compute for Agentic Codingcited by 11
  19. 2026Combee: Scaling Prompt Learning for Self-Improving Language Model Agentscited by 8
  20. 2019Interaction Trees: Representing Recursive and Impure Programs in Coqcited by 7
  21. 2026Fork, Explore, Commit: OS Primitives for Agentic Explorationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026LACUNA: Safe Agents as Recursive Program Holes
  2. 2026CaveAgent: Transforming LLMs into Stateful Runtime Operators
  3. 2026AgentFactory: A Self-Evolving Framework Through Executable Subagent Accumulation and Reuse
  4. 2026ROMA: Recursive Open Meta-Agent Framework for Long-Horizon Multi-Agent Systems
  5. 2026Cordon: Semantic Transactions for Tool-Using LLM Agents
  6. 2026From Agent Loops to Structured Graphs:A Scheduler-Theoretic Framework for LLM Agent Execution
  7. 2026AgentForge: Execution-Grounded Multi-Agent LLM Framework for Autonomous Software Engineering
  8. 2026openJiuwen: Beyond Static Harnesses for Long-Horizon Coding Agents