mlsanityData to 14 Oct 2026

Orchard: An Open-Source Agentic Modeling Framework

arXiv 2605.15040 ↗First posted 14 May 2026cs.AI cs.CLcited by 8

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Agentic modeling aims to transform LLMs into autonomous agents capable of solving complex tasks through planning, reasoning, tool use, and multi-turn interaction with external environments. We present Orchard, an open-source framework for scalable agentic modeling. At its core is Orchard Env, a lightweight Kubernetes-native environment service that provides reusable primitives for sandbox lifecycle management across task domains, agent harnesses, and training stages. On top of Orchard Env, we build three agentic modeling recipes. Orchard-SWE targets software engineering agents. We introduce credit-assignment supervised fine-tuning and a progression of RL signals: Balanced Adaptive Rollout (BAR) for sparse-reward optimization, on-policy distillation (OPD) and rubric-based process reward (RPR) for dense supervision, and historical experience distillation, which compresses rollouts from prior experiments into a compact value model for inference-time reranking. Built on the Qwen3.5-35B-A3B backbone, Orchard-SWE reaches 69.7% with RPR-based RL and 73.0% with value-model reranking on SWE-bench Verified, setting a new state of the art among open-source methods while approaching frontier systems over 10x larger. Orchard-GUI trains a 4B vision-language computer-use agent using only 0.4K distilled trajectories and 2.2K open-ended tasks, achieving 68.4% average success across WebVoyager, Online-Mind2Web, and DeepShop, making it the strongest open-source model while remaining competitive with proprietary systems. Orchard-Claw targets personal assistant agents. Trained with only 0.2K synthetic tasks, it achieves 59.6% pass@3 on Claw-Eval and 73.9% when paired with the stronger ZeroClaw harness. Collectively, these results demonstrate that a lightweight, open, harness-agnostic environment layer enables reusable agentic data, training recipes, and evaluation protocols across domains.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 45 of its 88 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

45 of 88 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026ClawGym: A Scalable Framework for Building Effective Claw Agents29 Apr
  2. 2026Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agents7 Apr
  3. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models8 Aug

Other references · 42

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  5. 2025Qwen3-VL Technical Reportcited by 2,793
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  7. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
  8. 2025Group Sequence Policy Optimizationcited by 835
  9. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
  10. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
  11. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  12. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
30 more
  1. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 244
  2. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learningcited by 168
  3. 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agentscited by 142
  4. 2025Act Only When It Pays: Efficient Reinforcement Learning for LLM Reasoning via Selective Rolloutscited by 113
  5. 2025Not All Rollouts are Useful: Down-Sampling Rollouts in LLM Reinforcement Learningcited by 84
  6. 2026Qwen3-Coder-Next Technical Reportcited by 71
  7. 2025rStar2-Agent: Agentic Reasoning Technical Reportcited by 54
  8. 2024Proposer-Agent-Evaluator(PAE): Autonomous Skill Discovery For Foundation Model Internet Agentscited by 50
  9. 2025No Prompt Left Behind: Exploiting Zero-Variance Prompts in LLM Reinforcement Learning via Entropy-Guided Advantage Shapingcited by 50
  10. 2025DeepShop: A Benchmark for Deep Research Shopping Agentscited by 46
  11. 2025Context as a Tool: Context Management for Long-Horizon SWE-Agentscited by 43
  12. 2025Kimi-Dev: Agentless Training as Skill Prior for SWE-Agentscited by 41
  13. 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wildcited by 37
  14. 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 35
  15. 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 31
  16. 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 31
  17. 2025BugPilot: Complex Bug Generation for Efficient Learning of SWE Skillscited by 30
  18. 2025Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystemcited by 30
  19. 2026SWE-rebench V2: Language-Agnostic SWE Task Collection at Scalecited by 29
  20. 2025Skywork-SWE: Unveiling Data Scaling Laws for Software Engineering in LLMscited by 26
  21. 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Trainingcited by 22
  22. 2026Immersion in the GitHub Universe: Scaling Coding Agents to Masterycited by 22
  23. 2026ProRL Agent: Rollout-as-a-Service for RL Training of Multi-Turn LLM Agentscited by 20
  24. 2026WebGym: Scaling Training Environments for Visual Web Agents with Realistic Taskscited by 19
  25. 2026daVinci-Dev: Agent-native Mid-training for Software Engineeringcited by 18
  26. 2025Multi-Crit: Benchmarking Multimodal Judges on Pluralistic Criteria-Followingcited by 15
  27. 2026Train Less, Learn More: Adaptive Efficient Rollout Optimization for Group-Based Reinforcement Learningcited by 14
  28. 2026daVinci-Env: Open SWE Environment Synthesis at Scalecited by 14
  29. 2026Claw-Eval-Live: A Live Agent Benchmark for Evolving Real-World Workflowscited by 13
  30. 2026MegaFlow: Large-Scale Distributed Orchestration System for the Agentic Eracited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Cerebrum (AIOS SDK): A Platform for Agent Development, Deployment, Distribution, and Discovery
  2. 2026Arbor: Tree Search as a Cognition Layer for Autonomous Agents
  3. 2026Learning to Construct Practical Agentic Systems
  4. 2025Agentic AI Process Observability: Discovering Behavioral Variability
  5. 2025A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic System
  6. 2026AgentFactory: Towards Automated Agentic System Design and Optimization
  7. 2026EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL
  8. 2025SynthTools: A Framework for Scaling Synthetic Tools for Agent Development