Orchard: An Open-Source Agentic Modeling Framework
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Agentic modeling aims to transform LLMs into autonomous agents capable of solving complex tasks through planning, reasoning, tool use, and multi-turn interaction with external environments. We present Orchard, an open-source framework for scalable agentic modeling. At its core is Orchard Env, a lightweight Kubernetes-native environment service that provides reusable primitives for sandbox lifecycle management across task domains, agent harnesses, and training stages. On top of Orchard Env, we build three agentic modeling recipes. Orchard-SWE targets software engineering agents. We introduce credit-assignment supervised fine-tuning and a progression of RL signals: Balanced Adaptive Rollout (BAR) for sparse-reward optimization, on-policy distillation (OPD) and rubric-based process reward (RPR) for dense supervision, and historical experience distillation, which compresses rollouts from prior experiments into a compact value model for inference-time reranking. Built on the Qwen3.5-35B-A3B backbone, Orchard-SWE reaches 69.7% with RPR-based RL and 73.0% with value-model reranking on SWE-bench Verified, setting a new state of the art among open-source methods while approaching frontier systems over 10x larger. Orchard-GUI trains a 4B vision-language computer-use agent using only 0.4K distilled trajectories and 2.2K open-ended tasks, achieving 68.4% average success across WebVoyager, Online-Mind2Web, and DeepShop, making it the strongest open-source model while remaining competitive with proprietary systems. Orchard-Claw targets personal assistant agents. Trained with only 0.2K synthetic tasks, it achieves 59.6% pass@3 on Claw-Eval and 73.9% when paired with the stronger ZeroClaw harness. Collectively, these results demonstrate that a lightweight, open, harness-agnostic environment layer enables reusable agentic data, training recipes, and evaluation protocols across domains.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 45 of its 88 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
45 of 88 references.
Closest ancestors · 3
Same direction, newest first
- 2026ClawGym: A Scalable Framework for Building Effective Claw Agents29 Apr
- 2026Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agents7 Apr
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models8 Aug
Other references · 42
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
- 2025Group Sequence Policy Optimizationcited by 835
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
- 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
30 more
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 244
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learningcited by 168
- 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agentscited by 142
- 2025Act Only When It Pays: Efficient Reinforcement Learning for LLM Reasoning via Selective Rolloutscited by 113
- 2025Not All Rollouts are Useful: Down-Sampling Rollouts in LLM Reinforcement Learningcited by 84
- 2026Qwen3-Coder-Next Technical Reportcited by 71
- 2025rStar2-Agent: Agentic Reasoning Technical Reportcited by 54
- 2024Proposer-Agent-Evaluator(PAE): Autonomous Skill Discovery For Foundation Model Internet Agentscited by 50
- 2025No Prompt Left Behind: Exploiting Zero-Variance Prompts in LLM Reinforcement Learning via Entropy-Guided Advantage Shapingcited by 50
- 2025DeepShop: A Benchmark for Deep Research Shopping Agentscited by 46
- 2025Context as a Tool: Context Management for Long-Horizon SWE-Agentscited by 43
- 2025Kimi-Dev: Agentless Training as Skill Prior for SWE-Agentscited by 41
- 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wildcited by 37
- 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 35
- 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 31
- 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 31
- 2025BugPilot: Complex Bug Generation for Efficient Learning of SWE Skillscited by 30
- 2025Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystemcited by 30
- 2026SWE-rebench V2: Language-Agnostic SWE Task Collection at Scalecited by 29
- 2025Skywork-SWE: Unveiling Data Scaling Laws for Software Engineering in LLMscited by 26
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Trainingcited by 22
- 2026Immersion in the GitHub Universe: Scaling Coding Agents to Masterycited by 22
- 2026ProRL Agent: Rollout-as-a-Service for RL Training of Multi-Turn LLM Agentscited by 20
- 2026WebGym: Scaling Training Environments for Visual Web Agents with Realistic Taskscited by 19
- 2026daVinci-Dev: Agent-native Mid-training for Software Engineeringcited by 18
- 2025Multi-Crit: Benchmarking Multimodal Judges on Pluralistic Criteria-Followingcited by 15
- 2026Train Less, Learn More: Adaptive Efficient Rollout Optimization for Group-Based Reinforcement Learningcited by 14
- 2026daVinci-Env: Open SWE Environment Synthesis at Scalecited by 14
- 2026Claw-Eval-Live: A Live Agent Benchmark for Evolving Real-World Workflowscited by 13
- 2026MegaFlow: Large-Scale Distributed Orchestration System for the Agentic Eracited by 9
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026OpenForgeRL: Train Harness-native Agents in Any Environmentcited by 7
- 2026OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agentscited by 6
- 2026Fara-1.5: Scalable Learning Environments for Computer Use Agentscited by 6
- 2026FrogNano: Training a 4B Coding Agent via Online Task Synthesiscited by 4
- 2026ExecCritic: Learn to Test, Test to Improve for Coding Agentscited by 3
- 2026What Does Multi-Harness RL Learn? Credit Assignment and Portability in Coding Agentscited by 2
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learningcited by 0
- 2026SWE-Stream: Scaling Executable Training Data for SWE Agents via Progressive Construction and Elastic Streamingcited by 0
- 2026SWE-Stream: Scaling Executable Training Data for SWE Agents via Progressive Construction and Elastic Streaming14 Oct 2026
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learning26 Sep 2026
- 2026ExecCritic: Learn to Test, Test to Improve for Coding Agents8 Sep 2026
- 2026FrogNano: Training a 4B Coding Agent via Online Task Synthesis7 Sep 2026
- 2026What Does Multi-Harness RL Learn? Credit Assignment and Portability in Coding Agents3 Sep 2026
- 2026OpenForgeRL: Train Harness-native Agents in Any Environment23 Jul 2026
- 2026Fara-1.5: Scalable Learning Environments for Computer Use Agents18 Jun 2026
- 2026OpenWebRL: Demystifying Online Multi-turn Reinforcement Learning for Visual Web Agents1 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025Cerebrum (AIOS SDK): A Platform for Agent Development, Deployment, Distribution, and Discovery
- 2026Arbor: Tree Search as a Cognition Layer for Autonomous Agents
- 2026Learning to Construct Practical Agentic Systems
- 2025Agentic AI Process Observability: Discovering Behavioral Variability
- 2025A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic System
- 2026AgentFactory: Towards Automated Agentic System Design and Optimization
- 2026EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL
- 2025SynthTools: A Framework for Scaling Synthetic Tools for Agent Development