mlsanityData to 14 Oct 2026

WEFT: Scaling Tool-Use Post-Training for General-Purpose Agents

arXiv 2609.36887 ↗First posted 29 Sep 2026cs.AIcited by 0

On the map: LLM agents and tool use → Agent skill learning and evolution also fits: Reinforcement learning for LLM agents

Abstract (arXiv)

Recent efforts to scale tool-use post-training have largely centered on the synthesis of executable environments, which constitute only one component of a broader agentic interaction system comprising the environment, task, agent harness, and evaluator. Scaling environments in isolation, however, does not guarantee commensurate gains in model performance, because reliable learning signals depend on coherent interactions among all components of the agentic interaction system. To address this problem, we introduce WEFT (Whole-system Evolution For Tool-use Post-training), which couples scalable agentic interaction system construction, execution-driven self-evolution, and stable post-training. WEFT scales agentic interaction system construction across environment breadth, task complexity, and interaction diversity. Execution-driven self-evolution iteratively uses execution traces and state evidence to attribute failures and revise the responsible components, with fresh rollouts evaluating the changes and providing evidence for subsequent evolution rounds. For stable post-training at scale, WEFT addresses both optimization and execution reliability: prefix-preserving sampling retains verified progress and atomic-turn credit assignment localizes learning signals, while MegaMCP maintains isolated, recoverable state across concurrent rollouts over shared tool services. Extensive experiments across various models and benchmarks demonstrate the effectiveness of WEFT for tool-use post-training. WEFT-8B and WEFT-14B outperform all evaluated matched-size environment-scaling baselines on BFCL V4, τ2-Bench, and Claw-Eval. In particular, WEFT-14B improves over Agent-World-14B by 6.41, 2.23, and 12.27 percentage points. WEFT-35B-A3B further extends these gains to more challenging long-horizon workflow benchmarks, including Toolathlon-Verified and AutomationBench.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 52 of its 58 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

52 of 58 references.

References · 52

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  5. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  6. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  7. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  8. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  9. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  10. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  11. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  12. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
38 more
  1. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  2. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
  3. 2024Automated Design of Agentic Systemscited by 407
  4. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 401
  5. 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 386
  6. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
  7. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
  8. 2024ToolACE: Winning the Points of LLM Function Callingcited by 216
  9. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 198
  10. 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplaycited by 167
  11. 2024The BrowserGym Ecosystem for Web Agent Researchcited by 161
  12. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 142
  13. 2025Agent Lightning: Train ANY AI Agents with Reinforcement Learningcited by 109
  14. 2025The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Executioncited by 85
  15. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 83
  16. 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learningcited by 66
  17. 2026Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agentscited by 64
  18. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
  19. 2026Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflowscited by 57
  20. 2026Endless Terminals: Scaling RL Environments for Terminal Agentscited by 54
  21. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 54
  22. 2025AgentRefine: Enhancing Agent Generalization through Refinement Tuningcited by 53
  23. 2025TaskCraft: Automated Generation of Agentic Taskscited by 51
  24. 2025RLVE: Scaling Up Reinforcement Learning for Language Models with Adaptive Verifiable Environmentscited by 50
  25. 2025Reinforcement Learning with Verifiable yet Noisy Rewards under Imperfect Verifierscited by 45
  26. 2025Magnet: Multi-turn Tool-use Data Synthesis and Distillation via Graph Translationcited by 37
  27. 2026ScaleEnv: Scaling Environment Synthesis from Scratch for Generalist Interactive Tool-Use Agent Trainingcited by 32
  28. 2026InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Trainingcited by 27
  29. 2025Procedural Environment Generation for Tool-Use Agentscited by 24
  30. 2025TinyV: Reducing False Negatives in Verification Improves RL for LLM Reasoningcited by 21
  31. 2026WebGym: Scaling Training Environments for Visual Web Agents with Realistic Taskscited by 19
  32. 2026ClawGym: A Scalable Framework for Building Effective Claw Agentscited by 15
  33. 2026PivotRL: High Accuracy Agentic Post-Training at Low Compute Costcited by 14
  34. 2026EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RLcited by 14
  35. 2026DIVE: Scaling Diversity in Agentic Task Synthesis for Generalizable Tool Usecited by 13
  36. 2026Branching Policy Optimization: Sandbox-Native Language Agent Reinforcement Learningcited by 12
  37. 2026EigenData: A Self-Evolving Multi-Agent Platform for Function-Calling Data Synthesis, Auditing, and Repaircited by 6
  38. 2024Reinforcement Learning for Aligning Large Language Models Agents with Interactive Environments: Quantifying and Mitigating Prompt Overfittingcited by 4

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Scalable Environments Drive Generalizable Agents
  2. 2026SEAL: Synergistic Co-Evolution of Agents and Learning Environments
  3. 2026Echoverse: Deep, Evolving Environments for Training Computer-Use Agents at Scale
  4. 2026Agent Skill Evaluation and Evolution: Frameworks and Benchmarks
  5. 2026Reasoning and Tool-use Compete in Agentic RL:From Quantifying Interference to Disentangled Tuning
  6. 2026EAU: Environment-Agent-User Co-evolution for Training User-Centric Agents
  7. 2026Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environments
  8. 2026TopoCurate:Modeling Interaction Topology for Tool-Use Agent Training