ScaleEnv: Scaling Environment Synthesis from Scratch for Generalist Interactive Tool-Use Agent Training
Not on the map. Why?
Abstract (arXiv)
Training generalist agents capable of adapting to diverse scenarios requires interactive environments for self-exploration. However, interactive environments remain critically scarce, and existing synthesis methods suffer from significant limitations regarding environmental diversity and scalability. To address these challenges, we introduce ScaleEnv, a framework that constructs fully interactive environments and verifiable tasks entirely from scratch. Specifically, ScaleEnv ensures environment reliability through procedural testing, and guarantees task completeness and solvability via tool dependency graph expansion and executable action verification. By enabling agents to learn through exploration within ScaleEnv, we demonstrate significant performance improvements on unseen, multi-turn tool-use benchmarks such as τ2-Bench and VitaBench, highlighting strong generalization capabilities. Furthermore, we investigate the relationship between increasing number of domains and model generalization performance, providing empirical evidence that scaling environmental diversity is critical for robust agent learning.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 25 of its 32 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
25 of 32 references.
References · 25
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
13 more
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2024ToolACE: Winning the Points of LLM Function Callingcited by 204
- 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplaycited by 158
- 2025ARPO:End-to-End Policy Optimization for GUI Agents with Experience Replaycited by 75
- 2024Feedback Loops With Language Models Drive In-Context Reward Hackingcited by 70
- 2025Simulating Environments with Reasoning Models for Agent Trainingcited by 52
- 2025Towards General Agentic Intelligence via Environment Scalingcited by 51
- 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 46
- 2025Scaling Agent Learning via Experience Synthesiscited by 40
- 2025EvilGenie: A Reward Hacking Benchmarkcited by 24
- 2025Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environmentscited by 19
- 2026ACE-Router: Generalizing History-Aware Routing from MCP Tools to the Agent Webcited by 7
Built on by
Citing papers per year: 2026: 23.
23 papers.
Sort:
By area:
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 35
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Recursive Synthesis for Long-Horizon Terminal Taskscited by 8
- 2026SPADE: Self-Play in Adaptive Synthetic Executable Environmentscited by 6
- 2026SETA: Scaling Environments for Terminal Agentscited by 5
- 2026Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environmentscited by 4
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agentscited by 3
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulationcited by 3
- 2026TRACE: Capability-Targeted Agentic Trainingcited by 2
- 2026RODS: Reward-Driven Online Data Synthesis for Multi-Turn Tool-Use Agentscited by 2
- 2026EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learningcited by 2
11 more
- 2026Apodex 1.1: Scaling Agentic Intelligence for Complex Workcited by 2
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agentscited by 2
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligencecited by 2
- 2026AgentBrew: Offline Tool-Use Agent Learning from Raw Real-World Trajectoriescited by 2
- 2026EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agentcited by 1
- 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applicationscited by 0
- 2026Environments as Scaffold: Enriching Feedback to Bootstrap Self-Evolving Agents in Long-Horizon Taskscited by 0
- 2026Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanismscited by 0
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learningcited by 0
- 2026CompoWorld: Compositional Environment Scaling for General Agentscited by 0
- 2026WEFT: Scaling Tool-Use Post-Training for General-Purpose Agentscited by 0
- 2026WEFT: Scaling Tool-Use Post-Training for General-Purpose Agents29 Sep 2026
- 2026CompoWorld: Compositional Environment Scaling for General Agents27 Sep 2026
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learning26 Sep 2026
- 2026Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanisms23 Sep 2026
- 2026Environments as Scaffold: Enriching Feedback to Bootstrap Self-Evolving Agents in Long-Horizon Tasks8 Sep 2026
- 2026AgentBrew: Offline Tool-Use Agent Learning from Raw Real-World Trajectories5 Sep 2026
- 2026EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agent4 Sep 2026
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence31 Aug 2026
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
- 2026Apodex 1.1: Scaling Agentic Intelligence for Complex Work24 Aug 2026
- 2026SPADE: Self-Play in Adaptive Synthetic Executable Environments19 Aug 2026
- 2026EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning6 Aug 2026
11 more
- 2026Recursive Synthesis for Long-Horizon Terminal Tasks5 Aug 2026
- 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applications25 Jul 2026
- 2026SETA: Scaling Environments for Terminal Agents12 Jul 2026
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation7 Jul 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026RODS: Reward-Driven Online Data Synthesis for Multi-Turn Tool-Use Agents17 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agents8 Jun 2026
- 2026Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environments26 May 2026
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr 2026
- 2026TRACE: Capability-Targeted Agentic Training7 Apr 2026
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 35
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026SETA: Scaling Environments for Terminal Agentscited by 5
- 2026Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environmentscited by 4
- 2026TRACE: Capability-Targeted Agentic Trainingcited by 2
- 2026Apodex 1.1: Scaling Agentic Intelligence for Complex Workcited by 2
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agentscited by 2
- 2026AgentBrew: Offline Tool-Use Agent Learning from Raw Real-World Trajectoriescited by 2
- 2026EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agentcited by 1
- 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applicationscited by 0
- 2026Environments as Scaffold: Enriching Feedback to Bootstrap Self-Evolving Agents in Long-Horizon Taskscited by 0
- 2026Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanismscited by 0
12 most cited of 14 All 14 (JSON)
- 2026WEFT: Scaling Tool-Use Post-Training for General-Purpose Agents29 Sep 2026
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learning26 Sep 2026
- 2026Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanisms23 Sep 2026
- 2026Environments as Scaffold: Enriching Feedback to Bootstrap Self-Evolving Agents in Long-Horizon Tasks8 Sep 2026
- 2026AgentBrew: Offline Tool-Use Agent Learning from Raw Real-World Trajectories5 Sep 2026
- 2026EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agent4 Sep 2026
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
- 2026Apodex 1.1: Scaling Agentic Intelligence for Complex Work24 Aug 2026
- 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applications25 Jul 2026
- 2026SETA: Scaling Environments for Terminal Agents12 Jul 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Learning to Act under Noise: Enhancing Agent Robustness via Noisy Environments26 May 2026
12 newest of 14 All 14 (JSON)
- 2026CompoWorld: Compositional Environment Scaling for General Agents27 Sep 2026
- 2026Recursive Synthesis for Long-Horizon Terminal Tasks5 Aug 2026