Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Large language models are increasingly expected to serve as general-purpose agents that interact with external, stateful tool environments. The Model Context Protocol (MCP) and broader agent skills offer a unified interface for connecting agents with scalable real-world services, but training robust agents remains limited by the lack of realistic environments and principled mechanisms for life-long learning. In this paper, we present Agent-World, a self-evolving training arena for advancing general agent intelligence through scalable environments. Agent-World has two main components: (1) Agentic Environment-Task Discovery, which autonomously explores topic-aligned databases and executable tool ecosystems from thousands of real-world environment themes and synthesizes verifiable tasks with controllable difficulty; and (2) Continuous Self-Evolving Agent Training, which combines multi-environment reinforcement learning with a self-evolving agent arena that automatically identifies capability gaps through dynamic task synthesis and drives targeted learning, enabling the co-evolution of agent policies and environments. Across 23 challenging agent benchmarks, Agent-World-8B and 14B consistently outperforms strong proprietary models and environment scaling baselines. Further analyses reveal scaling trends in relation to environment diversity and self-evolution rounds, offering insights for building general agent intelligence.
Key facts. Cited by 54 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 77 of its 107 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
77 of 107 references.
Closest ancestors · 14
Same direction, newest first
- 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning10 Feb
- 2026AgentSkiller: Scaling Generalist Agent Intelligence through Semantically Integrated Cross-Domain Data Synthesis10 Feb
- 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulators22 Dec
- 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?21 Dec
- 2025AgentEvolver: Towards Efficient Self-Evolving Agent System13 Nov
- 2025Real-Time Reasoning Agents in Evolving Environments7 Nov
- 2025The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution29 Oct
- 2025Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents28 Oct
- 2025DeepAgent: A General Reasoning Agent with Scalable Toolsets24 Oct
- 2025ARE: Scaling Up Agent Environments and Evaluations21 Sep
- 2025Towards General Agentic Intelligence via Environment Scaling16 Sep
- 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RL6 Aug
2 more
Other references · 63
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
38 more
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
- 2025ToolRL: Reward is All Tool Learning Needscited by 362
- 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 336
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
- 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 286
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
- 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 190
- 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 188
- 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
- 2025Agentic Reinforced Policy Optimizationcited by 172
- 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 171
- 2025ToRL: Scaling Tool-Integrated RLcited by 169
- 2025Thyme: Think Beyond Imagescited by 167
- 2025ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learningcited by 161
- 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RLcited by 150
- 2025DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Researchcited by 114
- 2025Reinforcement Learning with Rubric Anchorscited by 113
- 2025MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Serverscited by 96
- 2026AutoHarness: improving LLM agents by automatically synthesizing a code harnesscited by 76
- 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 75
- 2024Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Modelscited by 73
- 2025Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learningcited by 72
- 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedbackcited by 72
- 2024KOR-Bench: Benchmarking Language Models on Knowledge-Orthogonal Reasoning Taskscited by 70
- 2025TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environmentscited by 69
- 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
- 2025TreePO: Bridging the Gap of Policy Optimization and Efficacy and Inference Efficiency with Heuristic Tree-based Modelingcited by 61
- 2025Simulating Environments with Reasoning Models for Agent Trainingcited by 57
- 2026MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Serverscited by 53
- 2025Improving Retrieval-Augmented Generation through Multi-Agent Reinforcement Learningcited by 39
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2026: 54.
54 papers.
Sort:
By area:
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 28
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skillscited by 20
- 2026SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learningcited by 17
- 2026Overeager Coding Agents: Measuring Out-of-Scope Actions on Benign Taskscited by 13
- 2026EnvHarness: Awakening Static Worlds for Agent Learningcited by 13
- 2026SPADE: Self-Play in Adaptive Synthetic Executable Environmentscited by 12
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
- 2026NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMscited by 7
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulationcited by 5
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligencecited by 5
- 2026Learning Agentic Policy from Action Guidancecited by 4
- 2026PhoneBuddy: Training Open Models for Agentic Phone Usecited by 4
38 more
- 2026Living-Harness Is an Interactive-Agent Evolvercited by 4
- 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Trainingcited by 4
- 2026Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generationcited by 3
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 3
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agentscited by 3
- 2026Scalable Environments Drive Generalizable Agentscited by 2
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
- 2026AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agentscited by 2
- 2026EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learningcited by 2
- 2026Apodex 1.1: Scaling Agentic Intelligence for Complex Workcited by 2
- 2026AgentBrew: Offline Tool-Use Agent Learning from Raw Real-World Trajectoriescited by 2
- 2026OmniaBench: Benchmarking General AI Agents Across Diverse Scenarioscited by 1
- 2026SLAI T-Rex: Full-Parameter Post-training of the DeepSeek-V4 Family on Ascend SuperPODcited by 1
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Designcited by 1
- 2026AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scalecited by 1
- 2026SynCo: Data Synthesis Co-Training for Self-Evolving LLMs via Multi-Agent Reinforcement Learningcited by 1
- 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applicationscited by 0
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learningcited by 0
- 2026CompoWorld: Compositional Environment Scaling for General Agentscited by 0
- 2026BEHAVE: Functional Behavior Modeling Enables Self-Improving Agents for Hardware Design and Verificationcited by 0
- 2026WEFT: Scaling Tool-Use Post-Training for General-Purpose Agentscited by 0
- 2026SkillGym: Training Skill-Use Agents with Automatic Verifiable Environment Generationcited by 0
- 2026GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesiscited by 0
- 2026Scaling Verifiable Environments for Long-horizon Work Agentscited by 0
- 2026HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstentioncited by 0
- 2026DAEDALUS: Bootstrapping Agent Memory from Self-Generated Taskscited by 0
- 2026Safe, Persistent, and Evolving Agent Harness for Understanding Partially Observable Worldscited by 0
- 2026Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learningcited by 0
- 2026Scaling Agentic Data for Long-Horizon Terminal Intelligencecited by 0
- 2026Rollout-Time Intervention: Unlocking Agentic Reinforcement Learning Beyond Policy Limitscited by 0
- 2026GameSmith: Scaling Zero-Sum Self-Play with Synthesised Gamescited by 0
- 2026ClawLoop: Self-Improving Agents via Harness-Native Training Loopcited by 0
- 2026ProgAgent: Learning Tool Orchestration through Programmatic Trainingcited by 0
- 2026WorkBorne: Discovering Agentic Tasks from Real-World Artifact Transitionscited by 0
- 2026SkillForgeBench: Evaluating Agent Reliability Grounded in Agent Skill Specificationscited by 0
- 2026Recursive Environment Scaling for General Long-Horizon Agentscited by 0
- 2026Cowork-Gym: Synthesizing Interactive Work Environments at Scalecited by 0
- 2026Agent-Reflex: Teaching Language Agents to Act Reflectivelycited by 0
50 most cited of 54 All 54 (JSON)
- 2026Player-1: Learning to Play from Synthetic Experience14 Oct 2026
- 2026Interlock: From Local Correctness to Task Completion in Long-Horizon Agents14 Oct 2026
- 2026Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards13 Oct 2026
- 2026WorkRover: Scaling Long-Horizon Cowork Agent Training Via Recursive Environment Evolution13 Oct 2026
- 2026Agent-Reflex: Teaching Language Agents to Act Reflectively13 Oct 2026
- 2026Cowork-Gym: Synthesizing Interactive Work Environments at Scale13 Oct 2026
- 2026Recursive Environment Scaling for General Long-Horizon Agents12 Oct 2026
- 2026SkillForgeBench: Evaluating Agent Reliability Grounded in Agent Skill Specifications10 Oct 2026
- 2026WorkBorne: Discovering Agentic Tasks from Real-World Artifact Transitions10 Oct 2026
- 2026ProgAgent: Learning Tool Orchestration through Programmatic Training10 Oct 2026
- 2026ClawLoop: Self-Improving Agents via Harness-Native Training Loop9 Oct 2026
- 2026Rollout-Time Intervention: Unlocking Agentic Reinforcement Learning Beyond Policy Limits9 Oct 2026
38 more
- 2026Scaling Agentic Data for Long-Horizon Terminal Intelligence9 Oct 2026
- 2026Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning8 Oct 2026
- 2026Safe, Persistent, and Evolving Agent Harness for Understanding Partially Observable Worlds8 Oct 2026
- 2026SynCo: Data Synthesis Co-Training for Self-Evolving LLMs via Multi-Agent Reinforcement Learning8 Oct 2026
- 2026DAEDALUS: Bootstrapping Agent Memory from Self-Generated Tasks6 Oct 2026
- 2026HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstention5 Oct 2026
- 2026Scaling Verifiable Environments for Long-horizon Work Agents4 Oct 2026
- 2026GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis30 Sep 2026
- 2026SkillGym: Training Skill-Use Agents with Automatic Verifiable Environment Generation29 Sep 2026
- 2026WEFT: Scaling Tool-Use Post-Training for General-Purpose Agents29 Sep 2026
- 2026BEHAVE: Functional Behavior Modeling Enables Self-Improving Agents for Hardware Design and Verification28 Sep 2026
- 2026CompoWorld: Compositional Environment Scaling for General Agents27 Sep 2026
- 2026GameSmith: Scaling Zero-Sum Self-Play with Synthesised Games26 Sep 2026
- 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learning26 Sep 2026
- 2026AgentBrew: Offline Tool-Use Agent Learning from Raw Real-World Trajectories5 Sep 2026
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence31 Aug 2026
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
- 2026Apodex 1.1: Scaling Agentic Intelligence for Complex Work24 Aug 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scale21 Aug 2026
- 2026EnvHarness: Awakening Static Worlds for Agent Learning20 Aug 2026
- 2026SPADE: Self-Play in Adaptive Synthetic Executable Environments19 Aug 2026
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design10 Aug 2026
- 2026EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning6 Aug 2026
- 2026AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents6 Aug 2026
- 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training30 Jul 2026
- 2026Living-Harness Is an Interactive-Agent Evolver29 Jul 2026
- 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applications25 Jul 2026
- 2026SLAI T-Rex: Full-Parameter Post-training of the DeepSeek-V4 Family on Ascend SuperPOD22 Jul 2026
- 2026OmniaBench: Benchmarking General AI Agents Across Diverse Scenarios16 Jul 2026
- 2026NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMs15 Jul 2026
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy13 Jul 2026
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation7 Jul 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026PhoneBuddy: Training Open Models for Agentic Phone Use22 Jun 2026
- 2026Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generation28 May 2026
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skills20 May 2026
50 newest of 54 All 54 (JSON)
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skillscited by 20
- 2026SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learningcited by 17
- 2026Overeager Coding Agents: Measuring Out-of-Scope Actions on Benign Taskscited by 13
- 2026EnvHarness: Awakening Static Worlds for Agent Learningcited by 13
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
- 2026NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMscited by 7
- 2026Learning Agentic Policy from Action Guidancecited by 4
- 2026PhoneBuddy: Training Open Models for Agentic Phone Usecited by 4
- 2026Living-Harness Is an Interactive-Agent Evolvercited by 4
- 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Trainingcited by 4
- 2026Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generationcited by 3
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 3
12 most cited of 34 All 34 (JSON)
- 2026Player-1: Learning to Play from Synthetic Experience14 Oct 2026
- 2026Interlock: From Local Correctness to Task Completion in Long-Horizon Agents14 Oct 2026
- 2026Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards13 Oct 2026
- 2026Agent-Reflex: Teaching Language Agents to Act Reflectively13 Oct 2026
- 2026WorkBorne: Discovering Agentic Tasks from Real-World Artifact Transitions10 Oct 2026
- 2026ProgAgent: Learning Tool Orchestration through Programmatic Training10 Oct 2026
- 2026ClawLoop: Self-Improving Agents via Harness-Native Training Loop9 Oct 2026
- 2026Scaling Agentic Data for Long-Horizon Terminal Intelligence9 Oct 2026
- 2026Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning8 Oct 2026
- 2026Safe, Persistent, and Evolving Agent Harness for Understanding Partially Observable Worlds8 Oct 2026
- 2026SynCo: Data Synthesis Co-Training for Self-Evolving LLMs via Multi-Agent Reinforcement Learning8 Oct 2026
- 2026DAEDALUS: Bootstrapping Agent Memory from Self-Generated Tasks6 Oct 2026
12 newest of 34 All 34 (JSON)
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulationcited by 5
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligencecited by 5
- 2026Rollout-Time Intervention: Unlocking Agentic Reinforcement Learning Beyond Policy Limitscited by 0
- 2026Rollout-Time Intervention: Unlocking Agentic Reinforcement Learning Beyond Policy Limits9 Oct 2026
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence31 Aug 2026
- 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation7 Jul 2026
- 2026Scalable Environments Drive Generalizable Agentscited by 2
- 2026AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scalecited by 1
- 2026CompoWorld: Compositional Environment Scaling for General Agentscited by 0
- 2026GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesiscited by 0
- 2026Scaling Verifiable Environments for Long-horizon Work Agentscited by 0
- 2026SkillForgeBench: Evaluating Agent Reliability Grounded in Agent Skill Specificationscited by 0
- 2026Recursive Environment Scaling for General Long-Horizon Agentscited by 0
- 2026Cowork-Gym: Synthesizing Interactive Work Environments at Scalecited by 0
- 2026WorkRover: Scaling Long-Horizon Cowork Agent Training Via Recursive Environment Evolutioncited by 0
- 2026WorkRover: Scaling Long-Horizon Cowork Agent Training Via Recursive Environment Evolution13 Oct 2026
- 2026Cowork-Gym: Synthesizing Interactive Work Environments at Scale13 Oct 2026
- 2026Recursive Environment Scaling for General Long-Horizon Agents12 Oct 2026
- 2026SkillForgeBench: Evaluating Agent Reliability Grounded in Agent Skill Specifications10 Oct 2026
- 2026Scaling Verifiable Environments for Long-horizon Work Agents4 Oct 2026
- 2026GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis30 Sep 2026
- 2026CompoWorld: Compositional Environment Scaling for General Agents27 Sep 2026
- 2026AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scale21 Aug 2026
- 2026Scalable Environments Drive Generalizable Agents18 May 2026
Similar, not cited
Close in wording, no citation either way
- 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environments
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning
- 2025Nex-N1: Agentic Models Trained via a Unified Ecosystem for Large-Scale Environment Construction
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application
- 2026C-World: A Computer Use Agent Environment Creator
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems
- 2026ToolVerse: Unlocking Massive Environments and Long-Horizon Tasks for Agentic Reinforcement Learning