mlsanityData to 14 Oct 2026

Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence

arXiv 2604.18292 ↗First posted 20 Apr 2026cs.AI cs.CLcited by 54

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large language models are increasingly expected to serve as general-purpose agents that interact with external, stateful tool environments. The Model Context Protocol (MCP) and broader agent skills offer a unified interface for connecting agents with scalable real-world services, but training robust agents remains limited by the lack of realistic environments and principled mechanisms for life-long learning. In this paper, we present Agent-World, a self-evolving training arena for advancing general agent intelligence through scalable environments. Agent-World has two main components: (1) Agentic Environment-Task Discovery, which autonomously explores topic-aligned databases and executable tool ecosystems from thousands of real-world environment themes and synthesizes verifiable tasks with controllable difficulty; and (2) Continuous Self-Evolving Agent Training, which combines multi-environment reinforcement learning with a self-evolving agent arena that automatically identifies capability gaps through dynamic task synthesis and drives targeted learning, enabling the co-evolution of agent policies and environments. Across 23 challenging agent benchmarks, Agent-World-8B and 14B consistently outperforms strong proprietary models and environment scaling baselines. Further analyses reveal scaling trends in relation to environment diversity and self-evolution rounds, offering insights for building general agent intelligence.

Key facts. Cited by 54 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 77 of its 107 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

77 of 107 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning10 Feb
  2. 2026AgentSkiller: Scaling Generalist Agent Intelligence through Semantically Integrated Cross-Domain Data Synthesis10 Feb
  3. 2025GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulators22 Dec
  4. 2025From Word to World: Can Large Language Models be Implicit Text-based World Models?21 Dec
  5. 2025AgentEvolver: Towards Efficient Self-Evolving Agent System13 Nov
  6. 2025Real-Time Reasoning Agents in Evolving Environments7 Nov
  7. 2025The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution29 Oct
  8. 2025Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents28 Oct
  9. 2025DeepAgent: A General Reasoning Agent with Scalable Toolsets24 Oct
  10. 2025ARE: Scaling Up Agent Environments and Evaluations21 Sep
  11. 2025Towards General Agentic Intelligence via Environment Scaling16 Sep
  12. 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RL6 Aug
2 more
  1. 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplay4 Apr
  2. 2024Large Language Model-based Human-Agent Collaboration for Complex Task Solving20 Feb

Other references · 63

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  7. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  8. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  9. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  10. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  11. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  12. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
38 more
  1. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  2. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  3. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  4. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  5. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
  6. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
  7. 2025ToolRL: Reward is All Tool Learning Needscited by 362
  8. 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 336
  9. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
  10. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
  11. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 286
  12. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
  13. 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
  14. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  15. 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 190
  16. 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 188
  17. 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 175
  18. 2025Agentic Reinforced Policy Optimizationcited by 172
  19. 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 171
  20. 2025ToRL: Scaling Tool-Integrated RLcited by 169
  21. 2025Thyme: Think Beyond Imagescited by 167
  22. 2025ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learningcited by 161
  23. 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RLcited by 150
  24. 2025DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Researchcited by 114
  25. 2025Reinforcement Learning with Rubric Anchorscited by 113
  26. 2025MCP-Universe: Benchmarking Large Language Models with Real-World Model Context Protocol Serverscited by 96
  27. 2026AutoHarness: improving LLM agents by automatically synthesizing a code harnesscited by 76
  28. 2026XSkill: Continual Learning from Experience and Skills in Multimodal Agentscited by 75
  29. 2024Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Modelscited by 73
  30. 2025Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learningcited by 72
  31. 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedbackcited by 72
  32. 2024KOR-Bench: Benchmarking Language Models on Knowledge-Orthogonal Reasoning Taskscited by 70
  33. 2025TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environmentscited by 69
  34. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
  35. 2025TreePO: Bridging the Gap of Policy Optimization and Efficacy and Inference Efficiency with Heuristic Tree-based Modelingcited by 61
  36. 2025Simulating Environments with Reasoning Models for Agent Trainingcited by 57
  37. 2026MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Serverscited by 53
  38. 2025Improving Retrieval-Augmented Generation through Multi-Agent Reinforcement Learningcited by 39

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 54.

54 papers.

Sort:

By area:

  1. 2026Qwen-AgentWorld: Language World Models for General Agentscited by 28
  2. 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skillscited by 20
  3. 2026SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learningcited by 17
  4. 2026Overeager Coding Agents: Measuring Out-of-Scope Actions on Benign Taskscited by 13
  5. 2026EnvHarness: Awakening Static Worlds for Agent Learningcited by 13
  6. 2026SPADE: Self-Play in Adaptive Synthetic Executable Environmentscited by 12
  7. 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
  8. 2026NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMscited by 7
  9. 2026SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulationcited by 5
  10. 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligencecited by 5
  11. 2026Learning Agentic Policy from Action Guidancecited by 4
  12. 2026PhoneBuddy: Training Open Models for Agentic Phone Usecited by 4
38 more
  1. 2026Living-Harness Is an Interactive-Agent Evolvercited by 4
  2. 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Trainingcited by 4
  3. 2026Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generationcited by 3
  4. 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 3
  5. 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agentscited by 3
  6. 2026Scalable Environments Drive Generalizable Agentscited by 2
  7. 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
  8. 2026AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agentscited by 2
  9. 2026EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learningcited by 2
  10. 2026Apodex 1.1: Scaling Agentic Intelligence for Complex Workcited by 2
  11. 2026AgentBrew: Offline Tool-Use Agent Learning from Raw Real-World Trajectoriescited by 2
  12. 2026OmniaBench: Benchmarking General AI Agents Across Diverse Scenarioscited by 1
  13. 2026SLAI T-Rex: Full-Parameter Post-training of the DeepSeek-V4 Family on Ascend SuperPODcited by 1
  14. 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Designcited by 1
  15. 2026AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scalecited by 1
  16. 2026SynCo: Data Synthesis Co-Training for Self-Evolving LLMs via Multi-Agent Reinforcement Learningcited by 1
  17. 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applicationscited by 0
  18. 2026CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learningcited by 0
  19. 2026CompoWorld: Compositional Environment Scaling for General Agentscited by 0
  20. 2026BEHAVE: Functional Behavior Modeling Enables Self-Improving Agents for Hardware Design and Verificationcited by 0
  21. 2026WEFT: Scaling Tool-Use Post-Training for General-Purpose Agentscited by 0
  22. 2026SkillGym: Training Skill-Use Agents with Automatic Verifiable Environment Generationcited by 0
  23. 2026GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesiscited by 0
  24. 2026Scaling Verifiable Environments for Long-horizon Work Agentscited by 0
  25. 2026HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstentioncited by 0
  26. 2026DAEDALUS: Bootstrapping Agent Memory from Self-Generated Taskscited by 0
  27. 2026Safe, Persistent, and Evolving Agent Harness for Understanding Partially Observable Worldscited by 0
  28. 2026Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learningcited by 0
  29. 2026Scaling Agentic Data for Long-Horizon Terminal Intelligencecited by 0
  30. 2026Rollout-Time Intervention: Unlocking Agentic Reinforcement Learning Beyond Policy Limitscited by 0
  31. 2026GameSmith: Scaling Zero-Sum Self-Play with Synthesised Gamescited by 0
  32. 2026ClawLoop: Self-Improving Agents via Harness-Native Training Loopcited by 0
  33. 2026ProgAgent: Learning Tool Orchestration through Programmatic Trainingcited by 0
  34. 2026WorkBorne: Discovering Agentic Tasks from Real-World Artifact Transitionscited by 0
  35. 2026SkillForgeBench: Evaluating Agent Reliability Grounded in Agent Skill Specificationscited by 0
  36. 2026Recursive Environment Scaling for General Long-Horizon Agentscited by 0
  37. 2026Cowork-Gym: Synthesizing Interactive Work Environments at Scalecited by 0
  38. 2026Agent-Reflex: Teaching Language Agents to Act Reflectivelycited by 0

50 most cited of 54 All 54 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024AgentGym: Evolving Large Language Model-based Agents across Diverse Environments
  2. 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning
  3. 2025Nex-N1: Agentic Models Trained via a Unified Ecosystem for Large-Scale Environment Construction
  4. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence
  5. 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application
  6. 2026C-World: A Computer Use Agent Environment Creator
  7. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems
  8. 2026ToolVerse: Unlocking Massive Environments and Long-Horizon Tasks for Agentic Reinforcement Learning