mlsanityData to 13 Oct 2026

AWorld: Orchestrating the Training Recipe for Agentic AI

arXiv 2508.20404 ↗First posted 28 Aug 2025cs.AIcited by 17

On the map: LLM agents and tool use → Reinforcement learning for LLM agents

Abstract (arXiv)

The learning from practice paradigm is crucial for developing capable Agentic AI systems, yet it is severely hampered by inefficient experience generation, a bottleneck especially pronounced in complex benchmarks like GAIA. To address this, we introduce AWorld, an open-source system engineered for large-scale agent-environment interaction. By distributing tasks across a cluster, AWorld accelerates experience collection by 14.6x compared to standard single-node, sequential execution. This critical speedup makes extensive reinforcement learning practical and scalable. Leveraging this capability, we trained a Qwen3-32B-based agent that achieves pass@1 accuracy of 32.23% on the GAIA test set, which surpasses GPT-4o (27.91%) and rivals DeepSeek-V3 (31.89%). Our open-source system and the resulting agent provide a practical blueprint for a complete agentic AI training pipeline, from efficient interaction to demonstrable model improvement.

Key facts. Cited by 17 papers in the map (data through 13 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 27 references that are in the map. First posted on arXiv 28 Aug 2025.

Builds on

17 of 27 references.

References · 17

  1. 2023GPT-4 Technical Reportcited by 18,278
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,072
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
  4. 2025Qwen3 Technical Reportcited by 8,510
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,831
  6. 2024GPT-4o System Cardcited by 4,536
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,714
  8. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,003
  9. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,953
  10. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,289
  11. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,219
  12. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,154
5 more
  1. 2023GAIA: a benchmark for General AI Assistantscited by 1,102
  2. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 348
  3. 2025AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoningcited by 240
  4. 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 168
  5. 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 119

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 9; 2026: 8.

17 papers.

Sort:

By area:

  1. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 200
  2. 2025Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluationcited by 86
  3. 2025Every Step Evolves: Scaling Reinforcement Learning for Trillion-Scale Thinking Modelcited by 52
  4. 2026Hierarchy-of-Groups Policy Optimization for Long-Horizon Agentic Taskscited by 42
  5. 2025WALT: Web Agents that Learn Toolscited by 16
  6. 2026MiroFlow: Towards High-Performance and Robust Open-Source Agent Framework for General Deep Research Taskscited by 14
  7. 2025Co-Sight: Enhancing LLM-Based Agents via Conflict-Aware Meta-Verification and Trustworthy Reasoning with Structured Factscited by 13
  8. 2025RollArt: Disaggregated Multi-Task Agentic RL Training at Scalecited by 12
  9. 2026Autogenesis: A Self-Evolving Agent Protocolcited by 12
  10. 2025FlowSearch: Advancing deep research with dynamic structured knowledge flowcited by 10
  11. 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
  12. 2025HSCodeComp: A Realistic and Expert-level Benchmark for Deep Search Agents in Hierarchical Rule Applicationcited by 5
5 more
  1. 2025Unifying Dynamic Tool Creation and Cross-Task Experience Sharing through Cognitive Memory Architecturecited by 4
  2. 2026Lemon Agent Technical Reportcited by 1
  3. 2026CHILL-Harness: Counterfactual Harness Learning for Efficient Reasoning in Long-Horizon Agentscited by 1
  4. 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Modelscited by 0
  5. 2026WebCraftBench: Evaluating Web Application Generation from a Software Testing Perspectivecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentJet: A Distributed Swarm Training Framework for Agentic Reinforcement Learning
  2. 2025Klear-AgentForge: Forging Agentic Intelligence through Posttraining Scaling
  3. 2026LiteResearcher: A Scalable Agentic RL Training Framework for Deep Research Agent
  4. 2026ARLArena: A Unified Framework for Stable Agentic Reinforcement Learning
  5. 2025GEM: A Gym for Agentic LLMs
  6. 2026Molt: A Scalable PyTorch-Native Training Framework for Agentic Reinforcement Learning
  7. 2026Gaia2: Benchmarking LLM Agents on Dynamic and Asynchronous Environments
  8. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence