Youtu-Agent: Scaling Agent Productivity with Automated Generation and Hybrid Policy Optimization
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Existing Large Language Model (LLM) agent frameworks face two significant challenges: high configuration costs and static capabilities. Building a high-quality agent often requires extensive manual effort in tool integration and prompt engineering, while deployed agents struggle to adapt to dynamic environments without expensive fine-tuning. To address these issues, we propose Youtu-Agent, a modular framework designed for the automated generation and continuous evolution of LLM agents. Youtu-Agent features a structured configuration system that decouples execution environments, toolkits, and context management, enabling flexible reuse and automated synthesis. We introduce two generation paradigms: a Workflow mode for standard tasks and a Meta-Agent mode for complex, non-standard requirements, capable of automatically generating tool code, prompts, and configurations. Furthermore, Youtu-Agent establishes a hybrid policy optimization system: (1) an Agent Practice module that enables agents to accumulate experience and improve performance through in-context optimization without parameter updates; and (2) an Agent RL module that integrates with distributed training frameworks to enable scalable and stable reinforcement learning of any Youtu-Agents in an end-to-end, large-scale manner. Experiments demonstrate that Youtu-Agent achieves state-of-the-art performance on WebWalkerQA (71.47%) and GAIA (72.8%) using open-weight models. Our automated generation pipeline achieves over 81% tool synthesis success rate, while the Practice module improves performance on AIME 2024/2025 by +2.7% and +5.4% respectively. Moreover, our Agent RL training achieves 40% speedup with steady performance improvement on 7B LLMs, enhancing coding/reasoning and searching capabilities respectively up to 35% and 21% on Maths and general/multi-hop QA benchmarks.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 18 of its 18 references that are in the map. First posted on arXiv 31 Dec 2025.
Builds on
18 of 18 references.
Closest ancestors · 4
Same direction, newest first
- 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RL6 Aug
- 2024Automated Design of Agentic Systems15 Aug
- 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
Other references · 14
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
- 2025SimpleTIR: End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoningcited by 146
- 2025Agent Lightning: Train ANY AI Agents with Reinforcement Learningcited by 109
2 more
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluationcited by 27
- 2026Position: Agentic Evolution is the Path to Evolving LLMscited by 16
- 2026Evaluating the Search Agent in a Parallel Worldcited by 2
- 2026Rethinking Memory as Continuously Evolving Connectivitycited by 1
- 2026CUAWright: A Minimal Unified Interface for Digital Agentscited by 0
- 2026CUAWright: A Minimal Unified Interface for Digital Agents2 Oct 2026
- 2026Rethinking Memory as Continuously Evolving Connectivity27 May 2026
- 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation26 May 2026
- 2026Evaluating the Search Agent in a Parallel World5 Mar 2026
- 2026Position: Agentic Evolution is the Path to Evolving LLMs30 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025AgentSwift: Efficient LLM Agent Design via Value-guided Hierarchical Search
- 2026AgentFactory: Towards Automated Agentic System Design and Optimization
- 2026From Atomic Actions to Standard Operating Procedures: Iterative Tool Optimization for Self-Evolving LLM Agents
- 2024A Review of Prominent Paradigms for LLM-Based Agents: Tool Use (Including RAG), Planning, and Feedback Learning
- 2024Self-Organized Agents: A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimization
- 2026Agent Gym: A Framework for Continuous Evaluation and Evolution of LLM Agents Through Human-in-the-Loop Feedback
- 2026Utility-Guided Agent Orchestration for Efficient LLM Tool Use
- 2025SEW: Self-Evolving Agentic Workflows for Automated Code Generation