MetaAgent-X : Breaking the Ceiling of Automatic Multi-Agent Systems via End-to-End Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Automatic multi-agent systems aim to instantiate agent workflows without relying on manually designed or fixed orchestration. However, existing automatic MAS approaches remain only partially adaptive: they either perform training-free test-time search or optimize the meta-level designer while keeping downstream execution agents frozen, which creating a frozen-executor ceiling and leaving the end-to-end training of self-designing and self-executing agentic models unexplored. To address this, we introduce MetaAgent-X, an end-to-end reinforcement learning framework that jointly optimizes automatic MAS design and execution. MetaAgent-X enables script-based MAS generation, execution rollout collection, and credit assignment for both designer and executor trajectories. To support stable and scalable optimization, we propose Executor Designer Hierarchical Rollout and Stagewise Co-evolution to improve training stability and expose the dynamics of designer-executor co-evolution. MetaAgent-X consistently outperforms existing automatic MAS baselines, achieving up to 21.7% gains. Comprehensive ablations show that both designer and executor improve throughout training, and that effective automatic MAS learning follows a stagewise co-evolution process. These results establish end-to-end trainable automatic MAS as a practical paradigm for building self-designing and self-executing agentic models.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
34 of 43 references.
References · 34
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,099
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 903
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2024AFlow: Automating Agentic Workflow Generationcited by 395
- 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 357
- 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 182
- 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 162
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecyclecited by 129
- 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 102
22 more
- 2017A Survey of Learning in Multiagent Environments: Dealing with Non-Stationaritycited by 93
- 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 90
- 2024CodeR: Issue Resolving with Multi-Agent and Task Graphscited by 89
- 2025MAPoRL: Multi-Agent Post-Co-Training for Collaborative Large Language Models with Reinforcement Learningcited by 80
- 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RLcited by 75
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 68
- 2024Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent Systemcited by 63
- 2025Multi-Agent Evolve: LLM Self-Improve through Co-evolutioncited by 58
- 2025FlowReasoner: Reinforcing Query-Level Meta-Agentscited by 56
- 2025ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimizationcited by 50
- 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systemscited by 45
- 2025OrcaLoca: An LLM Agent Framework for Software Issue Localizationcited by 43
- 2025Scaling Agent Learning via Experience Synthesiscited by 40
- 2025MAM: Modular Multi-Agent Framework for Multi-Modal Medical Diagnosis via Role-Specialized Collaborationcited by 39
- 2025Agent-R1: A Unified and Modular Framework for Agentic Reinforcement Learningcited by 28
- 2025Stronger-MAS: Multi-Agent Reinforcement Learning for Collaborative LLMscited by 25
- 2025Learning to Orchestrate Agents in Natural Language with the Conductorcited by 22
- 2025MetaAgent: Automatically Constructing Multi-Agent Systems Based on Finite State Machinescited by 17
- 2026Dr. MAS: Stable Reinforcement Learning for Multi-Agent LLM Systemscited by 15
- 2023Dealing With Non-stationarity in Decentralized Cooperative Multi-Agent Deep Reinforcement Learning via Multi-Timescale Learningcited by 12
- 2026EVA: Efficient Reinforcement Learning for End-to-End Video Agentcited by 5
- 2025Marco: Configurable Graph-Based Task Solving and Multi-AI Agents Framework for Hardware Designcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Inefficiencies of Meta Agents for Agent Design
- 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems
- 2026OptiMAS: Automatically Optimize Multi-Agent System
- 2026Learning to Evolve: A Self-Improving Framework for Multi-Agent Systems via Textual Parameter Graph Optimization
- 2026Skill-MAS: Evolving Meta-Skill for Automatic Multi-Agent Systems
- 2025MasHost Builds It All: Autonomous Multi-Agent System Directed by Reinforcement Learning
- 2025SwarmAgentic: Towards Fully Automated Agentic System Generation via Swarm Intelligence
- 2026EvoTrainer: Co-Evolving LLM Policies and Training Harnesses for Autonomous Agentic Reinforcement Learning