MAS2: Self-Generative, Self-Configuring, Self-Rectifying Multi-Agent Systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The past two years have witnessed the meteoric rise of Large Language Model (LLM)-powered multi-agent systems (MAS), which harness collective intelligence and exhibit a remarkable trajectory toward self-evolution. This paradigm has rapidly progressed from manually engineered systems that require bespoke configuration of prompts, tools, roles, and communication protocols toward frameworks capable of automated orchestration. Yet, dominant automatic multi-agent systems, whether generated by external modules or a single LLM agent, largely adhere to a rigid ``textitgenerate-once-and-deploy'' paradigm, rendering the resulting systems brittle and ill-prepared for the dynamism and uncertainty of real-world environments. To transcend this limitation, we introduce MAS2, a paradigm predicated on the principle of recursive self-generation: a multi-agent system that autonomously architects bespoke multi-agent systems for diverse problems. Technically, we devise a ``textitgenerator-implementer-rectifier'' tri-agent team capable of dynamically composing and adaptively rectifying a target agent system in response to real-time task demands. Collaborative Tree Optimization is proposed to train and specialize these meta-agents. Extensive evaluation across seven benchmarks reveals that MAS2 achieves performance gains of up to 19.6% over state-of-the-art MAS in complex scenarios such as deep research and code generation. Moreover, MAS2 exhibits superior cross-backbone generalization, effectively leveraging previously unseen LLMs to yield improvements of up to 15.1%. Crucially, these gains are attained without incurring excessive token costs, as MAS2 consistently resides on the Pareto frontier of cost-performance trade-offs. The source codes are available at https://github.com/yeyeyeah2/MAS2.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 49 of its 70 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
49 of 70 references.
Closest ancestors · 17
Same direction, newest first
- 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation29 May
- 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systems5 Mar
- 2025I-MCTS: Enhancing Agentic AutoML via Introspective Monte Carlo Tree Search20 Feb
- 2025MasRouter: Learning to Route LLMs for Multi-Agent Systems16 Feb
- 2025SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning7 Feb
- 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMs10 Jan
- 2024Multi-Agent Sampling: Scaling Inference Compute for Data Synthesis with Tree Search-Based Agentic Collaboration22 Dec
- 2024MALT: Improving Reasoning with Multi-Agent LLM Training2 Dec
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks15 Oct
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Space8 Oct
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems3 Oct
5 more
- 2024Automated Design of Agentic Systems15 Aug
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration3 Oct
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration11 Jul
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 32
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025Qwen3 Technical Reportcited by 8,820
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
20 more
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 329
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
- 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 200
- 2024GraphRouter: A Graph-based Router for LLM Selectionscited by 165
- 2025MAPoRL: Multi-Agent Post-Co-Training for Collaborative Large Language Models with Reinforcement Learningcited by 86
- 2024Self-Evolving Multi-Agent Collaboration Networks for Software Developmentcited by 74
- 2024REBEL: Reinforcement Learning via Regressing Relative Rewardscited by 69
- 2025FlowReasoner: Reinforcing Query-Level Meta-Agentscited by 63
- 2025Robin: A multi-agent system for automating scientific discoverycited by 62
- 2025G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent Systemscited by 59
- 2025ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimizationcited by 56
- 2025Co-Evolving LLM Coder and Unit Tester via Reinforcement Learningcited by 56
- 2025MARFT: Multi-Agent Reinforcement Fine-Tuningcited by 52
- 2025Optimizing Model Selection for Compound AI Systemscited by 36
- 2025Weak-for-Strong: Training Weak Meta-Agent to Harness Strong Executorscited by 22
- 2025MermaidFlow: Redefining Agentic Workflow Generation via Safety-Constrained Evolutionary Programmingcited by 16
- 2025How to Train a Leader: Hierarchical Reasoning in Multi-Agent LLMscited by 12
- 2025A Multimodal Multi-Agent Framework for Radiology Report Generationcited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026ORCH: many analyses, one merge-a deterministic multi-agent orchestrator for discrete-choice reasoning with EMA-guided routingcited by 5
- 2026DHCG: Dynamic Construction of Hierarchical Collaboration Graphs for LLM-Based Multi-Agent Reasoningcited by 0
- 2026MAS-Gate: Unlocking Multi-Agent System Lifecycle via Node-Centric Quantificationcited by 0
- 2026MAS-Gate: Unlocking Multi-Agent System Lifecycle via Node-Centric Quantification13 Oct 2026
- 2026DHCG: Dynamic Construction of Hierarchical Collaboration Graphs for LLM-Based Multi-Agent Reasoning6 Oct 2026
- 2026ORCH: many analyses, one merge-a deterministic multi-agent orchestrator for discrete-choice reasoning with EMA-guided routing2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025MAS-ZERO: Designing Multi-Agent Systems with Zero Supervision
- 2025Large Language Models Miss the Multi-Agent Mark
- 2026LLM-Enabled Multi-Agent Systems: Empirical Evaluation and Insights into Emerging Design Patterns & Paradigms
- 2025X-MAS: Towards Building Multi-Agent Systems with Heterogeneous LLMs
- 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems
- 2026Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report
- 2023Balancing Autonomy and Alignment: A Multi-Dimensional Taxonomy for Autonomous LLM-powered Multi-Agent Architectures
- 2026LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Review