MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 2 more
Abstract (arXiv)
Large language models are increasingly deployed as multi-agent systems, where specialized roles communicate and collaborate through structured interactions to solve complex tasks that often exceed the capacity of a single agent. However, most existing systems still rely on a fixed role library and an execution-frozen interaction topology, a rigid design choice that frequently leads to task mismatch, prevents timely adaptation when new evidence emerges during reasoning, and further inflates inference cost. We introduce MetaGen, a training-free framework that adapts both the role space and the collaboration topology at inference time, without updating base model weights. MetaGen generates and rewrites query-conditioned role specifications to maintain a controllable dynamic role pool, then instantiates a constrained execution graph around a minimal backbone. During execution, it iteratively updates role prompts and adjusts structural decisions using lightweight feedback signals. Experiments on code generation and multi-step reasoning benchmarks show that MetaGen improves the accuracy and cost tradeoff over strong multi-agent baselines.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 20 of its 41 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
20 of 41 references.
Closest ancestors · 1
Same direction, newest first
Other references · 19
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 2024DeepSeek-V3 Technical Reportcited by 724
- 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 642
- 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 235
- 2025Multi-agent Architecture Search via Agentic Supernetcited by 164
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systemscited by 129
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networkscited by 110
- 2023Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debatecited by 94
7 more
- 2024Self-Organized Agents: A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimizationcited by 84
- 2025MasRouter: Learning to Route LLMs for Multi-Agent Systemscited by 80
- 2025Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generationcited by 57
- 2024LongAgent: Scaling Language Models to 128k Context through Multi-Agent Collaborationcited by 38
- 2023Large Language Model as a Policy Teacher for Training Reinforcement Learning Agentscited by 30
- 2025RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memorycited by 24
- 2025Cochain: Balancing Insufficient and Excessive Collaboration in LLM Agent Workflowscited by 2
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 22
- 2026Self-Improvements in Modern Agentic Systems: A Surveycited by 17
- 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systemscited by 4
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspectivecited by 4
- 2026AgentStream: How Well Do Self-Evolving LLM Agents Perform Under Streaming Tasks?cited by 2
- 2026Roles with Rails: Contract-Preserving Role Evolution in Multi-Agent Structured Reasoningcited by 0
- 2026RepoMAS: Solving Progressively Specified Tasks with Issue-Driven Multi-Agent Systemscited by 0
- 2026KVCMAS: Efficient KV cache Correction for Shared Context in Multi-Agent Systemscited by 0
- 2026KVCMAS: Efficient KV cache Correction for Shared Context in Multi-Agent Systems28 Sep 2026
- 2026RepoMAS: Solving Progressively Specified Tasks with Issue-Driven Multi-Agent Systems26 Sep 2026
- 2026AgentStream: How Well Do Self-Evolving LLM Agents Perform Under Streaming Tasks?31 Jul 2026
- 2026Self-Improvements in Modern Agentic Systems: A Survey14 Jul 2026
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspective10 Jun 2026
- 2026Roles with Rails: Contract-Preserving Role Evolution in Multi-Agent Structured Reasoning27 May 2026
- 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systems10 May 2026
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents23 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026MetaEvo: A Meta-Optimization Framework for Experience-Driven Agent Evolution
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents
- 2026A Comprehensive Evaluation of LLM Reasoning: From Single-Model to Multi-Agent Paradigms
- 2026Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolution
- 2026Inference-Time Graph Engineering for Multi-Agent LLM Workflows
- 2026Dynamic Role Assignment for Multi-Agent Debate
- 2026MetaCogAgent: A Metacognitive Multi-Agent LLM Framework with Self-Aware Task Delegation
- 2026Thinking Before Thinking: Scaling Agentic Inference Through Meta-Reasoning