Grammar Search for Multi-Agent Systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Automatic search for Multi-Agent Systems has recently emerged as a key focus in agentic AI research. Several prior approaches have relied on LLM-based free-form search over the code space. In this work, we propose a more structured framework that explores the same space through a fixed set of simple, composable components. We show that, despite lacking the generative flexibility of LLMs during the candidate generation stage, our method outperforms prior approaches on four out of five benchmarks across two domains: mathematics and question answering. Furthermore, our method offers additional advantages, including a more cost-efficient search process and the generation of modular, interpretable multi-agent systems with simpler logic.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 20 of its 40 references that are in the map. First posted on arXiv 16 Dec 2025.
Builds on
20 of 40 references.
Closest ancestors · 6
Same direction, newest first
- 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolution26 May
- 2025MAS-ZERO: Designing Multi-Agent Systems with Zero Supervision21 May
- 2025SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning7 Feb
- 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
- 2023A Survey on Large Language Model based Autonomous Agents22 Aug
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 14
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
2 more
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Space
- 2025Agent-UniRAG: A Trainable Open-Source LLM Agent Framework for Unified Retrieval-Augmented Generation Systems
- 2026LLM Agents Factory: Retrieval of Domain-Specific LLM Agents
- 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Application
- 2025AutoMaAS: Self-Evolving Multi-Agent Architecture Search for Large Language Models
- 2025Knowledge-Aware Iterative Retrieval for Multi-Agent Systems
- 2025AgentSwift: Efficient LLM Agent Design via Value-guided Hierarchical Search
- 2025Where to Search: Measure the Prior-Structured Search Space of LLM Agents