mlsanityData to 14 Oct 2026

OptiMAS: Automatically Optimize Multi-Agent System

arXiv 2608.21918 ↗First posted 22 Aug 2026cs.MAcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Automated evolution of Multi-Agent Systems (MAS) holds significant potential for reducing the manual effort required to design and optimize LLM-based agent architectures. However, extant search-based paradigms face a fundamental trade-off, where an expanded optimization scope exacerbates evolutionary instability, while discrete branch-and-discard search isolates insights across lineages. To address these limitations, we propose a continuous, data-driven optimization paradigm built upon a unified ReAct-based infrastructure that reconciles a broad optimization scope with operational stability. Under this paradigm, we present OptiMAS, a task-agnostic agentic optimizer that leverages textual interaction trajectories and task feedback as loss signals for end-to-end MAS evolution. Equipped with a novel dual-track memory mechanism, OptiMAS sustains performance improvement over extended optimization horizons. Evaluation on four heterogeneous agentic benchmarks with three varying scale and accessibility LLM backbones, demonstrates that OptiMAS consistently achieves competitive or superior accuracy relative to both domain-specialized hand-crafted systems and existing evolutionary methods. Our work establishes a practical milestone toward robust, automated MAS evolution.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 42 of its 48 references that are in the map. First posted on arXiv 22 Aug 2026.

Builds on

42 of 48 references.

Closest ancestors · 16

Same direction, newest first

  1. 2026EvoMAS: Evolutionary Generation of Multi-Agent Systems6 Feb
  2. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence28 Jul
  3. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents29 May
  4. 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolution26 May
  5. 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systems5 Mar
  6. 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
  7. 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies4 Feb
  8. 2024SMoA: Improving Multi-agent Large Language Models with Sparse Mixture-of-Agents5 Nov
  9. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Space8 Oct
  10. 2024Automated Design of Agentic Systems15 Aug
  11. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms20 Jun
  12. 2024WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting1 May
4 more
  1. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  2. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  3. 2023AdaPlanner: Adaptive Planning from Feedback with Language Models26 May
  4. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 26

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  7. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  8. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  9. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  10. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  11. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  12. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
14 more
  1. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
  2. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  3. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  4. 2024AFlow: Automating Agentic Workflow Generationcited by 432
  5. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  6. 2024TextGrad: Automatic "Differentiation" via Textcited by 273
  7. 2025BIG-Bench Extra Hardcited by 125
  8. 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 109
  9. 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 103
  10. 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?cited by 95
  11. 2024Self-Evolving Multi-Agent Collaboration Networks for Software Developmentcited by 74
  12. 2025FlowReasoner: Reinforcing Query-Level Meta-Agentscited by 63
  13. 2025EvoFlow: Evolving Diverse Agentic Workflows On The Flycited by 55
  14. 2026UIS-Digger: Towards Comprehensive Research Agent Systems for Real-world Unindexed Information Seekingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning to Evolve: A Self-Improving Framework for Multi-Agent Systems via Textual Parameter Graph Optimization
  2. 2025AutoMaAS: Self-Evolving Multi-Agent Architecture Search for Large Language Models
  3. 2026RoboPhD: Evolving Diverse Complex Agents Under Tight Evaluation Budgets
  4. 2026HMACE: Heterogeneous Multi-Agent Collaborative Evolution for Combinatorial Optimization
  5. 2024A Multi-AI Agent System for Autonomous Optimization of Agentic AI Solutions via Iterative Refinement and LLM-Driven Feedback Loops
  6. 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflows
  7. 2026MOAE: Multi-Objective Agent Evolution with Pareto-Preserving Search
  8. 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System