AgentInit: Initializing LLM-based Multi-Agent Systems via Diversity and Expertise Orchestration for Effective and Efficient Collaboration
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Proper initialization is crucial for any system, particularly in multi-agent systems (MAS), where it plays a pivotal role in determining both the system's efficiency and effectiveness. However, existing MAS initialization methods do not fully account for the collaborative needs of the generated agents in subsequent stages. Inspired by the principles of effective team composition, we propose AgentInit, which aims to optimize the structure of agent teams. Specifically, in addition to multi-round interactions and reflections between agents during agent generation, AgentInit incorporates a Natural Language to Format mechanism to ensure consistency and standardization. Balanced team selection strategies using Pareto principles are subsequently applied to jointly consider agent team diversity and task relevance to promote effective and efficient collaboration and enhance overall system performance. Experiments show that AgentInit consistently outperforms state-of-the-art initialization methods and pre-defined strategies across various frameworks and tasks, achieving an overall performance improvement of up to 1.2 and 1.6, respectively, while also significantly reducing token consumption. Further analysis confirms its strong transferability to similar tasks and verifies the effectiveness of its key components, demonstrating its capability and adaptability as a reliable MAS initialization method. Source code and models are available at https://github.com/1737423697/AgentInit.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 32 of its 71 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
32 of 71 references.
Closest ancestors · 8
Same direction, newest first
- 2024DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory10 Oct
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms20 Jun
- 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
- 2024Adaptive In-conversation Team Building for Language Model Agents29 May
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration3 Oct
- 2023AutoAgents: A Framework for Automatic Agent Generation29 Sep
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration11 Jul
- 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks27 May
Other references · 24
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2023Large Language Models are not Fair Evaluatorscited by 1,050
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
12 more
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
- 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 642
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
- 2016Solving General Arithmetic Word Problemscited by 353
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 298
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 248
- 2023ExpertPrompting: Instructing Large Language Models to be Distinguished Expertscited by 140
- 2024Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffoldingcited by 115
- 2024Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Modelscited by 90
- 2024Self-Organized Agents: A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimizationcited by 84
- 2023ChatLLM Network: More brains, More intelligencecited by 37
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Dynamic Role Assignment for Multi-Agent Debatecited by 5
- 2026MASRubric: Auditing Information Flow in Multi-Agent Systems with Failure-Distilled Pitfall Rubricscited by 2
- 2026Experience as a Compass: Multi-agent RAG with Evolving Orchestration and Agent Promptscited by 2
- 2026MemoNoveltyAgent: A Historical Research Memory-Aware Agent Workflow for Paper Novelty Assessmentcited by 1
- 2026Superficial Success vs. Internal Breakdown: An Empirical Study of Generalization in Adaptive Multi-Agent Systemscited by 1
- 2026Multi-Agent Coordination Adaptation via Structure-Guided Orchestrationcited by 1
- 2026ATOM: Instantiating Budget-Controllable Multi-Agent Collaboration via Nucleus-Electron Hierarchycited by 1
- 2026DeepDiscovery: A Location-Inference Framework for Task-Level Repository Understandingcited by 1
- 2026Loong: A Human-Like Long Document Translation Agent with Observe-and-Act Adaptive Context Selectioncited by 0
- 2026DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documentscited by 0
- 2026DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documents24 Sep 2026
- 2026DeepDiscovery: A Location-Inference Framework for Task-Level Repository Understanding22 Jun 2026
- 2026Loong: A Human-Like Long Document Translation Agent with Observe-and-Act Adaptive Context Selection28 May 2026
- 2026ATOM: Instantiating Budget-Controllable Multi-Agent Collaboration via Nucleus-Electron Hierarchy25 May 2026
- 2026Multi-Agent Coordination Adaptation via Structure-Guided Orchestration25 May 2026
- 2026Superficial Success vs. Internal Breakdown: An Empirical Study of Generalization in Adaptive Multi-Agent Systems21 Apr 2026
- 2026Experience as a Compass: Multi-agent RAG with Evolving Orchestration and Agent Prompts1 Apr 2026
- 2026MemoNoveltyAgent: A Historical Research Memory-Aware Agent Workflow for Paper Novelty Assessment21 Mar 2026
- 2026MASRubric: Auditing Information Flow in Multi-Agent Systems with Failure-Distilled Pitfall Rubrics26 Feb 2026
- 2026Dynamic Role Assignment for Multi-Agent Debate23 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024MorphAgent: Empowering Agents through Self-Evolving Profiles and Decentralized Collaboration
- 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems
- 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
- 2025AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration
- 2026Towards a Science of Collective AI: LLM-based Multi-Agent Systems Need a Transition from Blind Trial-and-Error to Rigorous Science
- 2025AgentGroupChat-V2: Divide-and-Conquer Is What LLM-Based Multi-Agent System Need
- 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems
- 2026Multi-Agent Teams Hold Experts Back