A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Recent studies show that collaborating multiple large language model (LLM) powered agents is a promising way for task solving. However, current approaches are constrained by using a fixed number of agents and static communication structures. In this work, we propose automatically selecting a team of agents from candidates to collaborate in a dynamic communication structure toward different tasks and domains. Specifically, we build a framework named Dynamic LLM-Powered Agent Network (DyLAN) for LLM-powered agent collaboration, operating a two-stage paradigm: (1) Team Optimization and (2) Task Solving. During the first stage, we utilize an textitagent selection algorithm, based on an unsupervised metric called textitAgent Importance Score, enabling the selection of best agents according to their contributions in a preliminary trial, oriented to the given task. Then, in the second stage, the selected agents collaborate dynamically according to the query. Empirically, we demonstrate that DyLAN outperforms strong baselines in code generation, decision-making, general reasoning, and arithmetic reasoning tasks with moderate computational cost. On specific subjects in MMLU, selecting a team of agents in the team optimization stage improves accuracy by up to 25.0% in DyLAN.
Key facts. Cited by 281 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 9 of its 48 references that are in the map. First posted on arXiv 3 Oct 2023.
Builds on
9 of 48 references.
Closest ancestors · 1
Same direction, newest first
Other references · 8
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 946
- 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 468
- 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 352
- 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
- 2023Self-collaboration Code Generation via ChatGPTcited by 255
- 2023LLM As DBAcited by 18
- 2023GPT-in-the-Loop: Adaptive Decision-Making for Multiagent Systemscited by 9
Built on by
Citing papers per year: 2023: 1; 2024: 57; 2025: 107; 2026: 116.
281 papers.
Sort:
By area:
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
- 2024More Agents Is All You Needcited by 174
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 164
- 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 162
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systemscited by 129
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
- 2025A Survey of Context Engineering for Large Language Modelscited by 120
- 2024Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffoldingcited by 115
38 more
- 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologiescited by 106
- 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 102
- 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systemscited by 86
- 2024Language Agents as Optimizable Graphscited by 81
- 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 81
- 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agentscited by 77
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directionscited by 67
- 2024LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Playcited by 65
- 2024Can Large Language Model Agents Simulate Human Trust Behavior?cited by 62
- 2025KVLink: Accelerating Large Language Models via Efficient KV Cache Reusecited by 60
- 2025LVAgent: Long Video Understanding by Multi-Round Dynamical Collaboration of MLLM Agentscited by 58
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 56
- 2024Learning to Use Tools via Cooperative and Interactive Agentscited by 54
- 2025Cache-to-Cache: Direct Semantic Communication Between Large Language Modelscited by 54
- 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 49
- 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systemscited by 45
- 2025A Survey on the Optimization of Large Language Model-based Agentscited by 45
- 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversationscited by 43
- 2024Adaptive In-conversation Team Building for Language Model Agentscited by 38
- 2024Cost-Effective Online Multi-LLM Selection with Versatile Reward Modelscited by 36
- 2025GUARDIAN: Safeguarding LLM Multi-Agent Collaborations with Temporal Graph Modelingcited by 35
- 2024Agent-Oriented Planning in Multi-Agent Systemscited by 34
- 2025X-MAS: Towards Building Multi-Agent Systems with Heterogeneous LLMscited by 33
- 2024How Far Are We From AGI: Are LLMs All We Need?cited by 31
- 2025Flow: Modularized Agentic Workflow Automationcited by 31
- 2025LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospectscited by 31
- 2025Internet of Agents: Fundamentals, Applications, and Challengescited by 31
- 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMscited by 31
- 2024SMoA: Improving Multi-agent Large Language Models with Sparse Mixture-of-Agentscited by 30
- 2025ReSo: A Reward-driven Self-organizing LLM-based Multi-Agent System for Reasoning Taskscited by 30
- 2025Thought Communication in Multiagent Collaborationcited by 28
- 2024Confidence Calibration and Rationalization for LLMs via Multi-Agent Deliberationcited by 26
- 2024AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaborationcited by 26
- 2024Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trendscited by 26
- 2025MAS-ZERO: Designing Multi-Agent Systems with Zero Supervisioncited by 26
- 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challengescited by 26
- 2026MAS-Orchestra: Understanding and Improving Multi-Agent Reasoning Through Holistic Orchestration and Controlled Benchmarkscited by 26
- 2025MA-RAG: Multi-Agent Retrieval-Augmented Generation via Collaborative Chain-of-Thought Reasoningcited by 24
50 most cited of 281 All 281 (JSON)
- 2026Can AI Scientists Coordinate at Runtime?1 Oct 2026
- 2026GraphMAS: A Systematic Benchmark of Multi-Agent Coordination for Graph Learning30 Sep 2026
- 2026When Order Matters: First-Speaker Bias and Mitigation through Personality in Sequential Multi-Agent Debate30 Sep 2026
- 2026CollabFlow: Recursive Self-Improvement of Agent Collaboration29 Sep 2026
- 2026PANDA: A Decentralized Architecture with Flexible Orchestration for Scalable, Fault-Tolerant Multi-Agent Systems29 Sep 2026
- 2026Which Models Work Well Together? Measuring Heterogeneity for LLM Team Selection29 Sep 2026
- 2026Topological Coherence for Self-evolving Multi-agent Systems29 Sep 2026
- 2026Distilling Agentic Systems: A Roadmap across Models, Artifacts, and Harnesses29 Sep 2026
- 2026Waggle: Learning One Anonymous Local Law for Self-Organizing LLM Swarms28 Sep 2026
- 2026DEALS: Decentralized Expertise-Aware Load Serving for Multi-Agent LLM Systems27 Sep 2026
- 2026ANTMAN: Adaptive Need Tracking for Multi-Agent Navigation in Large Information Spaces27 Sep 2026
- 2026RepoMAS: Solving Progressively Specified Tasks with Issue-Driven Multi-Agent Systems26 Sep 2026
38 more
- 2026Multi-Agent System Search via Active Substructure-aware Policy Optimization26 Sep 2026
- 2026CyberClear: A Benchmark for LLM Agent Systems on APT Attack Chain Provenance26 Sep 2026
- 2026MAGIC: Mixed-Granularity Agent Graphs via Incremental Construction with Dense-Reward Reinforcement Learning22 Sep 2026
- 2026A Task-Oriented Multi-Agent Framework for Complex Wearable Health Analysis21 Sep 2026
- 2026Self-Organizing Agent Teams Learn to Reason Together19 Sep 2026
- 2026OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systems18 Sep 2026
- 2026Scaling Discovery through Test-Time Communication17 Sep 2026
- 2026Rethinking Multi-Agent Collaboration: When More Is Less17 Sep 2026
- 2026Proxifield: Decentralized Multi-Agent Communication through Semantic Proximity16 Sep 2026
- 2026Mo' Models, Mo' Problems: How to best select model pools when designing Multi-Agent Systems15 Sep 2026
- 2026CoMem: Collective-Individual Memory Synergy for Evolutionary Multi-Agent Systems14 Sep 2026
- 2026TROVE: Adaptive Agent Skill Orchestration via Trace-Grounded Route Validation and Editing4 Sep 2026
- 2026Privacy-Preserving Topology-Guided Safety for LLM-Based Multi-Agent Systems via Federated Graph Learning2 Sep 2026
- 2026ArcticSwarm: Deferring Early Consensus in Long-Horizon Multi-Agent Research1 Sep 2026
- 2026AgentFactory: Towards Automated Agentic System Design and Optimization1 Sep 2026
- 2026Learning What to Retain: Gated-Memory Routing for Efficient Collaboration in Multi-Agent LLM Systems31 Aug 2026
- 2026COVER: Identifiable Evaluation of Coalition Routing28 Aug 2026
- 2026One Model, Many Minds: Unlocking Multi-Agent Synergy in a Single Agent via Mixture of Roles27 Aug 2026
- 2026Candidate supply and answer selection shape the value of LLM judging in multi-agent systems26 Aug 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026What Confidence Routing Is Actually Doing: Auditing Routing, Calibration, and Commitment in Multi-Agent Deliberation18 Aug 2026
- 2026DeAR: Decentralized Agentic Reasoning via Capability Grounding and Collaborative Thought Navigation18 Aug 2026
- 2026Wrong but Useful: Trajectory Value Beyond Answer Correctness in Multi-Agent Messages14 Aug 2026
- 2026EASy: Towards Efficient LLM-Based Agentic System5 Aug 2026
- 2026Global Optimization and Inference-Time Region Grafting for Agentic Workflows3 Aug 2026
- 2026Multi-Agent Debate Strategies: Survey, Taxonomy, and Challenges28 Jul 2026
- 2026Toward an Organizational Science of Multi-Agent LLM Systems: Decoupling Who, How, and Which Algorithm28 Jul 2026
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gaps27 Jul 2026
- 2026GS-Agent: Creating 4D Physical Worlds With Generative Simulation23 Jul 2026
- 2026Small, Free, and Effective: Orchestrating Open-Weight Small Language Models to Outperform Single LLM for Malware Analysis22 Jul 2026
- 2026Temporary Authority, Permanent Effects: Commit-Time Authorization for LLM Agents11 Jul 2026
- 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?10 Jul 2026
- 2026From Search to Synthesis: Training LLMs as Zero-Shot Workflow Generators29 Jun 2026
- 2026MESA: Prioritizing Vulnerable Communication Channels for Securing Multi-Agent Systems29 Jun 2026
- 2026At Equal Inference Cost, Multi-Agent Structure Does Not Beat a Single Frozen Agent25 Jun 2026
- 2026QueenBee Planner: Skill-Evolving Communication Topologies for Token-Efficient LLM Multi-Agent Systems25 Jun 2026
- 2026Escaping the Self-Confirmation Trap: An Execute-Distill-Verify Paradigm for Agentic Experience Learning23 Jun 2026
- 2026SIGMA: Skill-Incidence Graphs for Compositional Multi-Agent Design18 Jun 2026
50 newest of 281 All 281 (JSON)
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
- 2024More Agents Is All You Needcited by 174
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 164
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systemscited by 129
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
- 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologiescited by 106
- 2025Multi-Agent Collaboration via Evolving Orchestrationcited by 102
- 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systemscited by 86
- 2024Language Agents as Optimizable Graphscited by 81
12 most cited of 181 All 181 (JSON)
- 2026GraphMAS: A Systematic Benchmark of Multi-Agent Coordination for Graph Learning30 Sep 2026
- 2026CollabFlow: Recursive Self-Improvement of Agent Collaboration29 Sep 2026
- 2026PANDA: A Decentralized Architecture with Flexible Orchestration for Scalable, Fault-Tolerant Multi-Agent Systems29 Sep 2026
- 2026Distilling Agentic Systems: A Roadmap across Models, Artifacts, and Harnesses29 Sep 2026
- 2026Waggle: Learning One Anonymous Local Law for Self-Organizing LLM Swarms28 Sep 2026
- 2026DEALS: Decentralized Expertise-Aware Load Serving for Multi-Agent LLM Systems27 Sep 2026
- 2026RepoMAS: Solving Progressively Specified Tasks with Issue-Driven Multi-Agent Systems26 Sep 2026
- 2026Multi-Agent System Search via Active Substructure-aware Policy Optimization26 Sep 2026
- 2026CyberClear: A Benchmark for LLM Agent Systems on APT Attack Chain Provenance26 Sep 2026
- 2026MAGIC: Mixed-Granularity Agent Graphs via Incremental Construction with Dense-Reward Reinforcement Learning22 Sep 2026
- 2026A Task-Oriented Multi-Agent Framework for Complex Wearable Health Analysis21 Sep 2026
- 2026OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systems18 Sep 2026
12 newest of 181 All 181 (JSON)
- 2025MAS-GPT: Training LLMs to Build LLM-based Multi-Agent Systemscited by 45
- 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMscited by 31
- 2025ReSo: A Reward-driven Self-organizing LLM-based Multi-Agent System for Reasoning Taskscited by 30
- 2025Thought Communication in Multiagent Collaborationcited by 28
- 2025MA-RAG: Multi-Agent Retrieval-Augmented Generation via Collaborative Chain-of-Thought Reasoningcited by 24
- 2025DyFlow: Dynamic Workflow Framework for Agentic Reasoningcited by 22
- 2025Systematic Failures in Collective Reasoning under Distributed Information in Multi-Agent LLMscited by 15
- 2023Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agentscited by 13
- 2025Xolver: Multi-Agent Reasoning with Holistic Experience Learning Just Like an Olympiad Teamcited by 13
- 2025Meta-Thinking in LLMs via Multi-Agent Reinforcement Learning: A Surveycited by 10
- 2025Multi-LLM Collaborative Search for Complex Problem Solvingcited by 9
- 2025MedLA: A Logic-Driven Multi-Agent Framework for Complex Medical Reasoning with Large Language Modelscited by 9
12 most cited of 31 All 31 (JSON)
- 2026When Order Matters: First-Speaker Bias and Mitigation through Personality in Sequential Multi-Agent Debate30 Sep 2026
- 2026Rethinking Multi-Agent Collaboration: When More Is Less17 Sep 2026
- 2026Reward Modeling for Multi-Agent Orchestration11 Jun 2026
- 2026Streaming Communication in Multi-Agent Reasoning3 Jun 2026
- 2026Roles with Rails: Contract-Preserving Role Evolution in Multi-Agent Structured Reasoning27 May 2026
- 2026RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generation11 May 2026
- 2026Brain-Inspired Graph Multi-Agent Systems for LLM Reasoning16 Mar 2026
- 2026Training-Free Agentic AI: Probabilistic Control and Coordination in Multi-Agent LLM Systems24 Feb 2026
- 2026Guided Collaboration in Heterogeneous LLM-Based Multi-Agent Systems via Entropy-Based Understanding Assessment and Experience Retrieval14 Feb 2026
- 2026MAS-ProVe: Understanding the Process Verification of Multi-Agent Systems3 Feb 2026
- 2025FutureWeaver: Planning Test-Time Compute for Multi-Agent Systems with Modularized Collaboration12 Dec 2025
- 2025Thought Communication in Multiagent Collaboration23 Oct 2025
12 newest of 31 All 31 (JSON)
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personas28 Jun 2024
- 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 162
- 2025A Survey of Context Engineering for Large Language Modelscited by 120
- 2024Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffoldingcited by 115
- 2024LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Playcited by 65
- 2024How Far Are We From AGI: Are LLMs All We Need?cited by 31
- 2024Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trendscited by 26
- 2026MAS-Orchestra: Understanding and Improving Multi-Agent Reasoning Through Holistic Orchestration and Controlled Benchmarkscited by 26
- 2024BattleAgent: Multi-modal Dynamic Emulation on Historical Battles to Complement Historical Analysiscited by 20
- 2024Measuring the Inconsistency of Large Language Models in Preferential Rankingcited by 18
- 2025Scaffolding Empathy: Training Counselors with Simulated Patients and Utterance-level Performance Visualizationscited by 14
- 2024Evolving AI Collectives to Enhance Human Diversity and Enable Self-Regulationcited by 13
- 2024An Expert is Worth One Token: Synergizing Multiple Expert LLMs as Generalist via Expert Token Routingcited by 7
12 most cited of 59 All 59 (JSON)
- 2026Can AI Scientists Coordinate at Runtime?1 Oct 2026
- 2026Which Models Work Well Together? Measuring Heterogeneity for LLM Team Selection29 Sep 2026
- 2026Topological Coherence for Self-evolving Multi-agent Systems29 Sep 2026
- 2026ANTMAN: Adaptive Need Tracking for Multi-Agent Navigation in Large Information Spaces27 Sep 2026
- 2026Self-Organizing Agent Teams Learn to Reason Together19 Sep 2026
- 2026COVER: Identifiable Evaluation of Coalition Routing28 Aug 2026
- 2026What Confidence Routing Is Actually Doing: Auditing Routing, Calibration, and Commitment in Multi-Agent Deliberation18 Aug 2026
- 2026Wrong but Useful: Trajectory Value Beyond Answer Correctness in Multi-Agent Messages14 Aug 2026
- 2026From Cognitive Architectures to Language Agents: A Mechanism-Level Review of Lineage, Convergence, and Migration Gaps27 Jul 2026
- 2026Small, Free, and Effective: Orchestrating Open-Weight Small Language Models to Outperform Single LLM for Malware Analysis22 Jul 2026
- 2026From Search to Synthesis: Training LLMs as Zero-Shot Workflow Generators29 Jun 2026
- 2026The Illusion of Multi-Agent Advantage11 Jun 2026
12 newest of 59 All 59 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025AgentDropout: Dynamic Agent Elimination for Token-Efficient and High-Performance LLM-Based Multi-Agent Collaboration
- 2025Can LLM Agents Solve Collaborative Tasks? A Study on Urgency-Aware Planning and Coordination
- 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents
- 2025OPTAGENT: Optimizing Multi-Agent LLM Interactions Through Verbal Reinforcement Learning for Enhanced Reasoning
- 2026DHCG: Dynamic Construction of Hierarchical Collaboration Graphs for LLM-Based Multi-Agent Reasoning
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents
- 2026Token-Efficient Multi-Agent Collaboration via System One-Guided Computational Division of Labor
- 2024Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System