Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Multi-agent systems (MAS) based on large language models (LLMs) have emerged as a powerful solution for dealing with complex problems across diverse domains. The effectiveness of MAS is critically dependent on its collaboration topology, which has become a focal point for automated design research. However, existing approaches are fundamentally constrained by their reliance on a template graph modification paradigm with a predefined set of agents and hard-coded interaction structures, significantly limiting their adaptability to task-specific requirements. To address these limitations, we reframe MAS design as a conditional autoregressive graph generation task, where both the system composition and structure are designed jointly. We propose ARG-Designer, a novel autoregressive model that operationalizes this paradigm by constructing the collaboration graph from scratch. Conditioned on a natural language task query, ARG-Designer sequentially and dynamically determines the required number of agents, selects their appropriate roles from an extensible pool, and establishes the optimal communication links between them. This generative approach creates a customized topology in a flexible and extensible manner, precisely tailored to the unique demands of different tasks. Extensive experiments across six diverse benchmarks demonstrate that ARG-Designer not only achieves state-of-the-art performance but also enjoys significantly greater token efficiency and enhanced extensibility. The source code of ARG-Designer is available at https://github.com/Shiy-Li/ARG-Designer.
Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 26 of its 43 references that are in the map. First posted on arXiv 24 Jul 2025.
Builds on
26 of 43 references.
Closest ancestors · 2
Same direction, newest first
- 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies4 Feb
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
Other references · 24
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
- 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 642
- 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 406
- 2016Solving General Arithmetic Word Problemscited by 353
- 2019Efficient Graph Generation with Graph Recurrent Attention Networkscited by 231
- 2024Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understandingcited by 185
12 more
- 2024Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step-by-stepcited by 123
- 2023Autoregressive Diffusion Model for Graph Generationcited by 82
- 2023Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communicationcited by 78
- 2020GraphGen: A Scalable Approach to Domain-agnostic Labeled Graph Generationcited by 65
- 2020Scalable Deep Generative Modeling for Sparse Graphscited by 63
- 2024Are Large Language Models Good Statisticians?cited by 26
- 2025A Label-Free Heterophily-Guided Approach for Unsupervised Graph Fraud Detectioncited by 24
- 2023A Simple and Scalable Representation for Graph Generationcited by 15
- 2025Uncertainty-Aware Graph Neural Networks: A Multi-Hop Evidence Fusion Approachcited by 14
- 2025Bisecle: Binding and Separation in Continual Learning for Video Language Understandingcited by 13
- 2024Noise-Resilient Unsupervised Graph Representation Learning via Multi-Hop Feature Quality Estimationcited by 11
- 2021CCGG: A Deep Autoregressive Model for Class-Conditional Graph Generationcited by 4
Built on by
Citing papers per year: 2025: 13; 2026: 44.
57 papers.
Sort:
By area:
- 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attackscited by 37
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 22
- 2025Graph-Augmented Large Language Model Agents: Current Progress and Future Prospectscited by 14
- 2025A Survey of Generalization of Graph Anomaly Detection: From Transfer Learning to Foundation Modelscited by 13
- 2026DynHD: Hallucination Detection for Diffusion Large Language Models via Denoising Dynamics Deviation Learningcited by 13
- 2025Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test Timecited by 12
- 2026OFA-MAS: One-for-All Multi-Agent System Topology Design based on Mixture-of-Experts Graph Generative Modelscited by 12
- 2025Dynamic Generation of Multi-LLM Agents Communication Topologies with Graph Diffusion Modelscited by 11
- 2025Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systemscited by 11
- 2025Hollywood Town: Long-Video Generation via Cross-Modal Multi-Agent Orchestrationcited by 10
- 2025Beyond Pipelines: A Survey of the Paradigm Shift toward Model-Native Agentic AIcited by 8
- 2025Explainable and Fine-Grained Safeguarding of LLM Multi-Agent Systems via Bi-Level Graph Anomaly Detectioncited by 8
38 more
- 2026MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoningcited by 8
- 2025Metacognitive Self-Correction for Multi-Agent System via Prototype-Guided Next-Execution Reconstructioncited by 6
- 2026Towards One-for-All Anomaly Detection for Tabular Datacited by 5
- 2026GoAgent: Group-of-Agents Communication Topology Generation for LLM-based Multi-Agent Systemscited by 5
- 2026Self-Improvement of Large Language Models: A Technical Overview and Future Outlookcited by 5
- 2026RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generationcited by 5
- 2025Generalizing Test-time Compute-optimal Scaling as an Optimizable Graphcited by 4
- 2026EvoMAS: Evolutionary Generation of Multi-Agent Systemscited by 4
- 2026Holos: A Web-Scale LLM-Based Multi-Agent System for the Agentic Webcited by 4
- 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systemscited by 4
- 2026Towards Anomaly Detection on Relational Datacited by 4
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspectivecited by 4
- 2026TopoDIM: One-shot Topology Generation of Diverse Interaction Modes for Multi-Agent Systemscited by 3
- 2026Beyond a Single Perspective: Text Anomaly Detection with Multi-View Language Representationscited by 3
- 2025HyperAgent: Leveraging Hypergraphs for Topology Optimization in Multi-Agent Communicationcited by 2
- 2026Agent Q-Mix: Selecting the Right Action for LLM Multi-Agent Systems through Reinforcement Learningcited by 2
- 2026EMS: Multi-Agent Voting via Efficient Majority-then-Stoppingcited by 2
- 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systemscited by 2
- 2026SIGMA: Skill-Incidence Graphs for Compositional Multi-Agent Designcited by 2
- 2025Test-time GNN Model Evaluation on Dynamic Graphscited by 1
- 2026ST-EVO: Towards Generative Spatio-Temporal Evolution of Multi-Agent Communication Topologiescited by 1
- 2026Taming "Zombie'' Agents: A Markov State-Aware Framework for Resilient Multi-Agent Evolutioncited by 1
- 2026Learning Transferable Topology Priors for Multi-Agent LLM Collaboration Across Domainscited by 1
- 2026ATOM: Instantiating Budget-Controllable Multi-Agent Collaboration via Nucleus-Electron Hierarchycited by 1
- 2026Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inferencecited by 1
- 2026When Evidence Shapes Collaboration: Knowledge-Conditioned Topology Generation for Multi-Agent Systemscited by 1
- 2026Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systemscited by 1
- 2026Rethinking the Evaluation of Efficiency Methods for Multi-Agent Systemscited by 1
- 2026Active Learning for Communication Structure Optimization in LLM-Based Multi-Agent Systemscited by 0
- 2026LEMON: Learning Executable Multi-Agent Orchestration via Counterfactual Reinforcement Learningcited by 0
- 2026Differentiable Mixture-of-Agents Incentivizes Swarm Intelligence of Large Language Modelscited by 0
- 2026MasFACT: Continual Multi-Agent Topology Learning via Geometry-Aware Posterior Transfercited by 0
- 2026PEAR: Permutation-Equivariant Adaptive Routing Multi-Agent Debatecited by 0
- 2026AutoResearch: An Execution-Grounded Multi-Agent Framework for Reliable Research Workflow Automationcited by 0
- 2026Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Designcited by 0
- 2026Proxifield: Decentralized Multi-Agent Communication through Semantic Proximitycited by 0
- 2026OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systemscited by 0
- 2026MAGIC: Mixed-Granularity Agent Graphs via Incremental Construction with Dense-Reward Reinforcement Learningcited by 0
50 most cited of 57 All 57 (JSON)
- 2026Pay for the Fault, Not the Flow: Label-Free In-Flow Multi-Agent Workflow Optimization1 Oct 2026
- 2026MoFlow: Multi-Objective Agentic Workflow Generation29 Sep 2026
- 2026Topological Coherence for Self-evolving Multi-agent Systems29 Sep 2026
- 2026Concealing LLM-Based Multi-Agent Topology via Phantom Structure Injection29 Sep 2026
- 2026Waggle: Learning One Anonymous Local Law for Self-Organizing LLM Swarms28 Sep 2026
- 2026Beyond Solo and Consistency: Vindicating Multi-Agent Debate via Conditional Progressive Pruning27 Sep 2026
- 2026Do We Need Complex Topology Control? Distinct-Peer Random Routing Improves Cost-Efficiency in Sparse Multi-Agent Debate22 Sep 2026
- 2026MAGIC: Mixed-Granularity Agent Graphs via Incremental Construction with Dense-Reward Reinforcement Learning22 Sep 2026
- 2026OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systems18 Sep 2026
- 2026Proxifield: Decentralized Multi-Agent Communication through Semantic Proximity16 Sep 2026
- 2026Rethinking the Evaluation of Efficiency Methods for Multi-Agent Systems5 Sep 2026
- 2026Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systems2 Sep 2026
38 more
- 2026When Evidence Shapes Collaboration: Knowledge-Conditioned Topology Generation for Multi-Agent Systems28 Aug 2026
- 2026Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Design20 Aug 2026
- 2026Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inference13 Aug 2026
- 2026SIGMA: Skill-Incidence Graphs for Compositional Multi-Agent Design18 Jun 2026
- 2026Towards Anomaly Detection on Relational Data17 Jun 2026
- 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspective10 Jun 2026
- 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systems28 May 2026
- 2026PEAR: Permutation-Equivariant Adaptive Routing Multi-Agent Debate26 May 2026
- 2026ATOM: Instantiating Budget-Controllable Multi-Agent Collaboration via Nucleus-Electron Hierarchy25 May 2026
- 2026MasFACT: Continual Multi-Agent Topology Learning via Geometry-Aware Posterior Transfer17 May 2026
- 2026Learning Transferable Topology Priors for Multi-Agent LLM Collaboration Across Domains17 May 2026
- 2026Taming "Zombie'' Agents: A Markov State-Aware Framework for Resilient Multi-Agent Evolution17 May 2026
- 2026Differentiable Mixture-of-Agents Incentivizes Swarm Intelligence of Large Language Models15 May 2026
- 2026LEMON: Learning Executable Multi-Agent Orchestration via Counterfactual Reinforcement Learning14 May 2026
- 2026RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generation11 May 2026
- 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systems10 May 2026
- 2026Active Learning for Communication Structure Optimization in LLM-Based Multi-Agent Systems7 May 2026
- 2026AutoResearch: An Execution-Grounded Multi-Agent Framework for Reliable Research Workflow Automation4 May 2026
- 2026EMS: Multi-Agent Voting via Efficient Majority-then-Stopping3 Apr 2026
- 2026Agent Q-Mix: Selecting the Right Action for LLM Multi-Agent Systems through Reinforcement Learning1 Apr 2026
- 2026Self-Improvement of Large Language Models: A Technical Overview and Future Outlook26 Mar 2026
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents23 Mar 2026
- 2026GoAgent: Group-of-Agents Communication Topology Generation for LLM-based Multi-Agent Systems20 Mar 2026
- 2026DynHD: Hallucination Detection for Diffusion Large Language Models via Denoising Dynamics Deviation Learning17 Mar 2026
- 2026Towards One-for-All Anomaly Detection for Tabular Data15 Mar 2026
- 2026ST-EVO: Towards Generative Spatio-Temporal Evolution of Multi-Agent Communication Topologies16 Feb 2026
- 2026EvoMAS: Evolutionary Generation of Multi-Agent Systems6 Feb 2026
- 2026MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoning27 Jan 2026
- 2026Beyond a Single Perspective: Text Anomaly Detection with Multi-View Language Representations25 Jan 2026
- 2026OFA-MAS: One-for-All Multi-Agent System Topology Design based on Mixture-of-Experts Graph Generative Models19 Jan 2026
- 2026Holos: A Web-Scale LLM-Based Multi-Agent System for the Agentic Web18 Jan 2026
- 2026TopoDIM: One-shot Topology Generation of Diverse Interaction Modes for Multi-Agent Systems15 Jan 2026
- 2025Explainable and Fine-Grained Safeguarding of LLM Multi-Agent Systems via Bi-Level Graph Anomaly Detection21 Dec 2025
- 2025Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test Time10 Nov 2025
- 2025Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systems30 Oct 2025
- 2025Generalizing Test-time Compute-optimal Scaling as an Optimizable Graph29 Oct 2025
- 2025Hollywood Town: Long-Video Generation via Cross-Modal Multi-Agent Orchestration25 Oct 2025
- 2025Beyond Pipelines: A Survey of the Paradigm Shift toward Model-Native Agentic AI19 Oct 2025
50 newest of 57 All 57 (JSON)
- 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attackscited by 37
- 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 22
- 2025Graph-Augmented Large Language Model Agents: Current Progress and Future Prospectscited by 14
- 2026OFA-MAS: One-for-All Multi-Agent System Topology Design based on Mixture-of-Experts Graph Generative Modelscited by 12
- 2025Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systemscited by 11
- 2025Beyond Pipelines: A Survey of the Paradigm Shift toward Model-Native Agentic AIcited by 8
- 2025Explainable and Fine-Grained Safeguarding of LLM Multi-Agent Systems via Bi-Level Graph Anomaly Detectioncited by 8
- 2025Metacognitive Self-Correction for Multi-Agent System via Prototype-Guided Next-Execution Reconstructioncited by 6
- 2026GoAgent: Group-of-Agents Communication Topology Generation for LLM-based Multi-Agent Systemscited by 5
- 2026EvoMAS: Evolutionary Generation of Multi-Agent Systemscited by 4
- 2026Holos: A Web-Scale LLM-Based Multi-Agent System for the Agentic Webcited by 4
- 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systemscited by 4
12 most cited of 39 All 39 (JSON)
- 2026Pay for the Fault, Not the Flow: Label-Free In-Flow Multi-Agent Workflow Optimization1 Oct 2026
- 2026MoFlow: Multi-Objective Agentic Workflow Generation29 Sep 2026
- 2026Concealing LLM-Based Multi-Agent Topology via Phantom Structure Injection29 Sep 2026
- 2026Waggle: Learning One Anonymous Local Law for Self-Organizing LLM Swarms28 Sep 2026
- 2026MAGIC: Mixed-Granularity Agent Graphs via Incremental Construction with Dense-Reward Reinforcement Learning22 Sep 2026
- 2026OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systems18 Sep 2026
- 2026Proxifield: Decentralized Multi-Agent Communication through Semantic Proximity16 Sep 2026
- 2026Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systems2 Sep 2026
- 2026When Evidence Shapes Collaboration: Knowledge-Conditioned Topology Generation for Multi-Agent Systems28 Aug 2026
- 2026Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Design20 Aug 2026
- 2026Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inference13 Aug 2026
- 2026SIGMA: Skill-Incidence Graphs for Compositional Multi-Agent Design18 Jun 2026
12 newest of 39 All 39 (JSON)
- 2026MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoningcited by 8
- 2026RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generationcited by 5
- 2025Generalizing Test-time Compute-optimal Scaling as an Optimizable Graphcited by 4
- 2026Rethinking the Evaluation of Efficiency Methods for Multi-Agent Systemscited by 1
- 2026Do We Need Complex Topology Control? Distinct-Peer Random Routing Improves Cost-Efficiency in Sparse Multi-Agent Debatecited by 0
- 2026Beyond Solo and Consistency: Vindicating Multi-Agent Debate via Conditional Progressive Pruningcited by 0
- 2026Beyond Solo and Consistency: Vindicating Multi-Agent Debate via Conditional Progressive Pruning27 Sep 2026
- 2026Do We Need Complex Topology Control? Distinct-Peer Random Routing Improves Cost-Efficiency in Sparse Multi-Agent Debate22 Sep 2026
- 2026Rethinking the Evaluation of Efficiency Methods for Multi-Agent Systems5 Sep 2026
- 2026RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generation11 May 2026
- 2026MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoning27 Jan 2026
- 2025Generalizing Test-time Compute-optimal Scaling as an Optimizable Graph29 Oct 2025
- 2025A Survey of Generalization of Graph Anomaly Detection: From Transfer Learning to Foundation Modelscited by 13
- 2026DynHD: Hallucination Detection for Diffusion Large Language Models via Denoising Dynamics Deviation Learningcited by 13
- 2025Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test Timecited by 12
- 2025Hollywood Town: Long-Video Generation via Cross-Modal Multi-Agent Orchestrationcited by 10
- 2026Towards One-for-All Anomaly Detection for Tabular Datacited by 5
- 2026Towards Anomaly Detection on Relational Datacited by 4
- 2026EMS: Multi-Agent Voting via Efficient Majority-then-Stoppingcited by 2
- 2025Test-time GNN Model Evaluation on Dynamic Graphscited by 1
- 2026Topological Coherence for Self-evolving Multi-agent Systemscited by 0
- 2026Topological Coherence for Self-evolving Multi-agent Systems29 Sep 2026
- 2026Towards Anomaly Detection on Relational Data17 Jun 2026
- 2026EMS: Multi-Agent Voting via Efficient Majority-then-Stopping3 Apr 2026
- 2026DynHD: Hallucination Detection for Diffusion Large Language Models via Denoising Dynamics Deviation Learning17 Mar 2026
- 2026Towards One-for-All Anomaly Detection for Tabular Data15 Mar 2026
- 2025Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test Time10 Nov 2025
- 2025Hollywood Town: Long-Video Generation via Cross-Modal Multi-Agent Orchestration25 Oct 2025
- 2025Test-time GNN Model Evaluation on Dynamic Graphs28 Sep 2025
- 2025A Survey of Generalization of Graph Anomaly Detection: From Transfer Learning to Foundation Models8 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks
- 2026AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code Generation
- 2025AMAS: Adaptively Determining Communication Topology for LLM-based Multi-Agent System
- 2025Topological Structure Learning Should Be A Research Priority for LLM-Based Multi-Agent Systems
- 2026CARD: Towards Conditional Design of Multi-agent Topological Structures
- 2025AgentBalance: Backbone-then-Topology Design for Cost-Effective Multi-Agent Systems under Budget Constraints
- 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems
- 2026MANTA: Multi-Agent Network Topology Adaptation for Self-Evolving Multi-Agent Systems