mlsanityData to 7 Oct 2026

Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation

arXiv 2507.18224 ↗First posted 24 Jul 2025cs.MA cs.CLcited by 57

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Multi-agent systems (MAS) based on large language models (LLMs) have emerged as a powerful solution for dealing with complex problems across diverse domains. The effectiveness of MAS is critically dependent on its collaboration topology, which has become a focal point for automated design research. However, existing approaches are fundamentally constrained by their reliance on a template graph modification paradigm with a predefined set of agents and hard-coded interaction structures, significantly limiting their adaptability to task-specific requirements. To address these limitations, we reframe MAS design as a conditional autoregressive graph generation task, where both the system composition and structure are designed jointly. We propose ARG-Designer, a novel autoregressive model that operationalizes this paradigm by constructing the collaboration graph from scratch. Conditioned on a natural language task query, ARG-Designer sequentially and dynamically determines the required number of agents, selects their appropriate roles from an extensible pool, and establishes the optimal communication links between them. This generative approach creates a customized topology in a flexible and extensible manner, precisely tailored to the unique demands of different tasks. Extensive experiments across six diverse benchmarks demonstrate that ARG-Designer not only achieves state-of-the-art performance but also enjoys significantly greater token efficiency and enhanced extensibility. The source code of ARG-Designer is available at https://github.com/Shiy-Li/ARG-Designer.

Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 26 of its 43 references that are in the map. First posted on arXiv 24 Jul 2025.

Builds on

26 of 43 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies4 Feb
  2. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug

Other references · 24

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  5. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  6. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  7. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
  8. 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 642
  9. 2018GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Modelscited by 406
  10. 2016Solving General Arithmetic Word Problemscited by 353
  11. 2019Efficient Graph Generation with Graph Recurrent Attention Networkscited by 231
  12. 2024Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understandingcited by 185
12 more
  1. 2024Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step-by-stepcited by 123
  2. 2023Autoregressive Diffusion Model for Graph Generationcited by 82
  3. 2023Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communicationcited by 78
  4. 2020GraphGen: A Scalable Approach to Domain-agnostic Labeled Graph Generationcited by 65
  5. 2020Scalable Deep Generative Modeling for Sparse Graphscited by 63
  6. 2024Are Large Language Models Good Statisticians?cited by 26
  7. 2025A Label-Free Heterophily-Guided Approach for Unsupervised Graph Fraud Detectioncited by 24
  8. 2023A Simple and Scalable Representation for Graph Generationcited by 15
  9. 2025Uncertainty-Aware Graph Neural Networks: A Multi-Hop Evidence Fusion Approachcited by 14
  10. 2025Bisecle: Binding and Separation in Continual Learning for Video Language Understandingcited by 13
  11. 2024Noise-Resilient Unsupervised Graph Representation Learning via Multi-Hop Feature Quality Estimationcited by 11
  12. 2021CCGG: A Deep Autoregressive Model for Class-Conditional Graph Generationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 13; 2026: 44.

57 papers.

Sort:

By area:

  1. 2025BlindGuard: Safeguarding LLM-based Multi-Agent Systems under Unknown Attackscited by 37
  2. 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 22
  3. 2025Graph-Augmented Large Language Model Agents: Current Progress and Future Prospectscited by 14
  4. 2025A Survey of Generalization of Graph Anomaly Detection: From Transfer Learning to Foundation Modelscited by 13
  5. 2026DynHD: Hallucination Detection for Diffusion Large Language Models via Denoising Dynamics Deviation Learningcited by 13
  6. 2025Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test Timecited by 12
  7. 2026OFA-MAS: One-for-All Multi-Agent System Topology Design based on Mixture-of-Experts Graph Generative Modelscited by 12
  8. 2025Dynamic Generation of Multi-LLM Agents Communication Topologies with Graph Diffusion Modelscited by 11
  9. 2025Stop Wasting Your Tokens: Towards Efficient Runtime Multi-Agent Systemscited by 11
  10. 2025Hollywood Town: Long-Video Generation via Cross-Modal Multi-Agent Orchestrationcited by 10
  11. 2025Beyond Pipelines: A Survey of the Paradigm Shift toward Model-Native Agentic AIcited by 8
  12. 2025Explainable and Fine-Grained Safeguarding of LLM Multi-Agent Systems via Bi-Level Graph Anomaly Detectioncited by 8
38 more
  1. 2026MetaGen: Self-Evolving Roles and Topologies for Multi-Agent LLM Reasoningcited by 8
  2. 2025Metacognitive Self-Correction for Multi-Agent System via Prototype-Guided Next-Execution Reconstructioncited by 6
  3. 2026Towards One-for-All Anomaly Detection for Tabular Datacited by 5
  4. 2026GoAgent: Group-of-Agents Communication Topology Generation for LLM-based Multi-Agent Systemscited by 5
  5. 2026Self-Improvement of Large Language Models: A Technical Overview and Future Outlookcited by 5
  6. 2026RADAR: Redundancy-Aware Diffusion for Multi-Agent Communication Structure Generationcited by 5
  7. 2025Generalizing Test-time Compute-optimal Scaling as an Optimizable Graphcited by 4
  8. 2026EvoMAS: Evolutionary Generation of Multi-Agent Systemscited by 4
  9. 2026Holos: A Web-Scale LLM-Based Multi-Agent System for the Agentic Webcited by 4
  10. 2026TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systemscited by 4
  11. 2026Towards Anomaly Detection on Relational Datacited by 4
  12. 2026Self-Evolving Agents as Dynamic Graph Transformation: A Survey and New Perspectivecited by 4
  13. 2026TopoDIM: One-shot Topology Generation of Diverse Interaction Modes for Multi-Agent Systemscited by 3
  14. 2026Beyond a Single Perspective: Text Anomaly Detection with Multi-View Language Representationscited by 3
  15. 2025HyperAgent: Leveraging Hypergraphs for Topology Optimization in Multi-Agent Communicationcited by 2
  16. 2026Agent Q-Mix: Selecting the Right Action for LLM Multi-Agent Systems through Reinforcement Learningcited by 2
  17. 2026EMS: Multi-Agent Voting via Efficient Majority-then-Stoppingcited by 2
  18. 2026Evolve as a Team: Collaborative Self-Evolution for LLM-based Multi-Agent Systemscited by 2
  19. 2026SIGMA: Skill-Incidence Graphs for Compositional Multi-Agent Designcited by 2
  20. 2025Test-time GNN Model Evaluation on Dynamic Graphscited by 1
  21. 2026ST-EVO: Towards Generative Spatio-Temporal Evolution of Multi-Agent Communication Topologiescited by 1
  22. 2026Taming "Zombie'' Agents: A Markov State-Aware Framework for Resilient Multi-Agent Evolutioncited by 1
  23. 2026Learning Transferable Topology Priors for Multi-Agent LLM Collaboration Across Domainscited by 1
  24. 2026ATOM: Instantiating Budget-Controllable Multi-Agent Collaboration via Nucleus-Electron Hierarchycited by 1
  25. 2026Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inferencecited by 1
  26. 2026When Evidence Shapes Collaboration: Knowledge-Conditioned Topology Generation for Multi-Agent Systemscited by 1
  27. 2026Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systemscited by 1
  28. 2026Rethinking the Evaluation of Efficiency Methods for Multi-Agent Systemscited by 1
  29. 2026Active Learning for Communication Structure Optimization in LLM-Based Multi-Agent Systemscited by 0
  30. 2026LEMON: Learning Executable Multi-Agent Orchestration via Counterfactual Reinforcement Learningcited by 0
  31. 2026Differentiable Mixture-of-Agents Incentivizes Swarm Intelligence of Large Language Modelscited by 0
  32. 2026MasFACT: Continual Multi-Agent Topology Learning via Geometry-Aware Posterior Transfercited by 0
  33. 2026PEAR: Permutation-Equivariant Adaptive Routing Multi-Agent Debatecited by 0
  34. 2026AutoResearch: An Execution-Grounded Multi-Agent Framework for Reliable Research Workflow Automationcited by 0
  35. 2026Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Designcited by 0
  36. 2026Proxifield: Decentralized Multi-Agent Communication through Semantic Proximitycited by 0
  37. 2026OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systemscited by 0
  38. 2026MAGIC: Mixed-Granularity Agent Graphs via Incremental Construction with Dense-Reward Reinforcement Learningcited by 0

50 most cited of 57 All 57 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks
  2. 2026AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code Generation
  3. 2025AMAS: Adaptively Determining Communication Topology for LLM-based Multi-Agent System
  4. 2025Topological Structure Learning Should Be A Research Priority for LLM-Based Multi-Agent Systems
  5. 2026CARD: Towards Conditional Design of Multi-agent Topological Structures
  6. 2025AgentBalance: Backbone-then-Topology Design for Cost-Effective Multi-Agent Systems under Budget Constraints
  7. 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems
  8. 2026MANTA: Multi-Agent Network Topology Adaptation for Self-Evolving Multi-Agent Systems