Topological Structure Learning Should Be A Research Priority for LLM-Based Multi-Agent Systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Large Language Model-based Multi-Agent Systems (MASs) have emerged as a powerful paradigm for tackling complex tasks through collaborative intelligence. However, the topology of these systems--how agents in MASs should be configured, connected, and coordinated--remains largely unexplored. In this position paper, we call for a paradigm shift toward topology-aware MASs that explicitly model and dynamically optimize the structure of inter-agent interactions. We identify three fundamental components--agents, communication links, and overall topology--that collectively determine the system's adaptability, efficiency, robustness, and fairness. To operationalize this vision, we introduce a systematic three-stage framework: 1) agent selection, 2) structure profiling, and 3) topology synthesis. This framework not only provides a principled foundation for designing MASs but also opens new research frontiers across language modeling, reinforcement learning, graph learning, and generative modeling to ultimately unleash their full potential in complex real-world applications. We conclude by outlining key challenges and opportunities in MASs evaluation. We hope our framework and perspectives offer critical new insights in the era of agentic AI.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 49 of its 65 references that are in the map. First posted on arXiv 28 May 2025.
Builds on
49 of 65 references.
Closest ancestors · 17
Same direction, newest first
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems31 Mar
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents3 Mar
- 2025MasRouter: Learning to Route LLMs for Multi-Agent Systems16 Feb
- 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks15 Oct
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems3 Oct
- 2024Agent-Oriented Planning in Multi-Agent Systems3 Oct
- 2024Automated Design of Agentic Systems15 Aug
- 2024Scaling Large Language Model-based Multi-Agent Collaboration11 Jun
- 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
- 2024Chain of Agents: Large Language Models Collaborating on Long-Context Tasks4 Jun
- 2024Dynamic Evaluation of Large Language Models by Meta Probing Agents21 Feb
5 more
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration3 Oct
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 32
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 530
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 448
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2019Diffusion Improves Graph Learningcited by 414
- 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 282
- 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solvingcited by 177
20 more
- 2023DyVal: Dynamic Evaluation of Large Language Models for Reasoning Taskscited by 101
- 2024AgentReview: Exploring Peer Review Dynamics with LLM Agentscited by 93
- 2023Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queriescited by 82
- 2015Online Learning with Feedback Graphs: Beyond Banditscited by 80
- 2025ReMA: Learning to Meta-think for LLMs with Multi-Agent Reinforcement Learningcited by 79
- 2024LLM-based Multi-Agent Reinforcement Learning: Current and Future Directionscited by 67
- 2023CompeteAI: Understanding the Competition Dynamics in Large Language Model-based Agentscited by 65
- 2024Learning Multi-Agent Communication from Graph Modeling Perspectivecited by 48
- 2024How Easy is It to Fool Your Multimodal LLMs? An Empirical Analysis on Deceptive Promptscited by 47
- 2025CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countriescited by 42
- 2025Optimizing Model Selection for Compound AI Systemscited by 36
- 2022Global Counterfactual Explainer for Graph Neural Networkscited by 30
- 2024NetSafe: Exploring the Topological Safety of Multi-agent Networkscited by 29
- 2015Thompson Sampling for Budgeted Multi-armed Banditscited by 24
- 2024AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Makingcited by 20
- 2022A Near-Optimal Best-of-Both-Worlds Algorithm for Online Learning with Feedback Graphscited by 17
- 2025Mind the Gap! Static and Interactive Evaluations of Large Audio Modelscited by 8
- 2021Cooperative Online Learning with Feedback Graphscited by 4
- 2024MathLearner: A Large Language Model Agent Framework for Learning to Solve Mathematical Problemscited by 4
- 2022Minecraft: An Engaging Platform to Learn Programmingcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Reasoning Models Generate Societies of Thoughtcited by 12
- 2025Don't Trust Your Upstream: Exploiting LLM Multi-Agent System via Topology-Guided Adversarial Propagationcited by 5
- 2026Small Model as Master Orchestrator: Learning Unified Agent-Tool Orchestration with Parallel Subtask Decompositioncited by 2
- 2026Active Learning for Communication Structure Optimization in LLM-Based Multi-Agent Systemscited by 0
- 2026MESA: Prioritizing Vulnerable Communication Channels for Securing Multi-Agent Systemscited by 0
- 2026MESA: Prioritizing Vulnerable Communication Channels for Securing Multi-Agent Systems29 Jun 2026
- 2026Active Learning for Communication Structure Optimization in LLM-Based Multi-Agent Systems7 May 2026
- 2026Small Model as Master Orchestrator: Learning Unified Agent-Tool Orchestration with Parallel Subtask Decomposition18 Apr 2026
- 2026Reasoning Models Generate Societies of Thought15 Jan 2026
- 2025Don't Trust Your Upstream: Exploiting LLM Multi-Agent System via Topology-Guided Adversarial Propagation3 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Dynamic Generation of Multi-LLM Agents Communication Topologies with Graph Diffusion Models
- 2026AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code Generation
- 2026GoAgent: Group-of-Agents Communication Topology Generation for LLM-based Multi-Agent Systems
- 2026HieraMAS: Optimizing Intra-Node LLM Mixtures and Inter-Node Topology for Multi-Agent Systems
- 2026Graph-GRPO: Stabilizing Multi-Agent Topology Learning via Group Relative Policy Optimization
- 2025Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation
- 2026Learning Transferable Topology Priors for Multi-Agent LLM Collaboration Across Domains
- 2026PRISM: PRIvileged Sibling-guided Multi-Agent Topology Design