Learning Transferable Topology Priors for Multi-Agent LLM Collaboration Across Domains
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Large language model (LLM)-based multi-agent systems have shown strong potential for complex reasoning by coordinating specialized agents through structured communication. However, existing topology-evolution methods typically construct or optimize a collaboration topology for each query from scratch, leading to substantial online search overhead, high inference-time token consumption, and limited scalability in multi-domain settings. We propose TopoPrior, a framework for learning transferable topology priors for multi-agent LLM collaboration across domains. Rather than repeatedly searching for effective collaboration structures online, TopoPrior learns reusable topology priors from reference collaboration graphs collected offline from multiple domains and uses them to generate query-conditioned initial collaboration graphs for downstream refinement. By shifting part of topology search from per-query online optimization to offline prior learning, TopoPrior amortizes search cost while remaining compatible with existing topology-evolution backbones. Technically, TopoPrior contains two key components. First, a transferable topology prior learning module employs a conditional variational graph framework to capture reusable structural regularities across domains in a latent space. Second, a query-conditioned latent adaptation module introduces adversarial alignment to reduce unnecessary domain discrepancy while preserving query-relevant structural variation. Experiments on multi-domain reasoning benchmarks show that TopoPrior consistently improves several heterogeneous topology-evolution backbones while reducing online inference-time token usage, with only modest additional trainable parameters. These results suggest that transferable topology initialization is an effective and lightweight mechanism for improving the efficiency of multi-agent LLM collaboration across domains.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 44 of its 60 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
44 of 60 references.
Closest ancestors · 5
Same direction, newest first
- 2025Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation24 Jul
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks15 Oct
- 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems3 Oct
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration3 Oct
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
Other references · 39
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
27 more
- 2016Variational Graph Auto-Encoderscited by 1,373
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
- 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
- 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 221
- 2022Fine-tuned Language Models are Continual Learnerscited by 152
- 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thoughtcited by 120
- 2023A Comprehensive Survey on Source-free Domain Adaptationcited by 104
- 2024Self-Organized Agents: A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimizationcited by 84
- 2018How to Read Paintings: Semantic Art Understanding with Multi-Modal Retrievalcited by 73
- 2024Understanding the Dark Side of LLMs' Intrinsic Self-Correctioncited by 42
- 2022Multi-Prompt Alignment for Multi-Source Unsupervised Domain Adaptationcited by 25
- 2022Attribution-aware Weight Transfer: A Warm-Start Initialization for Class-Incremental Semantic Segmentationcited by 21
- 2023CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Taskscited by 18
- 2024GraphInsight: Unlocking Insights in Large Language Models for Graph Structure Understandingcited by 18
- 2023M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Modelscited by 15
- 2022PAC-Bayesian Domain Adaptation Bounds for Multiclass Learnerscited by 13
- 2025Diversity as a Reward: Fine-Tuning LLMs on a Mixture of Domain-Undetermined Datacited by 13
- 2024Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuningcited by 11
- 2025Dynamic Expert Specialization: Towards Catastrophic Forgetting-Free Multi-Domain MoE Adaptationcited by 8
- 2024CMNEE: A Large-Scale Document-Level Event Extraction Dataset based on Open-Source Chinese Military Newscited by 6
- 2025A Multi-Agent Framework with Automated Decision Rule Optimization for Cross-Domain Misinformation Detectioncited by 6
- 2022To Adapt or to Annotate: Challenges and Interventions for Domain Adaptation in Open-Domain Question Answeringcited by 5
- 2024MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learningcited by 5
- 2023Fast, Scalable, Warm-Start Semidefinite Programming with Spectral Bundling and Sketchingcited by 4
- 2024Scalable Multi-Domain Adaptation of Language Models using Modular Expertscited by 3
- 2025Efficient Prompt Optimisation for Legal Text Classification with Proxy Prompt Evaluatorcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026MasFACT: Continual Multi-Agent Topology Learning via Geometry-Aware Posterior Transfer
- 2025Topological Structure Learning Should Be A Research Priority for LLM-Based Multi-Agent Systems
- 2026OFA-MAS: One-for-All Multi-Agent System Topology Design based on Mixture-of-Experts Graph Generative Models
- 2026When Evidence Shapes Collaboration: Knowledge-Conditioned Topology Generation for Multi-Agent Systems
- 2025AnyMAC: Cascading Flexible Multi-Agent Collaboration via Next-Agent Prediction
- 2026SkillGraph: Self-Evolving Multi-Agent Collaboration with Multimodal Graph Topology
- 2026Inference-Time Graph Engineering for Multi-Agent LLM Workflows
- 2026Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inference