OFA-MAS: One-for-All Multi-Agent System Topology Design based on Mixture-of-Experts Graph Generative Models
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
also in 1 more
Abstract (arXiv)
Multi-Agent Systems (MAS) offer a powerful paradigm for solving complex problems, yet their performance is critically dependent on the design of their underlying collaboration topology. As MAS become increasingly deployed in web services (e.g., search engines), designing adaptive topologies for diverse cross-domain user queries becomes essential. Current graph learning-based design methodologies often adhere to a "one-for-one" paradigm, where a specialized model is trained for each specific task domain. This approach suffers from poor generalization to unseen domains and fails to leverage shared structural knowledge across different tasks. To address this, we propose OFA-TAD, a one-for-all framework that generates adaptive collaboration graphs for any task described in natural language through a single universal model. Our approach integrates a Task-Aware Graph State Encoder (TAGSE) that filters task-relevant node information via sparse gating, and a Mixture-of-Experts (MoE) architecture that dynamically selects specialized sub-networks to drive node and edge prediction. We employ a three-stage training strategy: unconditional pre-training on canonical topologies for structural priors, large-scale conditional pre-training on LLM-generated datasets for task-topology mappings, and supervised fine-tuning on empirically validated graphs. Experiments across six diverse benchmarks show that OFA-TAD significantly outperforms specialized one-for-one models, generating highly adaptive MAS topologies. Code: https://github.com/Shiy-Li/OFA-MAS.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 26 of its 42 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
26 of 42 references.
Closest ancestors · 2
Same direction, newest first
- 2025Assemble Your Crew: Automatic Multi-agent Communication Topology Design via Autoregressive Graph Generation24 Jul
- 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
Other references · 24
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
- 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 642
- 2016Solving General Arithmetic Word Problemscited by 353
- 2024Debating with More Persuasive LLMs Leads to More Truthful Answerscited by 255
12 more
- 2019Efficient Graph Generation with Graph Recurrent Attention Networkscited by 231
- 2022A Survey of Multi-Agent Deep Reinforcement Learning with Communicationcited by 103
- 2024Self-Evolving Multi-Agent Collaboration Networks for Software Developmentcited by 73
- 2024ARC: A Generalist Graph Anomaly Detector with In-Context Learningcited by 46
- 2024Pard: Permutation-Invariant Autoregressive Diffusion for Graph Generationcited by 25
- 2025A Label-Free Heterophily-Guided Approach for Unsupervised Graph Fraud Detectioncited by 24
- 2025Uncertainty-Aware Graph Neural Networks: A Multi-Hop Evidence Fusion Approachcited by 14
- 2025A Survey of Generalization of Graph Anomaly Detection: From Transfer Learning to Foundation Modelscited by 13
- 2025Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test Timecited by 12
- 2024Noise-Resilient Unsupervised Graph Representation Learning via Multi-Hop Feature Quality Estimationcited by 11
- 2025FreeGAD: A Training-Free yet Effective Approach for Graph Anomaly Detectioncited by 10
- 2024Overcoming Order in Autoregressive Graph Generationcited by 3
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026DynHD: Hallucination Detection for Diffusion Large Language Models via Denoising Dynamics Deviation Learningcited by 13
- 2026FedCIGAR: A Personalized Reconstruction Approach for Federated Graph-level Anomaly Detectioncited by 6
- 2026Towards One-for-All Anomaly Detection for Tabular Datacited by 5
- 2026Towards Anomaly Detection on Relational Datacited by 4
- 2026Beyond a Single Perspective: Text Anomaly Detection with Multi-View Language Representationscited by 3
- 2026Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inferencecited by 1
- 2026LEMON: Learning Executable Multi-Agent Orchestration via Counterfactual Reinforcement Learningcited by 0
- 2026PaSta: Noisy Node Classification with Partial Label Learningcited by 0
- 2026SIM: Subspace Interaction-based Method for Token-Level Text Anomaly Detectioncited by 0
- 2026CERA-MoA: Co-Evolving Routing Mechanisms with Continually Learning LLM Agentscited by 0
- 2026DiFA: Dual Evidence Fusion and Aggregation for Token-Level Text Anomaly Detectioncited by 0
- 2026Beyond Solo and Consistency: Vindicating Multi-Agent Debate via Conditional Progressive Pruningcited by 0
- 2026Beyond Solo and Consistency: Vindicating Multi-Agent Debate via Conditional Progressive Pruning27 Sep 2026
- 2026CERA-MoA: Co-Evolving Routing Mechanisms with Continually Learning LLM Agents16 Sep 2026
- 2026SIM: Subspace Interaction-based Method for Token-Level Text Anomaly Detection8 Sep 2026
- 2026PaSta: Noisy Node Classification with Partial Label Learning26 Aug 2026
- 2026DiFA: Dual Evidence Fusion and Aggregation for Token-Level Text Anomaly Detection24 Aug 2026
- 2026Discovering Efficient and Explainable Communication Topologies for LLM-based Multi-Agent Systems via Causal Inference13 Aug 2026
- 2026Towards Anomaly Detection on Relational Data17 Jun 2026
- 2026LEMON: Learning Executable Multi-Agent Orchestration via Counterfactual Reinforcement Learning14 May 2026
- 2026FedCIGAR: A Personalized Reconstruction Approach for Federated Graph-level Anomaly Detection10 May 2026
- 2026DynHD: Hallucination Detection for Diffusion Large Language Models via Denoising Dynamics Deviation Learning17 Mar 2026
- 2026Towards One-for-All Anomaly Detection for Tabular Data15 Mar 2026
- 2026Beyond a Single Perspective: Text Anomaly Detection with Multi-View Language Representations25 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Adaptive Graph Pruning for Multi-Agent Communication
- 2025AMAS: Adaptively Determining Communication Topology for LLM-based Multi-Agent System
- 2026Graph-of-Agents: A Graph-based Framework for Multi-Agent LLM Collaboration
- 2026Rethinking Multi-Agent Collaboration: When More Is Less
- 2024G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks
- 2026SkillGraph: Self-Evolving Multi-Agent Collaboration with Multimodal Graph Topology
- 2026Learning Transferable Topology Priors for Multi-Agent LLM Collaboration Across Domains
- 2026GraphMAS: A Systematic Benchmark of Multi-Agent Coordination for Graph Learning