mlsanityData to 7 Oct 2026

SC-MAS: Constructing Cost-Efficient Multi-Agent Systems with Edge-Level Heterogeneous Collaboration

arXiv 2601.09434 ↗First posted 14 Jan 2026cs.MAcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large Language Model (LLM)-based Multi-Agent Systems (MAS) enhance complex problem solving through multi-agent collaboration, but often incur substantially higher costs than single-agent systems. Recent MAS routing methods aim to balance performance and overhead by dynamically selecting agent roles and language models. However, these approaches typically rely on a homogeneous collaboration mode, where all agents follow the same interaction pattern, limiting collaboration flexibility across different roles. Motivated by Social Capital Theory, which emphasizes that different roles benefit from distinct forms of collaboration, we propose SC-MAS, a framework for constructing heterogeneous and cost-efficient multi-agent systems. SC-MAS models MAS as directed graphs, where edges explicitly represent pairwise collaboration strategies, allowing different agent pairs to interact through tailored communication patterns. Given an input query, a unified controller progressively constructs an executable MAS by selecting task-relevant agent roles, assigning edge-level collaboration strategies, and allocating appropriate LLM backbones to individual agents. Experiments on multiple benchmarks demonstrate the effectiveness of SC-MAS. In particular, SC-MAS improves accuracy by 3.35% on MMLU while reducing inference cost by 15.38%, and achieves a 3.53% accuracy gain with a 12.13% cost reduction on MBPP. These results validate the feasibility of SC-MAS and highlight the effectiveness of heterogeneous collaboration in multi-agent systems.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 31 of its 55 references that are in the map. First posted on arXiv 14 Jan 2026.

Builds on

31 of 55 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Space8 Oct
  2. 2024Scaling Large Language Model-based Multi-Agent Collaboration11 Jun
  3. 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
  4. 2024Small LLMs Are Weak Tool Learners: A Multi-LLM Agent14 Jan
  5. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate14 Aug
  6. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  7. 2021Program Synthesis with Large Language Modelscited by 3,509
  8. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  9. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  10. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  11. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  12. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
13 more
  1. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
  2. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  3. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  4. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  5. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
  6. 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 354
  7. 2023S3: Social-network Simulation System with Large Language Model-Empowered Agentscited by 228
  8. 2024RouterBench: A Benchmark for Multi-LLM Routing Systemcited by 222
  9. 2024GraphRouter: A Graph-based Router for LLM Selectionscited by 154
  10. 2025EvoFlow: Evolving Diverse Agentic Workflows On The Flycited by 49
  11. 2024Cost-Effective Online Multi-LLM Selection with Versatile Reward Modelscited by 36
  12. 2024Routoo: Learning to Route to Large Language Models Effectivelycited by 34
  13. 2024Small Language Models are Good Too: An Empirical Study of Zero-Shot Classificationcited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025MasRouter: Learning to Route LLMs for Multi-Agent Systems
  2. 2025X-MAS: Towards Building Multi-Agent Systems with Heterogeneous LLMs
  3. 2026Token-Efficient Multi-Agent Collaboration via System One-Guided Computational Division of Labor
  4. 2026MASBench: Benchmarking LLM-based Multi-Agent Collaboration under Partial Observability
  5. 2026Orchestrating Intelligence: Confidence-Aware Routing for Efficient Multi-Agent Collaboration across Multi-Scale Models
  6. 2025Optimal-Agent-Selection: State-Aware Routing Framework for Efficient Multi-Agent Collaboration
  7. 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
  8. 2025AgentBalance: Backbone-then-Topology Design for Cost-Effective Multi-Agent Systems under Budget Constraints