mlsanityData to 7 Oct 2026

Efficient and Interpretable Multi-Agent LLM Routing via Ant Colony Optimization

arXiv 2603.12933 ↗First posted 13 Mar 2026cs.AIcited by 2

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large Language Model (LLM)-driven Multi-Agent Systems (MAS) have demonstrated strong capability in complex reasoning and tool use, and heterogeneous agent pools further broaden the quality--cost trade-off space. Despite these advances, real-world deployment is often constrained by high inference cost, latency, and limited transparency, which hinders scalable and efficient routing. Existing routing strategies typically rely on expensive LLM-based selectors or static policies, and offer limited controllability for semantic-aware routing under dynamic loads and mixed intents, often resulting in unstable performance and inefficient resource utilization. To address these limitations, we propose AMRO-S, an efficient and interpretable routing framework for Multi-Agent Systems (MAS). AMRO-S models MAS routing as a semantic-conditioned path selection problem, enhancing routing performance through three key mechanisms: First, it leverages a supervised fine-tuned (SFT) small language model for intent inference, providing a low-overhead semantic interface for each query; second, it decomposes routing memory into task-specific pheromone specialists, reducing cross-task interference and optimizing path selection under mixed workloads; finally, it employs a quality-gated asynchronous update mechanism to decouple inference from learning, optimizing routing without increasing latency. Extensive experiments on five public benchmarks and high-concurrency stress tests demonstrate that AMRO-S consistently improves the quality--cost trade-off over strong routing baselines, while providing traceable routing evidence through structured pheromone patterns.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 38 of its 65 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

38 of 65 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory6 Aug
  2. 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems13 Mar
  3. 2025MasRouter: Learning to Route LLMs for Multi-Agent Systems16 Feb
  4. 2024MALT: Improving Reasoning with Multi-Agent LLM Training2 Dec
  5. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms20 Jun
  6. 2024Scaling Large Language Model-based Multi-Agent Collaboration11 Jun
  7. 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
  8. 2024Can LLM-Augmented autonomous agents cooperate?, An evaluation of their cooperative capabilities through Melting Pot18 Mar
  9. 2024LLM Multi-Agent Systems: Challenges and Open Problems5 Feb
  10. 2023A Survey on Large Language Model based Autonomous Agents22 Aug
  11. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug

Other references · 27

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  6. 2021Program Synthesis with Large Language Modelscited by 3,509
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  8. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  9. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  10. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
  11. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  12. 2024AFlow: Automating Agentic Workflow Generationcited by 395
15 more
  1. 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 354
  2. 2024RouterBench: A Benchmark for Multi-LLM Routing Systemcited by 222
  3. 2023Routing to the Expert: Efficient Reward-guided Ensemble of Large Language Modelscited by 141
  4. 2024RouterDC: Query-Based Router by Dual Contrastive Learning for Assembling Large Language Modelscited by 84
  5. 2024Towards Lifelong Learning of Large Language Models: A Surveycited by 60
  6. 2025Atom of Thoughts for Markov LLM Test-Time Scalingcited by 54
  7. 2025Confident or Seek Stronger: Exploring Uncertainty-Based On-device LLM Routing From Benchmarking to Generalizationcited by 29
  8. 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answeringcited by 29
  9. 2025A Comprehensive Survey on Multi-Agent Cooperative Decision-Making: Scenarios, Approaches, Challenges and Perspectivescited by 27
  10. 2025DocAgent: A Multi-Agent System for Automated Code Documentation Generationcited by 16
  11. 2026Learning Global Hypothesis Space for Enhancing Synergistic Reasoning Chaincited by 15
  12. 2026Text summarization via global structure awarenesscited by 11
  13. 2024Cooperative Resilience in Artificial Intelligence Multiagent Systemscited by 8
  14. 2026TCAndon-Router: Adaptive Reasoning Router for Multi-Agent Collaborationcited by 3
  15. 2024HEnRY: A Multi-Agent System Framework for Multi-Domain Contextscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Generalized Routing: Model and Agent Orchestration for Adaptive and Efficient Inference
  2. 2026SC-MAS: Constructing Cost-Efficient Multi-Agent Systems with Edge-Level Heterogeneous Collaboration
  3. 2026GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs
  4. 2026Learning Agent Routing From Early Experience
  5. 2025Optimal-Agent-Selection: State-Aware Routing Framework for Efficient Multi-Agent Collaboration
  6. 2026Orchestrating Intelligence: Confidence-Aware Routing for Efficient Multi-Agent Collaboration across Multi-Scale Models
  7. 2026Agent-as-a-Router: Agentic Model Routing for Coding Tasks
  8. 2026CASTER: Breaking the Cost-Performance Barrier in Multi-Agent Orchestration via Context-Aware Strategy for Task Efficient Routing