CASTER: Breaking the Cost-Performance Barrier in Multi-Agent Orchestration via Context-Aware Strategy for Task Efficient Routing
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Graph-based Multi-Agent Systems (MAS) enable complex cyclic workflows but suffer from inefficient static model allocation, where deploying strong models uniformly wastes computation on trivial sub-tasks. We propose CASTER (Context-Aware Strategy for Task Efficient Routing), a lightweight router for dynamic model selection in graph-based MAS. CASTER employs a Dual-Signal Router that combines semantic embeddings with structural meta-features to estimate task difficulty. During training, the router self-optimizes through a Cold Start to Iterative Evolution paradigm, learning from its own routing failures via on-policy negative feedback. Experiments using LLM-as-a-Judge evaluation across Software Engineering, Data Analysis, Scientific Discovery, and Cybersecurity demonstrate that CASTER reduces inference cost by up to 72.4% compared to strong-model baselines while matching their success rates, and consistently outperforms both heuristic routing and FrugalGPT across all domains.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 21 of its 24 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
21 of 24 references.
Closest ancestors · 6
Same direction, newest first
- 2025OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaboration5 Sep
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents3 Mar
- 2025Multi-agent Architecture Search via Agentic Supernet6 Feb
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents24 Jan
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 15
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Qwen Technical Reportcited by 3,273
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 248
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
3 more
- 2023TaskWeaver: A Code-First Agent Frameworkcited by 85
- 2024Hypothesis Generation with Large Language Modelscited by 68
- 2025Self-Improvement of Language Models by Post-Training on Multi-Agent Debatecited by 7
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026AdaptOrch: Task-Adaptive Multi-Agent Orchestration in the Era of LLM Performance Convergence
- 2026GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMs
- 2026HM-ROUTER: Joint Model and Harness Routing for Agentic Systems
- 2026Agent-as-a-Router: Agentic Model Routing for Coding Tasks
- 2025Optimal-Agent-Selection: State-Aware Routing Framework for Efficient Multi-Agent Collaboration
- 2026Orchestrating Intelligence: Confidence-Aware Routing for Efficient Multi-Agent Collaboration across Multi-Scale Models
- 2026Uno-Orchestra: Parsimonious Agent Routing via Selective Delegation
- 2026Learning Compositional Meta-Routing for Agentic Workflows: An Executable Benchmark