mlsanityData to 14 Oct 2026

Agentic Routing: The Harness-Native Data Flywheel

arXiv 2607.11399 ↗First posted 13 Jul 2026cs.CL cs.AIcited by 4

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large language model agents are increasingly executed not by a single model call, but by an execution harness that manages observation, context, control, action, state, and verification. At the same time, frontier and open models are becoming structurally specialized: a model that is strong at code editing, long-context recovery, tool use, mathematical reasoning, or low-latency response may not dominate on the other axes. This makes model selection inside an agent a core systems problem rather than a per-query serving trick. Existing routing methods mostly optimize single-turn cost-quality trade-offs and therefore miss the execution state, intermediate failures, and feedback loops that make agents different from chat completion. We propose Harness-Native agentic routing, a step-level routing paradigm that selects either a single best-fit model for cost-effective execution or multiple complementary models for ensemble-style accuracy improvement, conditioned on the full harness state. The key insight is that every routing decision naturally produces a structured data record -- consisting of the query, harness state, model choice or model set, execution trace, outcome, and cost -- whose labels are supplied by the environment rather than by the router itself. These records form a harness-native data flywheel: execution traces train better routers and harness-native models, which improve cost-quality trade-offs and generate more traces under the same budget. We instantiate this idea in OpenSquilla with a four-layer routing stack, an open LightGBM cold-start ranker, and a staged router-model path that turns logged arena records into progressively stronger routing policies. The report studies singleton and multi-model routing on agentic benchmarks including DRACO and PinchBench, and argues that agentic routing is not merely cost control, but a data engine for agent-native training.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 31 of its 40 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

31 of 40 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026Agent-as-a-Router: Agentic Model Routing for Coding Tasks22 Jun
  2. 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Design14 Jun
  3. 2026TwinRouterBench: Fast Static and Live Dynamic Evaluation for Realistic Agentic LLM Routing14 May
  4. 2026Switchcraft: AI Model Router for Agentic Tool Calling8 May
  5. 2026Explainable Model Routing for Agentic Workflows4 Apr
  6. 2025MasRouter: Learning to Route LLMs for Multi-Agent Systems16 Feb
  7. 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
  8. 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models19 Mar
  9. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMs19 Oct

Other references · 22

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  5. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  6. 2025OpenAI GPT-5 System Cardcited by 989
  7. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
  8. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  9. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 564
  10. 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 372
  11. 2024RouterBench: A Benchmark for Multi-LLM Routing Systemcited by 238
  12. 2023Large Language Model Routing with Benchmark Datasetscited by 172
10 more
  1. 2023Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modelingcited by 95
  2. 2026LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routingcited by 38
  3. 2024Routoo: Learning to Route to Large Language Models Effectivelycited by 34
  4. 2025Adaptive LLM Routing under Budget Constraintscited by 24
  5. 2026Dynamic Model Routing and Cascading for Efficient LLM Inference: A Surveycited by 19
  6. 2026DRACO: a Cross-Domain Benchmark for Deep Research Accuracy, Completeness, and Objectivitycited by 14
  7. 2025TagRouter: Learning Route to LLMs through Tags for Open-Domain Text Generation Taskscited by 9
  8. 2025Arch-Router: Aligning LLM Routing with Human Preferencescited by 9
  9. 2026Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Taskscited by 8
  10. 2025IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentRouter: Heterogeneous Model Routing for Cost-Optimal Multi-Step Agentic Workflows
  2. 2025Towards Generalized Routing: Model and Agent Orchestration for Adaptive and Efficient Inference
  3. 2026Runtime Burden Allocation for Structured LLM Routing in Agentic Expert Systems: A Full-Factorial Cross-Backend Methodology
  4. 2024A Unified Approach to Routing and Cascading for LLMs
  5. 2026RSI-Router: Evolving Subtask-Level LLM Routing and Skills for Cost-Efficient Agents
  6. 2026AgentWeave: Routing Before Reasoning for Efficient Function Calling in Tool-Rich Language Models
  7. 2026Harnesses for Inference-Time Alignment over Execution Trajectories
  8. 2026Learning Query-Aware Budget-Tier Routing for Runtime Agent Memory