Triage: Routing Software Engineering Tasks to Cost-Effective LLM Tiers via Code Quality Signals
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Context: AI coding agents route every task to a single frontier large language model (LLM), paying premium inference cost even when many tasks are routine. Objectives: We propose Triage, a framework that uses code health metrics -- indicators of software maintainability -- as a routing signal to assign each task to the cheapest model tier whose output passes the same verification gate as the expensive model. Methods: Triage defines three capability tiers (light, standard, heavy -- mirroring, e.g., Haiku, Sonnet, Opus) and routes tasks based on pre-computed code health sub-factors and task metadata. We design an evaluation comparing three routing policies on SWE-bench Lite (300 tasks across three model tiers): heuristic thresholds, a trained ML classifier, and a perfect-hindsight oracle. Results: We analytically derived two falsifiable conditions under which the tier-dependent asymmetry (medium LLMs benefit from clean code while frontier models do not) yields cost-effective routing: the light-tier pass rate on healthy code must exceed the inter-tier cost ratio, and code health must discriminate the required model tier with at least a small effect size (hatp ≥ 0.56). Conclusion: Triage transforms a diagnostic code quality metric into an actionable model-selection signal. We present a rigorous evaluation protocol to test the cost--quality trade-off and identify which code health sub-factors drive routing decisions.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 7 of its 9 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
7 of 9 references.
Closest ancestors · 1
Same direction, newest first
Other references · 6
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2025A Survey on Collaborative Mechanisms Between Large and Small Language Modelscited by 14
- 2026Token-Level LLM Collaboration via FusionRoutecited by 9
- 2022Code Red: The Business Impact of Code Quality -- A Quantitative Study of 39 Proprietary Production Codebasescited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026TwinRouterBench: Fast Static and Live Dynamic Evaluation for Realistic Agentic LLM Routingcited by 6
- 2026HyDRA: Hybrid Dynamic Routing Architecture for Heterogeneous LLM Poolscited by 1
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agentscited by 0
- 2026What Can Component-Replacement Evidence Establish? A Critical Scoping Review of Local Decisions in LLM Agents30 Sep 2026
- 2026HyDRA: Hybrid Dynamic Routing Architecture for Heterogeneous LLM Pools16 May 2026
- 2026TwinRouterBench: Fast Static and Live Dynamic Evaluation for Realistic Agentic LLM Routing14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Code Health in LLM-Based Test Generation: Effectiveness and Token Efficiency
- 2026Taming Scylla: Understanding the multi-headed agentic daemon of the coding seas
- 2026SWE-Router: Routing in Multi-turn Agentic Software Engineering Tasks
- 2025TREAT: A Code LLMs Trustworthiness / Reliability Evaluation and Testing Framework
- 2025Breakpoint: Scalable evaluation of system-level reasoning in LLM code agents
- 2026Beyond Isolated Tasks: A Framework for Evaluating Coding Agents on Sequential Software Evolution
- 2026E2E-SWE: Benchmarking LLMs on Building Working Codebases from Scratch
- 2026SWE Atlas: Benchmarking Coding Agents Beyond Issue Resolution