Scrouting: Cost-Aware Routing of Coding Agents by Scouting the Repository First
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Frontier language models can resolve repository-level software issues, but each attempt is expensive, and existing routers select a model from the issue text alone. We present SuperScout, which routes after scouting the repository: a 7B searcher, SuperScout-7B, first explores the repository and produces a structured handoff whose reproduction claims are sandbox-verified, with false claims stripped before delivery. The searcher's hidden states, together with the task text, then feed a resume-based router that dispatches the task to one of four frontier fixers. Adding a new fixer requires no retraining. On the full Python slice of SWE-bench Pro (266 tasks) under the benchmark's official capped budget tier, SuperScout matches the best single model's solve rate (159 of 266 for SuperScout, 158 for the best model) at about a fifth of the total cost per solve, and the reported configuration sits above the random traffic-splitting baseline. A no-router ablation, always the cheapest fixer with the handoff, ties the routed system on this benchmark, so the handoff rather than the routing decision carries the result. A paired calibration study points to the mechanism: the handoff appears to redistribute rather than add solving ability, lifting the three cheaper fixers while slightly hurting the strongest, though at N=99 the per-fixer effects are directional only; the searcher's hidden states improve cost routing on the calibration labels while the handoff's own text does not. The searcher's compute adds less than half a cent of GPU time per task.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 37 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
29 of 37 references.
Closest ancestors · 13
Same direction, newest first
- 2026CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents21 Jul
- 2026SWE-Router: Routing in Multi-turn Agentic Software Engineering Tasks30 Jun
- 2026Open-SWE-Traces: Advancing Dual-Mode Multilingual Distillation for Software Engineering Agents14 Jun
- 2026From SWE-ZERO to SWE-HERO: Execution-free to Execution-based Fine-tuning for Software Engineering Agents2 Apr
- 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RL21 Dec
- 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents26 May
- 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
- 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents9 Apr
- 2025LocAgent: Graph-Guided LLM Agents for Code Localization12 Mar
- 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul
Other references · 16
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 354
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
- 2023Large Language Model Routing with Benchmark Datasetscited by 166
4 more
- 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 87
- 2024EmbedLLM: Learning Compact Representations of Large Language Modelscited by 46
- 2025SweRank: Software Issue Localization with Code Rankingcited by 20
- 2026TRACE-ROUTER: Task-Consistent and Adaptive Online Routing for Agentic AIcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Agent-as-a-Router: Agentic Model Routing for Coding Tasks
- 2026Agentic Routing: The Harness-Native Data Flywheel
- 2026TwinRouterBench: Fast Static and Live Dynamic Evaluation for Realistic Agentic LLM Routing
- 2026AgentRouter: Heterogeneous Model Routing for Cost-Optimal Multi-Step Agentic Workflows
- 2025NL2Repo-Bench: Towards Long-Horizon Repository Generation Evaluation of Coding Agents
- 2026Cost-Effective Repository Exploration for Agentic Issue Localization
- 2026SWE-Explore: Benchmarking How Coding Agents Explore Repositories
- 2025GitTaskBench: A Benchmark for Code Agents Solving Real-World Tasks Through Code Repository Leveraging