CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Coding agents increasingly operate in executable environments where a failed attempt produces actionable feedback rather than merely an incorrect answer. Existing cost-aware systems typically treat such failures as cascade decisions: try a cheap model first, then escalate hard cases to a stronger and more expensive model. In coding, however, execution feedback can also make further cheap-model recovery worthwhile, raising a budgeted deployment question: when should an agent spend more cheap compute, and when should it escalate? We formulate this post-failure decision as recovery routing over heterogeneous actions and train a supervised router from execution rollouts. To make the same router usable under changing budgets, we add a Conformal Risk Control (CRC) layer that selects a deployment-time cost penalty without retraining and provides marginal expected-cost control under exchangeability. Across held-out failures from five coding benchmarks, cheap recovery and escalation exhibit complementary success patterns. The calibrated frontier improves over fixed actions, prompt-only routers, and a binary cascade baseline; in the main GPT-5.4-nano/GPT-5.4 setting, one CRC-calibrated frontier point exceeds always-escalate solve rate while using 35% of its mean recovery cost. Code is available at https://github.com/Qijia-He/agent-budget-control.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 33 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
25 of 33 references.
Closest ancestors · 3
Same direction, newest first
- 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
Other references · 22
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
- 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 354
10 more
- 2022Conformal Risk Controlcited by 290
- 2023TACO: Topics in Algorithmic COde generation datasetcited by 150
- 2024Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step-by-stepcited by 123
- 2023AutoMix: Automatically Mixing Language Modelscited by 116
- 2024Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreementcited by 99
- 2024A Unified Approach to Routing and Cascading for LLMscited by 71
- 2025C3PO: Optimized Large Language Model Cascades with Probabilistic Cost Constraints for Reasoningcited by 8
- 2025Rethinking Human Preference Evaluation of LLM Rationalescited by 3
- 2026Reasoning Is Not Free: Robust Adaptive Cost-Efficient Routing for LLM-as-a-Judgecited by 2
- 2026A Few Teacher Steps Go a Long Way: Cost-Efficient On-Policy Data Augmentation for Agent Post-Trainingcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Agent-as-a-Router: Agentic Model Routing for Coding Tasks
- 2026Diagnosis Before Recovery: Turning Agent Failures into Selective Self-Correction
- 2026RippleCP: Measuring Counterfactual Checkpoint Advantage in Coding Agents
- 2026When Harnesses Lose the Signal: Causal Evaluation of Recovery in LLM Agents
- 2026Before They Can Solve: Predicting Post-Training Coding-Agent Performance from Base Models
- 2026Analyzing and Mitigating Cost-Inefficient Behaviors in Coding Agents
- 2026Learning When and How to Intervene: A Hindsight-Distilled Sentinel for Coding Agents
- 2026EvoCode-Bench: Evaluating Coding Agents in Multi-Turn Iterative Interactions