mlsanityData to 7 Oct 2026

Terminus-4B: Can a Smaller Model Replace Frontier LLMs at Agentic Execution Tasks?

arXiv 2605.03195 ↗First posted 4 May 2026cs.AI cs.SEcited by 1

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Modern coding agents increasingly delegate specialized subtasks to subagents, which are smaller, focused agentic loops that handle narrow responsibilities like search, debugging or terminal execution. This architectural pattern keeps the main agent's context window clean by isolating verbose outputs (e.g. build logs, test results, etc.) within the subagent context. Typically when agents employ subagents for such tasks, they use frontier models as these subagents. In this paper, we investigate whether a finetuned small language model (SLM) can achieve comparable performance to frontier models in the task of agentic terminal execution. We present Terminus-4B, which is a post-trained Qwen3-4B model via Supervised Finetuning (SFT) and Reinforcement Learning (RL) using rubric-based LLM-as-judge reward, specifically for this task. In our extensive evaluation spanning various frontier models, training ablations and main agent configurations, we find that Terminus-4B is able to reduce the token usage of the main agent by up to ~30% compared to the No Subagent baseline with no impact to agent performance on benchmarks like SWE-Bench Pro and our internal SWE-Bench C# benchmark, which tends to be heavy in verbose execution tasks. Furthermore, Terminus-4B improves key metrics showing the main agent relying on the outputs of the subagent and doing fewer terminal execution tasks by itself. We see that our model not only closes the gap between the Vanilla Qwen model and frontier models like Claude Sonnet / Opus / GPT-5.3-Codex, but often even exceeds their performance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 29 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

22 of 29 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026Qwen3-Coder-Next Technical Report28 Feb
  2. 2026Debug2Fix: Can Interactive Debugging Help Coding Agents Fix More Bugs?20 Feb
  3. 2026SWE Context Bench: A Benchmark for Context Learning in Coding9 Feb
  4. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
  5. 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Ahead7 Apr
  6. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
  7. 2023ChatDev: Communicative Agents for Software Development16 Jul

Other references · 15

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  7. 2025Small Language Models are the Future of Agentic AIcited by 254
  8. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
  9. 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
  10. 2024LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Textscited by 81
  11. 2025Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn'tcited by 72
  12. 2025SkyRL-Agent: Efficient RL Training for Multi-turn LLM Agentcited by 44
3 more
  1. 2026Endless Terminals: Scaling RL Environments for Terminal Agentscited by 43
  2. 2026Active Context Compression: Autonomous Memory Management in LLM Agentscited by 15
  3. 2026Memex(RL): Scaling Long-Horizon LLM Agents via Indexed Experience Memorycited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Scaling Agentic Capabilities, Not Context: Efficient Reinforcement Finetuning for Large Toolspaces
  2. 2025TinyLLM: Evaluation and Optimization of Small Language Models for Agentic Tasks on Edge Devices
  3. 2026Cross-Benchmark Transfer from RL on Agentic Coding Tasks
  4. 2025Generalizable End-to-End Tool-Use RL with Synthetic CodeGym
  5. 2026Reward Hacking Benchmark: Measuring Exploits in LLM Agents with Tool Use
  6. 2026Tmax: A simple recipe for terminal agents
  7. 2026AgentAbstain: Do LLM Agents Know When Not to Act?
  8. 2026Beyond Token Savings: A Systematic Study of Context Compression in LLM Agents