mlsanityData to 7 Oct 2026

Prompt-Induced Waste in Coding Agents: Reasoning, Effort, Harness Design, and End-to-End Cost

arXiv 2608.01347 ↗First posted 2 Aug 2026cs.CLcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Coding-agent efficiency cannot be characterized by token count or model price alone. End-to-end cost and task success depend jointly on prompt semantics, inference effort, harness policy, model, task difficulty, tool use, context management, and provider accounting. Controlled experiments show that prompt wording can change reasoning and verification behavior without changing the task, that additional inference effort can help on difficult tasks but can also add cost without benefit, and that the value of an efficiency intervention can change when the harness changes. These results show that prompt, effort, and harness are interacting experimental factors rather than independent controls. We model efficiency as cost per successful task induced by the agent trajectory. Token and cache counts are measurements of that trajectory, not sufficient optimization targets. Agent evaluations should therefore measure success and end-to-end cost while controlling the system variables that determine how the trajectory is produced.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 6 of its 13 references that are in the map. First posted on arXiv 2 Aug 2026.

Builds on

6 of 13 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026CORVUS: Context Optimization and Reduction Via Underlying Synchronization for LLM Coding Agents20 Jul

Other references · 5

  1. 2025CostBench: Evaluating Multi-Turn Cost-Optimal Planning and Adaptation in Dynamic Environments for LLM Tool-Use Agentscited by 32
  2. 2026LLM Agents Already Know When to Call Tools -- Even Without Reasoningcited by 17
  3. 2024CATP-LLM: Empowering Large Language Models for Cost-Aware Tool Planningcited by 14
  4. 2026Toward Efficient Agents: Memory, Tool learning, and Planningcited by 11
  5. 2026Not All LLM Reasoning is Visible in the Chain-of-Thoughtcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Analyzing and Mitigating Cost-Inefficient Behaviors in Coding Agents
  2. 2026Can your AI agent be cheaper? Investigating the effects of task specifications on token spend in agentic coding tasks
  3. 2026Coding Agents are Strong Prompt Optimizers
  4. 2026The Scaffold Effect in Coding Agents: Harness Choice as a Hidden Variable in Coding-Agent Evaluation
  5. 2026Beyond Resolution Rates: Behavioral Drivers of Coding Agent Success and Failure
  6. 2026An Empirical Study of Harness Design for Coding Agents
  7. 2026Beyond Token Savings: A Systematic Study of Context Compression in LLM Agents
  8. 2026What Makes a Good Terminal-Agent Benchmark Task: A Guideline for Adversarial, Difficult, and Legible Evaluation Design