mlsanityData to 7 Oct 2026

Coding Agents Don't Know When to Act

arXiv 2605.07769 ↗First posted 8 May 2026cs.SEcited by 4

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Coding agents are increasingly deployed to autonomously maintain software, including to resolve user-reported issues: a bug report comes in and the agent creates a patch to address it. However, in any real-world deployment, they will encounter stale bug reports about issues that have already been resolved. Agents should recognize this and abstain from modifying the code to avoid accumulating technical debt. To systematically evaluate whether current agents do so, we introduce FixedBench, a code benchmark with 200 human-verified coding tasks in which no code changes are required, testing five recent models across four agent harnesses. We find that even state-of-the-art models fail, proposing undesirable changes (excluding tests and documentation) in 35 to 65% of cases. Explicit instructions to reproduce the issue before patching partially address this issue but introduce a new failure mode: when an issue is partially fixed, they abstain even though a patch would still be needed. More broadly, our results indicate that LLMs fall prey to an action bias: they choose to act even if inaction would be appropriate. To break this pattern, inaction needs to be explicitly framed as a path to success, which highlights an overreliance on human guidance implicit in current training objectives.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 16 of its 27 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

16 of 27 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Abstain and Validate: A Dual-LLM Policy for Reducing Noise in Agentic Program Repair3 Oct
  2. 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents26 May
  3. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
  4. 2024SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents18 Jun

Other references · 12

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2021Program Synthesis with Large Language Modelscited by 3,509
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  4. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  5. 2024A Survey on Large Language Models for Code Generationcited by 646
  6. 2024Don't Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM Collaborationcited by 176
  7. 2025AbstentionBench: Reasoning LLMs Fail on Unanswerable Questionscited by 129
  8. 2024SWE-Bench+: Enhanced Coding Benchmark for LLMscited by 95
  9. 2024Quantifying Contamination in Evaluating Code Generation Capabilities of Language Modelscited by 62
  10. 2023A Survey of Learning-based Automated Program Repaircited by 55
  11. 2025Automated Benchmark Generation for Repository-Level Coding Taskscited by 27
  12. 2025Honesty over Accuracy: Trustworthy Language Models through Reinforced Hesitationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Teaching Agents to Code Reliably
  2. 2026How Coding Agents Fail Their Users: A Large-Scale Analysis of Developer-Agent Misalignment in 20,574 Real-World Sessions
  3. 2026Beyond Resolution Rates: Behavioral Drivers of Coding Agent Success and Failure
  4. 2026Beyond Bug Fixes: An Empirical Investigation of Post-Merge Code Quality Issues in Agent-Generated Pull Requests
  5. 2026Is Agent Code Less Maintainable Than Human Code?
  6. 2026"Refactoring Runaway": Understanding and Mitigating Tangled Refactorings in Coding Agents for Issue Resolution
  7. 2026Why Agentic-PRs Get Rejected: A Comparative Study of Coding Agents
  8. 2026Agentic Coding Needs Proactivity, Not Just Autonomy