mlsanityData to 7 Oct 2026

Teaching Agents to Code Reliably

arXiv 2610.03984 ↗First posted 2 Oct 2026cs.AI cs.LGcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Autonomous coding agents solve repository issues by reading code, running commands, editing files, and submitting patches. Extra inference-time compute yields gains only when it produces a useful repair and supplies reliable evidence for choosing one. Three behaviors decide both, and we argue they are teachable rather than byproducts of scale, so a policy can carry them instead of a scaffold. Location diversity remains narrow, since attempts return to the same site and extra samples add no coverage. Edit diversity is left unexploited, since methodologies that differ resolve complementary issues no single run reaches. Verification misleads, since a test the agent writes for its own patch accepts many incorrect ones. Directing search by execution feedback and scoring each patch against its own reverted tree resolves 52.8% of SWE-bench Verified using 48.1% of the agent-steps an eight-sample baseline spends. Training moves these behaviors into the policy. On the 270 issues held out from SFT and RL training, weighted supervised fine-tuning raises pass@1 from 31.9% to 35.2% and pass@8 from 46.7% to 51.1%. A reinforcement objective then trains the verifier against gold-labeled repairs and incorrect variants, crediting the assertions that detect them. It raises pass@1 to 43.0% and pass@8 to 60.7%, lifts verifier precision from 26.8% to 41.7%, and more than halves false acceptance. Resolution improves on two of three out-of-distribution suites and verifier precision on all three, and the gains hold at 7B, 14B, and 30B against published coder baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. First posted on arXiv 2 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ExecCritic: Learn to Test, Test to Improve for Coding Agents
  2. 2026AutoCompact: Learning When to Compact Context in Long-Horizon Coding Agents
  3. 2026Independent Patch Verification for Coding Agents with a Bidirectional Reconstruct-and-Verify Framework
  4. 2026CodeMidas: Scaling Agentic Coding RL Environments from Code Itself
  5. 2026Coding Agents Don't Know When to Act
  6. 2026Cross-Benchmark Transfer from RL on Agentic Coding Tasks
  7. 2026CodeScout: An Effective Recipe for Reinforcement Learning of Code Search Agents
  8. 2026Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills