mlsanityData to 7 Oct 2026

Self-Improving AI Coding Agents Through Accumulated Behavioral Rules: A Closed-Loop Framework

arXiv 2607.13091 ↗First posted 13 Jul 2026cs.SE cs.AIcited by 1

On the map: LLM agents and tool use → Software engineering coding agents

also in 1 more
Abstract (arXiv)

LLM-based coding agents repeat the same classes of mistakes across sessions because they lack a mechanism to retain corrections from human review feedback. We present a closed-loop framework in which every accepted review comment is codified as a persistent behavioral rule, progressively expanding the set of error classes the agent can self-detect. The framework combines an accumulating rule set in a version-controlled instruction file, a self-review checklist executed before code submission, and automated validation that ensures rule set integrity as it grows. In deployment across a 35+ service microservices platform, the rule set grew from 5 to 18 behavioral rules, 15+ language-specific standards, and a 15-item self-review checklist, all derived from real review feedback. We present empirical results from 11 recorded working sessions spanning code generation, PR review, incident investigation, and cross service refactoring. We observe that accumulated rules shift review effort from low-level correctness toward design-level validation, achieve a measured 0% recurrence rate for ruled-against error classes, and transfer across heterogeneous agent interfaces. We compare our approach against related work in experiential LLM learning (Reflexion, ExpeL, Voyager) and automated code review (CodeReviewer, SWE-bench agents), showing that our framework achieves persistent cross-session learning without weight updates, operates on production codebases rather than synthetic benchmarks, and addresses an orthogonal dimension (behavioral consistency over time) that existing benchmarks do not measure. The result is a coding agent that improves with every review cycle, accumulating the engineering wisdom of its human collaborators without changing a single model weight.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 35 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

18 of 35 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul
  2. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May

Other references · 16

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  7. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  8. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  9. 2023Teaching Large Language Models to Self-Debugcited by 963
  10. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  11. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
  12. 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
4 more
  1. 2024AutoCodeRover: Autonomous Program Improvementcited by 272
  2. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
  3. 2022Automating Code Review Activities by Large-Scale Pre-trainingcited by 98
  4. 2022Using Pre-Trained Models to Boost Code Review Automationcited by 63

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Self-Evolving Coding Rules for AI Coding Agents
  2. 2026Opera: A Verbal Critic Framework for Long-horizon Coding Agents
  3. 2026CR-Bench: Evaluating the Real-World Utility of AI Code Review Agents
  4. 2026Adversarial Review: Structured Disagreement for Grounded Agentic Code Review
  5. 2025A Self-Improving Coding Agent
  6. 2026Wink: Recovering from Misbehaviors in Coding Agents
  7. 2026A Phased Workflow for Operating LLM-Based Coding Agents
  8. 2026Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents