Self-Improving AI Coding Agents Through Accumulated Behavioral Rules: A Closed-Loop Framework
On the map: LLM agents and tool use → Software engineering coding agents
also in 1 more
Abstract (arXiv)
LLM-based coding agents repeat the same classes of mistakes across sessions because they lack a mechanism to retain corrections from human review feedback. We present a closed-loop framework in which every accepted review comment is codified as a persistent behavioral rule, progressively expanding the set of error classes the agent can self-detect. The framework combines an accumulating rule set in a version-controlled instruction file, a self-review checklist executed before code submission, and automated validation that ensures rule set integrity as it grows. In deployment across a 35+ service microservices platform, the rule set grew from 5 to 18 behavioral rules, 15+ language-specific standards, and a 15-item self-review checklist, all derived from real review feedback. We present empirical results from 11 recorded working sessions spanning code generation, PR review, incident investigation, and cross service refactoring. We observe that accumulated rules shift review effort from low-level correctness toward design-level validation, achieve a measured 0% recurrence rate for ruled-against error classes, and transfer across heterogeneous agent interfaces. We compare our approach against related work in experiential LLM learning (Reflexion, ExpeL, Voyager) and automated code review (CodeReviewer, SWE-bench agents), showing that our framework achieves persistent cross-session learning without weight updates, operates on production codebases rather than synthetic benchmarks, and addresses an orthogonal dimension (behavioral consistency over time) that existing benchmarks do not measure. The result is a coding agent that improves with every review cycle, accumulating the engineering wisdom of its human collaborators without changing a single model weight.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 35 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
18 of 35 references.
Closest ancestors · 2
Same direction, newest first
- 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
Other references · 16
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
4 more
- 2024AutoCodeRover: Autonomous Program Improvementcited by 272
- 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
- 2022Automating Code Review Activities by Large-Scale Pre-trainingcited by 98
- 2022Using Pre-Trained Models to Boost Code Review Automationcited by 63
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Self-Evolving Coding Agentscited by 2
- 2026Self-Evolving Coding Agents4 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Self-Evolving Coding Rules for AI Coding Agents
- 2026Opera: A Verbal Critic Framework for Long-horizon Coding Agents
- 2026CR-Bench: Evaluating the Real-World Utility of AI Code Review Agents
- 2026Adversarial Review: Structured Disagreement for Grounded Agentic Code Review
- 2025A Self-Improving Coding Agent
- 2026Wink: Recovering from Misbehaviors in Coding Agents
- 2026A Phased Workflow for Operating LLM-Based Coding Agents
- 2026Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents