PYTHALAB-MERA: Validation-Grounded Memory, Retrieval, and Acceptance Control for Frozen-LLM Coding Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Local LLM-based coding agents increasingly work in settings where correctness is earned through execution feedback, persistent state, and bounded repair, not through a single fluent answer. Static retrieval, long-context prompting, self-refinement, execution-feedback repair, and reinforcement learning over model weights each address part of this setting, but they do not jointly provide validation-grounded episodic memory, adaptive retrieval-action selection, delayed credit assignment, and structural skill reuse around a frozen local model. We introduce PYTHALAB-MERA, a lightweight external controller for local validation-conditioned code generation. The frozen language model proposes complete source files; the controller decides which memory records and AST-derived skills should enter the next prompt, validates each candidate through a fail-fast pipeline, converts validation outcomes into bounded shaped rewards, and propagates delayed credit through TD(lambda)-style eligibility traces. We evaluate the implementation as a local CLI artifact on reinforcement-learning coding tasks with strict validation gates. In the measured hard RL setting with three tasks, three repetitions, and a three-attempt budget, PYTHALAB-MERA passed 8/9 strict validations; the self-refinement baseline and the investigated GRACE extension each passed 0/9. These results support a deliberately bounded claim: in this recorded setting, the external memory-and-retrieval controller improved validation success. They do not establish general-purpose code synthesis, state-of-the-art performance, formal program correctness, or formal safety.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 51 of its 67 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
51 of 67 references.
Closest ancestors · 9
Same direction, newest first
- 2026RAG-Reflect: Agentic Retrieval-Augmented Generation with Reflections for Comment-Driven Code Maintenance on Stack Overflow24 Apr
- 2026REAgent: Requirement-Driven LLM Agents for Software Issue Resolution8 Apr
- 2026Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architectures3 Apr
- 2026Building Effective AI Coding Agents for the Terminal: Scaffolding, Harness, Context Engineering, and Lessons Learned5 Mar
- 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectories2 Feb
- 2025Smarter Together: Creating Agentic Communities of Practice through Shared Experiential Learning11 Nov
- 2025Vibe Coding vs. Agentic Coding: Fundamentals and Practical Implications of Agentic AI26 May
- 2025Beyond Final Code: A Process-Oriented Error Analysis of Software Development Agents in Real-World GitHub Scenarios16 Mar
- 2024Defining and Detecting the Defects of the Large Language Model-based Autonomous Agents24 Dec
Other references · 42
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 358
- 2024RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learningcited by 151
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 142
- 2022Practical Program Repair in the Era of Large Pre-trained Language Modelscited by 133
- 2025Establishing Best Practices for Building Rigorous Agentic Benchmarkscited by 102
- 2025MemoryGraft: Persistent Compromise of LLM Agents via Poisoned Experience Retrievalcited by 72
- 2022Automated Repair of Programs from Large Language Modelscited by 71
- 2024Calibration and Correctness of Language Models for Codecited by 49
- 2023RAP-Gen: Retrieval-Augmented Patch Generation with CodeT5 for Automatic Program Repaircited by 44
- 2026Memory Poisoning Attack and Defense on Memory Based LLM-Agentscited by 44
- 2023Large Language Models Are Semi-Parametric Reinforcement Learning Agentscited by 42
30 more
- 2024ReGAL: Refactoring Programs to Discover Generalizable Abstractionscited by 36
- 2025CodeJudgeBench: Benchmarking LLM-as-a-Judge for Coding Taskscited by 33
- 2023Privacy Implications of Retrieval-Based Language Modelscited by 32
- 2025Securing Agentic AI: A Comprehensive Threat Model and Mitigation Framework for Generative AI Agentscited by 32
- 2024CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding?cited by 30
- 2025RefactorBench: Evaluating Stateful Reasoning in Language Agents Through Codecited by 30
- 2026SkillCraft: Can LLM Agents Learn to Use Tools Skillfully?cited by 30
- 2024Toward Secure Code Generation: Bridging Correctness and Security via Task-Adaptive Vulnerability Modeling and Execution-Based Benchmarkingcited by 27
- 2021Off-Policy Reinforcement Learning with Delayed Rewardscited by 25
- 2024Reasoning Through Execution: Unifying Process and Outcome Rewards for Code Generationcited by 21
- 2025Online Multi-LLM Selection via Contextual Bandits under Unstructured Context Evolutioncited by 19
- 2021Fault Localization with Code Coverage Representation Learningcited by 16
- 2025Beyond Consensus: Mitigating the Agreeableness Bias in LLM Judge Evaluationscited by 16
- 2025Do Repetitions Matter? Strengthening Reliability in LLM Evaluationscited by 14
- 2024IRCoCo: Immediate Rewards-Guided Deep Reinforcement Learning for Code Completioncited by 13
- 2025SandboxEval: Towards Securing Test Environment for Untrusted Codecited by 10
- 2025FeedbackEval: A Benchmark for Evaluating Large Language Models in Feedback-Driven Code Repair Taskscited by 10
- 2026MASPOB: Bandit-Based Prompt Optimization for Multi-Agent Systems with Graph Neural Networkscited by 9
- 2026SoK: Agentic Retrieval-Augmented Generation (RAG): Taxonomy, Architectures, Evaluation, and Research Directionscited by 8
- 2026ReflexiCoder: Teaching Large Language Models to Self-Reflect on Generated Code and Self-Correct It via Reinforcement Learningcited by 7
- 2026How Many Tries Does It Take? Iterative Self-Repair in LLM Code Generation Across Model Scales and Benchmarkscited by 5
- 2025FLAIR: Feedback Learning for Adaptive Information Retrievalcited by 4
- 2026Bridging Online and Offline RL: Contextual Bandit Learning for Multi-Turn Code Generationcited by 4
- 2025Skill Discovery for Software Scripting Automation via Offline Simulations with LLMscited by 3
- 2025Bridging Symbolic Control and Neural Reasoning in LLM Agents -- The Structured Cognitive Loopcited by 3
- 2026DebugRepair: Enhancing LLM-Based Automated Program Repair via Self-Directed Debuggingcited by 3
- 2016Dynamic Information Retrieval: Theoretical Framework and Applicationcited by 2
- 2025Prompt Tuning Decision Transformers with Structured and Scalable Banditscited by 2
- 2025Automated Repair of C Programs Using Large Language Modelscited by 2
- 2025Agentic Episodic Controlcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning to Control LLM Agent Harnesses with Offline Reinforcement Learning
- 2026Feedback-Normalized Developer Memory for Reinforcement-Learning Coding Agents: A Safety-Gated MCP Architecture
- 2026A Control System, a Dataset, and a Recipe for Making Frozen LLM Agents Learn a Domain
- 2026CodeScaler: Scaling Code LLM Training and Test-Time Inference via Reward Models
- 2025A Self-Improving Coding Agent
- 2026Opera: A Verbal Critic Framework for Long-horizon Coding Agents
- 2026SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectories
- 2025Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement