mlsanityData to 14 Oct 2026

MMLA-RSI: Recursive Self-Improvement through RTT and RTMA

arXiv 2610.20294 ↗First posted 14 Oct 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

An agent can improve its behavior within an unresolved problem by changing how it acts and which experience it retains. We propose MMLA-RSI, a recursive self-improvement scheme with two implementations in Memory-Mediated Learning Architecture: Reasoning-Time Training (RTT) changes the policy state Phi, while Reasoning-Time Memory Adaptation (RTMA) changes authoritative memory M. Each route also makes its adaptation method an object of improvement. A current numerical updater trains the policy proposing its successor; a current memory manager chooses the records available to the process proposing its successor. An independently admitted successor takes over the same role in the next generation. We give bounded executable rule languages, shared task/proposal interfaces, and one algorithm for either route or their composition. The RTT instance changes scalar schedules in a clipped-momentum update. The RTMA instance chooses NULL or a complete-row write with possible eviction. A fixed interpreter, trusted committer, and independent evaluator bound what can change. State versions, read closures, and conditional properties describe causal execution, accepted transitions, and finite work. Existing numerical-component studies motivate the construction. In four-candidate program selection, retaining LARC feedback updates reduces expected error by 24.65 and 36.65 percentage points for two trained initializations. In chronological continuous-integration replay, feedback binding is positive while retention increases loss. Completed SQL studies improve substantially over an unadapted substrate but do not establish the required additional online benefit. These results characterize their declared components. The two recursive routes and their joint realization are specified here; their beneficial recursive chains and discovery efficiency remain to be evaluated.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 32 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

25 of 32 references.

References · 25

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  5. 2018On First-Order Meta-Learning Algorithmscited by 1,018
  6. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
  7. 2016Learning to learn by gradient descent by gradient descentcited by 620
  8. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  9. 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 455
  10. 2015Policy Distillationcited by 440
  11. 2023Symbolic Discovery of Optimization Algorithmscited by 434
  12. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
13 more
  1. 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 355
  2. 2019CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databasescited by 185
  3. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 148
  4. 2019SParC: Cross-Domain Semantic Parsing in Contextcited by 144
  5. 2026Learning to Discover at Test Timecited by 115
  6. 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 95
  7. 2022Eliminating Meta Optimization Through Self-Referential Meta Learningcited by 14
  8. 2026RRSI: Regularized Recursive Self-Improvement of Agent Harnessescited by 13
  9. 2026No Time Like the Present: Agentic Test-Time Training for LLM Agentscited by 4
  10. 2026Recursive Self-Improvement via On-Policy Distillation for Reasoningcited by 3
  11. 2026MMLA: Memory-Mediated Learning Architecture for Predictive Dual-State Adaptationcited by 2
  12. 2026LARC: Low-Rank Adaptive Residual Connections for Learning in Frozen Modelscited by 1
  13. 2026Agentic-TTT: Training test-time policy for test-time trainingcited by 1

Built on by

Not cited yet.