mlsanityData to 7 Oct 2026

MetaRSI / RSI2: A Meta-Recursive Self-Improving System for Recursive Self-Improving Systems Themselves

arXiv 2609.06396 ↗First posted 6 Sep 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Recursive self-improvement (RSI) lets a system improve the model-building machinery from its own failures, so every later model inherits the gain. Yet RSI has been validated almost exclusively on coding and formal benchmarks such as science QA and mathematics. This format bound limits RSI to improvement within a machine-checkable slice, not general capability where questions are open and correctness is settled by argument, replication, or measurement. We argue RSI must next operate across real, diverse scientific, engineering, and meta-scientific domains, not where formal evaluation is merely tractable. To that end we present MetaRSI-v1, where improvement is the scheduled composition of three typed operators over one unified paradigm. Data-RSI amplifies existing competence and marks its boundary; Harness-RSI edits a five-slot scaffold without touching weights; Model-RSI internalizes capability into parameters through bounded training. Sharing one loop kernel and artifact vocabulary, they make data, scaffold, and model changes composable rather than exclusive. A two-axis optimizer jointly decides operator order and each operator's proposal policy, while a meta-level policy revises the schedule across terms. We validate MetaRSI-v1 under the field's standard evaluations, on code and closed-form science, with no external teacher: the target model plays every role in its own loop. MetaRSI-v1 reframes self-improvement from a single-surface edit to a composition across the full model-production pipeline, opening two paths: a model route internalizing capability through training, and a harness route leaving weights untouched and thus extending self-improvement to any model reachable through an interface, with Data-RSI redefined as the shared substrate feeding both. The framework further yields refutable laws on where loops exist, how operators compose, and what supervision buys.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 79 of its 90 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

79 of 90 references.

References · 79

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  7. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  8. 2025Qwen3 Technical Reportcited by 8,195
  9. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  10. 2020Scaling Laws for Neural Language Modelscited by 6,411
  11. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  12. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
38 more
  1. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  4. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  5. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  7. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  8. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  9. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  10. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  11. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  12. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  13. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  14. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
  15. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  16. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  17. 2024Self-Rewarding Language Modelscited by 654
  18. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  19. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  20. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
  21. 2024AFlow: Automating Agentic Workflow Generationcited by 395
  22. 2024Automated Design of Agentic Systemscited by 360
  23. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
  24. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
  25. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
  26. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  27. 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIcited by 227
  28. 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 172
  29. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
  30. 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human expertscited by 153
  31. 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Researchcited by 138
  32. 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecyclecited by 129
  33. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
  34. 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 119
  35. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 119
  36. 2026Self-Harness: Harnesses That Improve Themselvescited by 79
  37. 2025AgentEvolver: Towards Efficient Self-Evolving Agent Systemcited by 77
  38. 2025Self-Adapting Language Modelscited by 71

50 most cited of 79 All 79 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.