mlsanityData to 7 Oct 2026

Learn Like Humans: Use Meta-cognitive Reflection for Efficient Self-Improvement

arXiv 2601.11974 ↗First posted 17 Jan 2026cs.AIcited by 4

On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents

Abstract (arXiv)

While Large Language Models (LLMs) enable complex autonomous behavior, current agents remain constrained by static, human-designed prompts that limit adaptability. Existing self-improving frameworks attempt to bridge this gap but typically rely on inefficient, multi-turn recursive loops that incur high computational costs. To address this, we propose Metacognitive Agent Reflective Self-improvement (MARS), a framework that achieves efficient self-evolution within a single recurrence cycle. Inspired by educational psychology, MARS mimics human learning by integrating principle-based reflection (abstracting normative rules to avoid errors) and procedural reflection (deriving step-by-step strategies for success). By synthesizing these insights into optimized instructions, MARS allows agents to systematically refine their reasoning logic without continuous online feedback. Extensive experiments on six benchmarks demonstrate that MARS outperforms state-of-the-art self-evolving systems while significantly reducing computational overhead.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 13 of its 37 references that are in the map. First posted on arXiv 17 Jan 2026.

Builds on

13 of 37 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents29 May

Other references · 12

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  7. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  8. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
  9. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
  10. 2024Recursive Introspection: Teaching Language Model Agents How to Self-Improvecited by 162
  11. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
  12. 2024Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimizationcited by 93

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Truly Self-Improving Agents Require Intrinsic Metacognitive Learning
  2. 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
  3. 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness
  4. 2026Experiential Reflective Learning for Self-Improving LLM Agents
  5. 2026OPT-BENCH: Evaluating the Iterative Self-Optimization of LLM Agents in Large-Scale Search Spaces
  6. 2024Competence-Aware AI Agents with Metacognition for Unknown Situations and Environments (MUSE)
  7. 2025Reflecting with Two Voices: A Co-Adaptive Dual-Strategy Framework for LLM-Based Agent Decision Making
  8. 2024G"odel Agent: A Self-Referential Agent Framework for Recursive Self-Improvement