Learn Like Humans: Use Meta-cognitive Reflection for Efficient Self-Improvement
On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents
Abstract (arXiv)
While Large Language Models (LLMs) enable complex autonomous behavior, current agents remain constrained by static, human-designed prompts that limit adaptability. Existing self-improving frameworks attempt to bridge this gap but typically rely on inefficient, multi-turn recursive loops that incur high computational costs. To address this, we propose Metacognitive Agent Reflective Self-improvement (MARS), a framework that achieves efficient self-evolution within a single recurrence cycle. Inspired by educational psychology, MARS mimics human learning by integrating principle-based reflection (abstracting normative rules to avoid errors) and procedural reflection (deriving step-by-step strategies for success). By synthesizing these insights into optimized instructions, MARS allows agents to systematically refine their reasoning logic without continuous online feedback. Extensive experiments on six benchmarks demonstrate that MARS outperforms state-of-the-art self-evolving systems while significantly reducing computational overhead.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 13 of its 37 references that are in the map. First posted on arXiv 17 Jan 2026.
Builds on
13 of 37 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
- 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
- 2024Recursive Introspection: Teaching Language Model Agents How to Self-Improvecited by 162
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
- 2024Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimizationcited by 93
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunitiescited by 1
- 2026Toward Metacognitive One-Shot Indirect Prompt Injection: Strategy Abstraction Via Outcome-Conditioned Reflectioncited by 0
- 2026ForeDreamer: A Self-Evolving Dual-Agent Memory Architecture for Future Event Predictioncited by 0
- 2026Certified Long-Horizon Code Agent Evolution via Validation-Gated Skill Optimizationcited by 0
- 2026Certified Long-Horizon Code Agent Evolution via Validation-Gated Skill Optimization26 Sep 2026
- 2026ForeDreamer: A Self-Evolving Dual-Agent Memory Architecture for Future Event Prediction21 Aug 2026
- 2026Toward Metacognitive One-Shot Indirect Prompt Injection: Strategy Abstraction Via Outcome-Conditioned Reflection9 Aug 2026
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunities13 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025Truly Self-Improving Agents Require Intrinsic Metacognitive Learning
- 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness
- 2026Experiential Reflective Learning for Self-Improving LLM Agents
- 2026OPT-BENCH: Evaluating the Iterative Self-Optimization of LLM Agents in Large-Scale Search Spaces
- 2024Competence-Aware AI Agents with Metacognition for Unknown Situations and Environments (MUSE)
- 2025Reflecting with Two Voices: A Co-Adaptive Dual-Strategy Framework for LLM-Based Agent Decision Making
- 2024G"odel Agent: A Self-Referential Agent Framework for Recursive Self-Improvement