mlsanityData to 7 Oct 2026

Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning

arXiv 2604.17399 ↗First posted 19 Apr 2026cs.AIcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

Large language models (LLMs) have demonstrated strong reasoning capabilities, and as existing approaches for enhancing LLM reasoning continue to mature, increasing attention has shifted toward meta-reasoning as a promising direction for further improvement. However, most existing meta-reasoning methods remain episodic: they focus on executing complex meta-reasoning routines within individual instances, but ignore the accumulation of reusable meta-reasoning skills across instances, leading to recurring failure modes and repeatedly high metacognitive effort. In this paper, we introduce Metacognitive Consolidation, a novel framework in which a model consolidates metacognitive experience from past reasoning episodes into reusable knowledge that improves future meta-reasoning. We instantiate this framework by structuring instance-level problem solving into distinct roles for reasoning, monitoring, and control to generate rich, attributable meta-level traces. These traces are then consolidated through a hierarchical, multi-timescale update mechanism that gradually forms evolving meta-knowledge. Experimental results demonstrate consistent performance gains across benchmarks and backbone models, and show that performance improves as metacognitive experience accumulates over time.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 11 of its 31 references that are in the map. First posted on arXiv 19 Apr 2026.

Builds on

11 of 31 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Test-time Prompt Intervention4 Aug
  2. 2025MetaScale: Test-Time Scaling with Evolving Meta-Thoughts17 Mar
  3. 2025Meta-Reasoner: Dynamic Guidance for Optimized Inference-time Reasoning in Large Language Models27 Feb
  4. 2024Meta Reasoning for Large Language Models17 Jun

Other references · 7

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2024OpenAI o1 System Cardcited by 1,220
  4. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
  5. 2024Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffoldingcited by 115
  6. 2025RLVMR: Reinforcement Learning with Verifiable Meta-Reasoning Rewards for Robust Long-Horizon Agentscited by 56
  7. 2025Thinker: Training LLMs in Hierarchical Thinking for Deep Search via Multi-Turn Interactioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors
  2. 2026Think2: Grounded Metacognitive Reasoning in Large Language Models
  3. 2026LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling
  4. 2025Meta-R1: Empowering Large Reasoning Models with Metacognition
  5. 2025MARCO: Meta-Reflection with Cross-Referencing for Code Reasoning
  6. 2026MetaCtrl: Your Large Language Models Can Reason Better and More Concisely with a Metacognitive Controller
  7. 2026MetaMem: Evolving Meta-Memory for Knowledge Utilization through Self-Reflective Symbolic Optimization
  8. 2025Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspective