From "Aha Moments" to Controllable Thinking: Toward Meta-Cognitive Reasoning in Large Reasoning Models via Decoupled Reasoning and Control
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large Reasoning Models (LRMs) can exhibit step-by-step reasoning, reflection, and backtracking, but these behaviors are often unregulated, leading to overthinking. As a result, LRMs continue generating redundant reasoning even after reaching high-confidence conclusions. This increases inference cost and latency, limiting practical deployment. The root cause is the absence of an intrinsic mechanism to monitor the reasoning state and decide when to continue, backtrack, or stop. We propose MERA, a meta-cognitive reasoning framework that decouples reasoning from control to enable independent optimization of control strategies. MERA constructs high-quality reasoning-control supervision data via a takeover-based pipeline, and transforms long-horizon traces into structured reasoning-control alternating sequences for training. The model is trained with supervised fine-tuning to internalize the structured separation, and further optimized with Control-Segment Policy Optimization (CSPO), which combines segment-wise GRPO with control masking to focus learning on control segments. Experiments across reasoning benchmarks show that MERA improves both efficiency and accuracy.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 30 of its 38 references that are in the map. First posted on arXiv 6 Aug 2025.
Builds on
30 of 38 references.
Closest ancestors · 16
Same direction, newest first
- 2025LAPO: Internalizing Reasoning Efficiency via Length-Adaptive Policy Optimization21 Jul
- 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency10 Jun
- 2025Demystifying Reasoning Dynamics with Mutual Information: Thinking Tokens are Information Peaks in LLM Reasoning3 Jun
- 2025Think Only When You Need with Large Hybrid-Reasoning Models20 May
- 2025AdaptThink: Reasoning Models Can Learn When to Think19 May
- 2025Thinkless: LLM Learns When to Think19 May
- 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learning17 May
- 2025ConCISE: Confidence-guided Compression in Step-by-step Efficient Reasoning8 May
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Reasoning Models Can Be Effective Without Thinking14 Apr
- 2025Speculative Thinking: Enhancing Small-Model Reasoning with Large Model Guidance at Inference Time12 Apr
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
4 more
Other references · 14
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
- 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 155
- 2025Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuningcited by 123
- 2025Segment Policy Optimization: Effective Segment-Level Credit Assignment in RL for Large Language Modelscited by 75
- 2025RedStar: Does Scaling Long-CoT Data Unlock Better Slow-Reasoning Systems?cited by 60
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Verifying Meta-Awareness via Predictive Rewards in Reasoning Modelscited by 3
- 2026Confidence Before Answering: A Paradigm Shift for Efficient LLM Uncertainty Estimationcited by 3
- 2026MA2P: A Meta-Cognitive Autonomous Intelligent Agents Framework for Complex Persuasioncited by 0
- 2026Metacognition as Reward: Reinforcing LLM Reasoning via Knowledge and Regulation Signalscited by 0
- 2026Metacognition as Reward: Reinforcing LLM Reasoning via Knowledge and Regulation Signals22 May 2026
- 2026MA2P: A Meta-Cognitive Autonomous Intelligent Agents Framework for Complex Persuasion18 May 2026
- 2026Confidence Before Answering: A Paradigm Shift for Efficient LLM Uncertainty Estimation6 Mar 2026
- 2025Verifying Meta-Awareness via Predictive Rewards in Reasoning Models26 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026MetaCtrl: Your Large Language Models Can Reason Better and More Concisely with a Metacognitive Controller
- 2026Cognitive Demand Steering for Adaptive Meta-Reasoning in Large Language Models
- 2025Meta-R1: Empowering Large Reasoning Models with Metacognition
- 2025Beyond 'Aha!': Toward Systematic Meta-Abilities Alignment in Large Reasoning Models
- 2026CoT2-Meta: Budgeted Metacognitive Control for Test-Time Reasoning
- 2025Modeling Hierarchical Thinking in Large Reasoning Models
- 2025Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time
- 2026From Meta-Thought to Execution: Cognitively Aligned Post-Training for Generalizable and Reliable LLM Reasoning