MetaCtrl: Your Large Language Models Can Reason Better and More Concisely with a Metacognitive Controller
On the map: LLM reasoning → Test-time compute and efficient thinking also fits: Reinforcement learning for reasoning
Abstract (arXiv)
Large reasoning models improve performance on challenging problems by allocating additional computation before answering, but longer reasoning does not always lead to better results and can introduce substantial redundant reasoning on simple problems. Conversely, aggressively shortening reasoning can degrade performance on difficult ones. Effective reasoning therefore requires dynamically deciding when additional computation is useful based on the reasoner's capabilities and evolving solution state. Existing approaches often rely on predefined budgets or intervention rules, retrain the target reasoner, or require additional supervision. We introduce MetaCtrl, a lightweight controller that adaptively regulates a frozen reasoner without predefined token budgets or reasoner retraining. We formulate reasoning regulation as a sequential metacognitive control problem: MetaCtrl observes the evolving reasoning trace and decides whether to continue, simplify, skip redundant steps, or conclude reasoning. It is trained directly with reinforcement learning using a reward that prioritizes correctness while favoring shorter trajectories among correct solutions, requiring neither supervised intervention trajectories nor problem-specific budgets. Across seven benchmarks spanning mathematics, science, and code, MetaCtrl consistently improves the accuracy of LRMs while reducing their reasoning length. On DeepSeek-R1-Distill-Qwen-7B, it improves average accuracy by 4.7 points while reducing generation length by 53.3%. Without further training, the same controller transfers to an unseen reasoner (e.g., Qwen3-14B), improving average accuracy by 2.9 points and reducing generation length by 50.3%. These results establish MetaCtrl as a plug-and-play controller for improving reasoning accuracy while substantially reducing inference-time generation. The code is available at https://github.com/binbin2xs/MetaCtrl.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 60 of its 68 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
60 of 68 references.
Closest ancestors · 29
Same direction, newest first
- 2026Stop When Further Reasoning Won't Help: Attention-State Adaptive Generation in Reasoning Models13 Jun
- 2026Agentic Chain-of-Thought Steering for Efficient and Controllable LLM Reasoning2 Jun
- 2026When More Thinking Hurts: Overthinking in LLM Test-Time Compute Scaling12 Apr
- 2025DiffAdapt: Difficulty-Adaptive Reasoning for Token-Efficient LLM Inference22 Oct
- 2025Do LLMs Really Need 10+ Thoughts for "Find the Time 1000 Days Later"? Towards Structural Understanding of LLM Overthinking9 Oct
- 2025Efficient Reasoning for Large Reasoning Language Models via Certainty-Guided Reflection Suppression7 Aug
- 2025Think How to Think: Mitigating Overthinking with Autonomous Difficulty Cognition in Large Reasoning Models3 Jul
- 2025AdaCtrl: Towards Adaptive and Controllable Reasoning via Difficulty-Aware Budgeting24 May
- 2025ThinkSwitcher: When to Think Hard, When to Think Fast20 May
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Reasoning Models Can Be Effective Without Thinking14 Apr
- 2025Speculative Thinking: Enhancing Small-Model Reasoning with Large Model Guidance at Inference Time12 Apr
17 more
- 2025SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning10 Apr
- 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Free7 Apr
- 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learning2 Apr
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
- 2025Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decoding3 Mar
- 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approach3 Mar
- 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning25 Feb
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
- 2025Reward-Guided Speculative Decoding for Efficient LLM Reasoning31 Jan
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Token-Budget-Aware LLM Reasoning24 Dec
- 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectiveness16 Dec
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar
Other references · 31
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
19 more
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
- 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Modelscited by 284
- 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningcited by 263
- 2024Distilling System 2 into System 1cited by 159
- 2024The Impact of Reasoning Step Length on Large Language Modelscited by 153
- 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
- 2025S*: Test Time Scaling for Code Generationcited by 98
- 2024The Benefits of a Concise Chain of Thought on Problem-Solving in Large Language Modelscited by 63
- 2025Answer Convergence as a Signal for Early Stopping in Reasoningcited by 40
- 2025Think When You Need: Self-Adaptive Chain-of-Thought Learningcited by 38
- 2024Break the Chain: Large Language Models Can be Shortcut Reasonerscited by 32
- 2025Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspectivecited by 29
- 2025What Makes a Good Curriculum? Disentangling the Effects of Data Ordering on LLM Mathematical Reasoningcited by 11
- 2024Step Guided Reasoning: Improving Mathematical Reasoning using Guidance Generation and Step Reasoningcited by 9
- 2025Long or short CoT? Investigating Instance-level Switch of Large Reasoning Modelscited by 8
- 2025PREMISE: Scalable and Strategic Prompt Optimization for Efficient Mathematical Reasoning in Large Modelscited by 5
- 2026Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirerscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Meta-Reasoner: Dynamic Guidance for Optimized Inference-time Reasoning in Large Language Models
- 2026Cognitive Demand Steering for Adaptive Meta-Reasoning in Large Language Models
- 2025From Efficiency to Adaptivity: A Deeper Look at Adaptive Reasoning in Large Language Models
- 2026Think2: Grounded Metacognitive Reasoning in Large Language Models
- 2025ConciseRL: Conciseness-Guided Reinforcement Learning for Efficient Reasoning Models
- 2026Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning
- 2025ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Models
- 2026Long-Context Reasoning Through Proxy-Based Chain-of-Thought Tuning