Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large language models (LLMs) now solve multi-step problems by emitting extended chains of thought. During the process, they often re-derive the same intermediate steps across problems, inflating token usage and latency. This saturation of the context window leaves less capacity for exploration. We study a simple mechanism that converts recurring reasoning fragments into concise, reusable "behaviors" (name + instruction) via the model's own metacognitive analysis of prior traces. These behaviors are stored in a "behavior handbook" which supplies them to the model in-context at inference or distills them into parameters via supervised fine-tuning. This approach achieves improved test-time reasoning across three different settings - 1) Behavior-conditioned inference: Providing the LLM relevant behaviors in-context during reasoning reduces number of reasoning tokens by up to 46% while matching or improving baseline accuracy; 2) Behavior-guided self-improvement: Without any parameter updates, the model improves its own future reasoning by leveraging behaviors from its own past problem solving attempts. This yields up to 10% higher accuracy than a naive critique-and-revise baseline; and 3) Behavior-conditioned SFT: SFT on behavior-conditioned reasoning traces is more effective at converting non-reasoning models into reasoning models as compared to vanilla SFT. Together, these results indicate that turning slow derivations into fast procedural hints enables LLMs to remember how to reason, not just what to conclude.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 21 of its 36 references that are in the map. First posted on arXiv 16 Sep 2025.
Builds on
21 of 36 references.
Closest ancestors · 4
Same direction, newest first
- 2025Done Is Better than Perfect: Unlocking Efficient Reasoning by Structured Multi-Turn Decomposition26 May
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2025s1: Simple test-time scaling31 Jan
- 2024Efficiently Scaling LLM Reasoning with Certaindex30 Dec
Other references · 17
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Qwen Technical Reportcited by 3,344
- 2024OpenAI o1 System Cardcited by 1,244
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2025SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wildcited by 511
5 more
- 2025LIMO: Less is More for Reasoningcited by 498
- 2021Efficient Nearest Neighbor Language Modelscited by 93
- 2024On Designing Effective RL Reward at Training Time for LLM Reasoningcited by 87
- 2024AI-Assisted Generation of Difficult Math Questionscited by 37
- 2025AdaptMI: Adaptive Skill-based In-context Math Instruction for Small Language Modelscited by 5
Built on by
Citing papers per year: 2025: 3; 2026: 27.
30 papers.
Sort:
By area:
- 2026Privileged Information Distillation for Language Modelscited by 90
- 2026Self-Distillation Zero: Self-Revision Turns Binary Rewards into Dense Supervisioncited by 68
- 2025Rethinking Thinking Tokens: LLMs as Improvement Operatorscited by 21
- 2026Vero: An Open RL Recipe for General Visual Reasoningcited by 11
- 2026UMEM: Unified Memory Extraction and Management Framework for Generalizable Memorycited by 8
- 2026Learning Next Action Predictors from Human-Computer Interactioncited by 7
- 2026Measuring Weak-to-Strong Legibility of Reasoning Modelscited by 5
- 2025Verifying Meta-Awareness via Predictive Rewards in Reasoning Modelscited by 3
- 2026Scaling Small Agents Through Strategy Auctionscited by 3
- 2026Self-Verification Dilemma: Experience-Driven Suppression of Overused Checking in LLM Reasoningcited by 3
- 2026Federation over Text: Insight Sharing for Multi-Agent Reasoningcited by 3
- 2025Training-Free Spectral Fingerprints of Voice Processing in Transformerscited by 2
18 more
- 2026Towards Effective Experiential Learning: Dual Guidance for Utilization and Internalizationcited by 2
- 2026Neural Garbage Collection: Learning to Forget while Learning to Reasoncited by 2
- 2026Zipping the Thought: When and How Compressed Reasoning Data Works in LLM Post-Trainingcited by 2
- 2026Beyond Confidence: Rethinking Self-Assessments for Performance Prediction in LLMscited by 1
- 2026CORE: Contrastive Reflection Enables Rapid Improvements in Reasoningcited by 1
- 2026Learning to Reason by Analogy via Retrieval-Augmented Reinforcement Fine-Tuningcited by 1
- 2026MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoningcited by 1
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunitiescited by 1
- 2026Metacognitive Behavioral Tuning of Large Language Models for Multi-Hop Question Answeringcited by 0
- 2026Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMscited by 0
- 2026Characterizing Model-Native Skillscited by 0
- 2026Notes to Self: Can LLMs Benefit from Experiential Abstractions?cited by 0
- 2026ThinkReset: Learnable Intermediate Interface Construction for Bounded-Context Long-Horizon Reasoningcited by 0
- 2026Memory Augmentation Unlocks Efficient Chain-of-Thought Reasoningcited by 0
- 2026Characterizing a Configuration Where Inference-Time PRM-Pruned Fragment Grafting Is Inert: Evidence from Three Reasoning LMscited by 0
- 2026Test-Time Adaptation of Reasoning Strategies with Bayesian Nonparametric Memorycited by 0
- 2026Agent Plasticity: Measuring Self-Improvement Through Experiencecited by 0
- 2026Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolutioncited by 0
- 2026Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolution8 Oct 2026
- 2026Agent Plasticity: Measuring Self-Improvement Through Experience6 Oct 2026
- 2026Test-Time Adaptation of Reasoning Strategies with Bayesian Nonparametric Memory5 Oct 2026
- 2026Characterizing a Configuration Where Inference-Time PRM-Pruned Fragment Grafting Is Inert: Evidence from Three Reasoning LMs3 Sep 2026
- 2026Memory Augmentation Unlocks Efficient Chain-of-Thought Reasoning21 Aug 2026
- 2026Notes to Self: Can LLMs Benefit from Experiential Abstractions?22 Jul 2026
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunities13 Jul 2026
- 2026MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoning8 Jul 2026
- 2026Learning to Reason by Analogy via Retrieval-Augmented Reinforcement Fine-Tuning11 Jun 2026
- 2026CORE: Contrastive Reflection Enables Rapid Improvements in Reasoning27 May 2026
- 2026Zipping the Thought: When and How Compressed Reasoning Data Works in LLM Post-Training27 May 2026
- 2026ThinkReset: Learnable Intermediate Interface Construction for Bounded-Context Long-Horizon Reasoning26 May 2026
18 more
- 2026Beyond Confidence: Rethinking Self-Assessments for Performance Prediction in LLMs8 May 2026
- 2026Neural Garbage Collection: Learning to Forget while Learning to Reason20 Apr 2026
- 2026Characterizing Model-Native Skills19 Apr 2026
- 2026Federation over Text: Insight Sharing for Multi-Agent Reasoning18 Apr 2026
- 2026Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMs17 Apr 2026
- 2026Self-Distillation Zero: Self-Revision Turns Binary Rewards into Dense Supervision13 Apr 2026
- 2026Vero: An Open RL Recipe for General Visual Reasoning6 Apr 2026
- 2026Towards Effective Experiential Learning: Dual Guidance for Utilization and Internalization25 Mar 2026
- 2026Measuring Weak-to-Strong Legibility of Reasoning Models20 Mar 2026
- 2026Learning Next Action Predictors from Human-Computer Interaction6 Mar 2026
- 2026Metacognitive Behavioral Tuning of Large Language Models for Multi-Hop Question Answering26 Feb 2026
- 2026UMEM: Unified Memory Extraction and Management Framework for Generalizable Memory11 Feb 2026
- 2026Privileged Information Distillation for Language Models4 Feb 2026
- 2026Self-Verification Dilemma: Experience-Driven Suppression of Overused Checking in LLM Reasoning3 Feb 2026
- 2026Scaling Small Agents Through Strategy Auctions2 Feb 2026
- 2025Training-Free Spectral Fingerprints of Voice Processing in Transformers21 Oct 2025
- 2025Rethinking Thinking Tokens: LLMs as Improvement Operators1 Oct 2025
- 2025Verifying Meta-Awareness via Predictive Rewards in Reasoning Models26 Sep 2025
- 2025Rethinking Thinking Tokens: LLMs as Improvement Operatorscited by 21
- 2026Vero: An Open RL Recipe for General Visual Reasoningcited by 11
- 2026Measuring Weak-to-Strong Legibility of Reasoning Modelscited by 5
- 2025Verifying Meta-Awareness via Predictive Rewards in Reasoning Modelscited by 3
- 2026Self-Verification Dilemma: Experience-Driven Suppression of Overused Checking in LLM Reasoningcited by 3
- 2026Federation over Text: Insight Sharing for Multi-Agent Reasoningcited by 3
- 2026Neural Garbage Collection: Learning to Forget while Learning to Reasoncited by 2
- 2026Zipping the Thought: When and How Compressed Reasoning Data Works in LLM Post-Trainingcited by 2
- 2026Beyond Confidence: Rethinking Self-Assessments for Performance Prediction in LLMscited by 1
- 2026CORE: Contrastive Reflection Enables Rapid Improvements in Reasoningcited by 1
- 2026Learning to Reason by Analogy via Retrieval-Augmented Reinforcement Fine-Tuningcited by 1
- 2026MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoningcited by 1
12 most cited of 17 All 17 (JSON)
- 2026Test-Time Adaptation of Reasoning Strategies with Bayesian Nonparametric Memory5 Oct 2026
- 2026Memory Augmentation Unlocks Efficient Chain-of-Thought Reasoning21 Aug 2026
- 2026MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoning8 Jul 2026
- 2026Learning to Reason by Analogy via Retrieval-Augmented Reinforcement Fine-Tuning11 Jun 2026
- 2026CORE: Contrastive Reflection Enables Rapid Improvements in Reasoning27 May 2026
- 2026Zipping the Thought: When and How Compressed Reasoning Data Works in LLM Post-Training27 May 2026
- 2026ThinkReset: Learnable Intermediate Interface Construction for Bounded-Context Long-Horizon Reasoning26 May 2026
- 2026Beyond Confidence: Rethinking Self-Assessments for Performance Prediction in LLMs8 May 2026
- 2026Neural Garbage Collection: Learning to Forget while Learning to Reason20 Apr 2026
- 2026Federation over Text: Insight Sharing for Multi-Agent Reasoning18 Apr 2026
- 2026Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMs17 Apr 2026
- 2026Vero: An Open RL Recipe for General Visual Reasoning6 Apr 2026
12 newest of 17 All 17 (JSON)
- 2026Scaling Small Agents Through Strategy Auctionscited by 3
- 2026Scaling Small Agents Through Strategy Auctions2 Feb 2026
- 2026UMEM: Unified Memory Extraction and Management Framework for Generalizable Memorycited by 8
- 2026Learning Next Action Predictors from Human-Computer Interactioncited by 7
- 2025Training-Free Spectral Fingerprints of Voice Processing in Transformerscited by 2
- 2026Towards Effective Experiential Learning: Dual Guidance for Utilization and Internalizationcited by 2
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunitiescited by 1
- 2026Characterizing Model-Native Skillscited by 0
- 2026Notes to Self: Can LLMs Benefit from Experiential Abstractions?cited by 0
- 2026Characterizing a Configuration Where Inference-Time PRM-Pruned Fragment Grafting Is Inert: Evidence from Three Reasoning LMscited by 0
- 2026Agent Plasticity: Measuring Self-Improvement Through Experiencecited by 0
- 2026Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolutioncited by 0
- 2026Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolution8 Oct 2026
- 2026Agent Plasticity: Measuring Self-Improvement Through Experience6 Oct 2026
- 2026Characterizing a Configuration Where Inference-Time PRM-Pruned Fragment Grafting Is Inert: Evidence from Three Reasoning LMs3 Sep 2026
- 2026Notes to Self: Can LLMs Benefit from Experiential Abstractions?22 Jul 2026
- 2026Metacognition in LLMs: Foundations, Progress, and Opportunities13 Jul 2026
- 2026Characterizing Model-Native Skills19 Apr 2026
- 2026Towards Effective Experiential Learning: Dual Guidance for Utilization and Internalization25 Mar 2026
- 2026Learning Next Action Predictors from Human-Computer Interaction6 Mar 2026
- 2026UMEM: Unified Memory Extraction and Management Framework for Generalizable Memory11 Feb 2026
- 2025Training-Free Spectral Fingerprints of Voice Processing in Transformers21 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning
- 2026LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling
- 2026Think2: Grounded Metacognitive Reasoning in Large Language Models
- 2026The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes
- 2025Fast, Slow, and Tool-augmented Thinking for LLMs: A Review
- 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs
- 2025ReJump: A Tree-Jump Representation for Analyzing and Improving LLM Reasoning
- 2025Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time