mlsanityData to 14 Oct 2026

Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors

arXiv 2509.13237 ↗First posted 16 Sep 2025cs.LG cs.AIcited by 30

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large language models (LLMs) now solve multi-step problems by emitting extended chains of thought. During the process, they often re-derive the same intermediate steps across problems, inflating token usage and latency. This saturation of the context window leaves less capacity for exploration. We study a simple mechanism that converts recurring reasoning fragments into concise, reusable "behaviors" (name + instruction) via the model's own metacognitive analysis of prior traces. These behaviors are stored in a "behavior handbook" which supplies them to the model in-context at inference or distills them into parameters via supervised fine-tuning. This approach achieves improved test-time reasoning across three different settings - 1) Behavior-conditioned inference: Providing the LLM relevant behaviors in-context during reasoning reduces number of reasoning tokens by up to 46% while matching or improving baseline accuracy; 2) Behavior-guided self-improvement: Without any parameter updates, the model improves its own future reasoning by leveraging behaviors from its own past problem solving attempts. This yields up to 10% higher accuracy than a naive critique-and-revise baseline; and 3) Behavior-conditioned SFT: SFT on behavior-conditioned reasoning traces is more effective at converting non-reasoning models into reasoning models as compared to vanilla SFT. Together, these results indicate that turning slow derivations into fast procedural hints enables LLMs to remember how to reason, not just what to conclude.

Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 21 of its 36 references that are in the map. First posted on arXiv 16 Sep 2025.

Builds on

21 of 36 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Done Is Better than Perfect: Unlocking Efficient Reasoning by Structured Multi-Turn Decomposition26 May
  2. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
  3. 2025s1: Simple test-time scaling31 Jan
  4. 2024Efficiently Scaling LLM Reasoning with Certaindex30 Dec

Other references · 17

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2024Qwen2.5 Technical Reportcited by 4,942
  5. 2023Qwen Technical Reportcited by 3,344
  6. 2024OpenAI o1 System Cardcited by 1,244
  7. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  8. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  9. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  10. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
  11. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
  12. 2025SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wildcited by 511
5 more
  1. 2025LIMO: Less is More for Reasoningcited by 498
  2. 2021Efficient Nearest Neighbor Language Modelscited by 93
  3. 2024On Designing Effective RL Reward at Training Time for LLM Reasoningcited by 87
  4. 2024AI-Assisted Generation of Difficult Math Questionscited by 37
  5. 2025AdaptMI: Adaptive Skill-based In-context Math Instruction for Small Language Modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 27.

30 papers.

Sort:

By area:

  1. 2026Privileged Information Distillation for Language Modelscited by 90
  2. 2026Self-Distillation Zero: Self-Revision Turns Binary Rewards into Dense Supervisioncited by 68
  3. 2025Rethinking Thinking Tokens: LLMs as Improvement Operatorscited by 21
  4. 2026Vero: An Open RL Recipe for General Visual Reasoningcited by 11
  5. 2026UMEM: Unified Memory Extraction and Management Framework for Generalizable Memorycited by 8
  6. 2026Learning Next Action Predictors from Human-Computer Interactioncited by 7
  7. 2026Measuring Weak-to-Strong Legibility of Reasoning Modelscited by 5
  8. 2025Verifying Meta-Awareness via Predictive Rewards in Reasoning Modelscited by 3
  9. 2026Scaling Small Agents Through Strategy Auctionscited by 3
  10. 2026Self-Verification Dilemma: Experience-Driven Suppression of Overused Checking in LLM Reasoningcited by 3
  11. 2026Federation over Text: Insight Sharing for Multi-Agent Reasoningcited by 3
  12. 2025Training-Free Spectral Fingerprints of Voice Processing in Transformerscited by 2
18 more
  1. 2026Towards Effective Experiential Learning: Dual Guidance for Utilization and Internalizationcited by 2
  2. 2026Neural Garbage Collection: Learning to Forget while Learning to Reasoncited by 2
  3. 2026Zipping the Thought: When and How Compressed Reasoning Data Works in LLM Post-Trainingcited by 2
  4. 2026Beyond Confidence: Rethinking Self-Assessments for Performance Prediction in LLMscited by 1
  5. 2026CORE: Contrastive Reflection Enables Rapid Improvements in Reasoningcited by 1
  6. 2026Learning to Reason by Analogy via Retrieval-Augmented Reinforcement Fine-Tuningcited by 1
  7. 2026MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoningcited by 1
  8. 2026Metacognition in LLMs: Foundations, Progress, and Opportunitiescited by 1
  9. 2026Metacognitive Behavioral Tuning of Large Language Models for Multi-Hop Question Answeringcited by 0
  10. 2026Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMscited by 0
  11. 2026Characterizing Model-Native Skillscited by 0
  12. 2026Notes to Self: Can LLMs Benefit from Experiential Abstractions?cited by 0
  13. 2026ThinkReset: Learnable Intermediate Interface Construction for Bounded-Context Long-Horizon Reasoningcited by 0
  14. 2026Memory Augmentation Unlocks Efficient Chain-of-Thought Reasoningcited by 0
  15. 2026Characterizing a Configuration Where Inference-Time PRM-Pruned Fragment Grafting Is Inert: Evidence from Three Reasoning LMscited by 0
  16. 2026Test-Time Adaptation of Reasoning Strategies with Bayesian Nonparametric Memorycited by 0
  17. 2026Agent Plasticity: Measuring Self-Improvement Through Experiencecited by 0
  18. 2026Which Skill to Distill? SGUID: Selecting a Compact Skill Bank for Model-Skill Co-Evolutioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning
  2. 2026LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling
  3. 2026Think2: Grounded Metacognitive Reasoning in Large Language Models
  4. 2026The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes
  5. 2025Fast, Slow, and Tool-augmented Thinking for LLMs: A Review
  6. 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs
  7. 2025ReJump: A Tree-Jump Representation for Analyzing and Improving LLM Reasoning
  8. 2025Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time