mlsanityData to 14 Oct 2026

Towards Understanding the Cognitive Habits of Large Reasoning Models

arXiv 2506.21571 ↗First posted 13 Jun 2025cs.CL cs.AI cs.CRcited by 4

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large Reasoning Models (LRMs), which autonomously produce a reasoning Chain of Thought (CoT) before producing final responses, offer a promising approach to interpreting and monitoring model behaviors. Inspired by the observation that certain CoT patterns -- e.g., ``Wait, did I miss anything?'' -- consistently emerge across tasks, we explore whether LRMs exhibit human-like cognitive habits. Building on Habits of Mind, a well-established framework of cognitive habits associated with successful human problem-solving, we introduce CogTest, a principled benchmark designed to evaluate LRMs' cognitive habits. CogTest includes 16 cognitive habits, each instantiated with 25 diverse tasks, and employs an evidence-first extraction method to ensure reliable habit identification. With CogTest, we conduct a comprehensive evaluation of 16 widely used LLMs (13 LRMs and 3 non-reasoning ones). Our findings reveal that LRMs, unlike conventional LLMs, not only exhibit human-like habits but also adaptively deploy them according to different tasks. Finer-grained analyses further uncover patterns of similarity and difference in LRMs' cognitive habit profiles, particularly certain inter-family similarity (e.g., Qwen-3 models and DeepSeek-R1). Extending the study to safety-related tasks, we observe that certain habits, such as Taking Responsible Risks, are strongly associated with the generation of harmful responses. These findings suggest that studying persistent behavioral patterns in LRMs' CoTs is a valuable step toward deeper understanding of LLM misbehavior. The code is available at: https://github.com/jianshuod/CogTest.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 27 of its 60 references that are in the map. First posted on arXiv 13 Jun 2025.

Builds on

27 of 60 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  2. 2025s1: Simple test-time scaling31 Jan
  3. 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan
  4. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
  5. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug

Other references · 22

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2024Qwen2.5 Technical Reportcited by 4,942
  6. 2024GPT-4o System Cardcited by 4,588
  7. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  8. 2024OpenAI o1 System Cardcited by 1,244
  9. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
  10. 2024DeepSeek-V3 Technical Reportcited by 811
  11. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
  12. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
10 more
  1. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
  2. 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 313
  3. 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 293
  4. 2024Chain-of-Thought Reasoning Without Promptingcited by 210
  5. 2025Seed1.5-Thinking: Advancing Superb Reasoning Models with Reinforcement Learningcited by 161
  6. 2023Do LLMs Possess a Personality? Making the MBTI Test an Amazing Evaluation for Large Language Modelscited by 56
  7. 2025Detection and Mitigation of Hallucination in Large Reasoning Models: A Mechanistic Perspectivecited by 34
  8. 2025How Should We Enhance the Safety of Large Reasoning Models: An Empirical Studycited by 18
  9. 2024CBEval: A framework for evaluating and interpreting cognitive biases in LLMscited by 12
  10. 2025AI Awarenesscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks
  2. 2026Reasoning as Pattern Matching: Shared Mechanisms in Human and LLM Everyday Reasoning
  3. 2025Probing the "Psyche'' of Large Reasoning Models: Understanding Through a Human Lens
  4. 2025Measuring the Faithfulness of Thinking Drafts in Large Reasoning Models
  5. 2026Cognitive Profiling of LRMs' Reasoning Traces Using Bloom's Taxonomy
  6. 2025Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time
  7. 2023Studying and improving reasoning in humans and machines
  8. 2025Cognitive Foundations for Reasoning and Their Manifestation in LLMs