mlsanityData to 7 Oct 2026

Probing the "Psyche'' of Large Reasoning Models: Understanding Through a Human Lens

arXiv 2512.00729 ↗First posted 30 Nov 2025cs.AI cs.CLcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Motivated by the observed human-like behaviours in Large Reasoning Models (LRMs), this paper introduces a comprehensive taxonomy to characterise atomic reasoning steps and analyse the reasoning behaviours of LRMs. Grounded in human cognitive processes, we propose a taxonomy comprising five groups and seventeen categories. Through this taxonomy, we conduct an in-depth analysis of contemporary LRMs and distil four actionable takeaways for model optimisation. Most notably, we reveal that prevailing post-answer ``doublechecks'' are largely superficial and rarely yield substantive revisions. A targeted intervention further shows that explicitly eliciting richer reflection processes can substantially improve failed self-correction. To support this largescale study, we propose CAPO, an automated annotation method used to construct a dataset of 277,534 reasoning steps with strong agreement with human expert annotations. We further validate the main behavioural patterns on a newer reasoning model and a coding domain, demonstrating the broader applicability of the proposed taxonomy. All source code and data are available at https://github.com/hehepig4/psyche.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 15 of its 32 references that are in the map. First posted on arXiv 30 Nov 2025.

Builds on

15 of 32 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Reasoning Models Better Express Their Confidence20 May
  2. 2025A Tutorial on LLM Reasoning: Relevant Methods behind ChatGPT o115 Feb
  3. 2024A Comparative Study on Reasoning Patterns of OpenAI's o1 Model17 Oct
  4. 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Training29 Sep

Other references · 11

  1. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  3. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  4. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  5. 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 729
  6. 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 275
  7. 2025MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiencycited by 123
  8. 2025The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMscited by 72
  9. 2025AURORA:Automated Training Framework of Universal Process Reward Models via Ensemble Prompting and Reverse Verificationcited by 22
  10. 2024StraGo: Harnessing Strategic Guidance for Prompt Optimizationcited by 16
  11. 2025GAAPO: Genetic Algorithmic Applied to Prompt Optimizationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Thinking Isn't an Illusion: Overcoming the Limitations of Reasoning Models via Tool Augmentations
  2. 2026Cognitive Profiling of LRMs' Reasoning Traces Using Bloom's Taxonomy
  3. 2025Your thoughts tell who you are: Characterize the reasoning patterns of LRMs
  4. 2025Exploring the System 1 Thinking Capability of Large Reasoning Models
  5. 2025Trade-offs in Large Reasoning Models: An Empirical Analysis of Deliberative and Adaptive Reasoning over Foundational Capabilities
  6. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
  7. 2025Atomic Thinking of LLMs: Decoupling and Exploring Mathematical Reasoning Abilities
  8. 2024Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpus