A Comprehensive Anatomy of Human and DeepSeek-R1 LLM Mathematical Reasoning
On the map: LLM reasoning → Mathematical reasoning
Abstract (arXiv)
The emergence of "Aha moments" in large language models, particularly DeepSeek-R1-0120, has raised the question of whether these systems genuinely reason or merely imitate the appearance of reasoning. We conduct a comprehensive empirical comparison between model and human reasoning across all 30 problems from AIME 2025, exhaustively annotating 10,247 reasoning steps into five functional categories: Analysis, Inference, Branch, Backtrace, and Reflection. We find a clear structural difference. Human solutions maintain a compact alternation between analysis and deduction, whereas DeepSeek-R1 frequently revisits intermediate results, performs shallow and often unnecessary verification, and loops through local checks without meaningful logical progress. We describe this as topological mimicry: reproducing the surface form of reasoning without its functional role. Despite this, we identify two signals of genuine reasoning. First, successful traces exhibit stable use of branching and backtracking, while failed traces either underuse or overuse exploratory actions. Second, reflection is only effective when placed within deductive inference; reflections trapped in analysis loops focus on local numerical details while missing global logical errors. These findings suggest that current long-CoT models may be rewarded more for the appearance of reasoning than for genuine deductive progress. We discuss directions for improving evaluation and training, including measuring cross-trace stability, penalising "spinning-wheel" traces, encouraging deeper logical correction, and reallocating inference-time compute toward deduction and backtracking. Overall, reasoning quality depends not simply on how much reflection occurs, but on whether reflection appears consistently and at the appropriate logical scale.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 15 of its 34 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
15 of 34 references.
Closest ancestors · 2
Same direction, newest first
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models5 Feb
- 2023A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis24 May
Other references · 13
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
- 2022In-context Learning and Induction Headscited by 964
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 503
- 2024Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Modelscited by 446
- 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
- 2022Generating Sequences by Learning to Self-Correctcited by 277
- 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
- 2025Thought Anchors: Which LLM Reasoning Steps Matter?cited by 129
- 2024A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chainscited by 65
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Schoenfeld's Anatomy of Mathematical Reasoning by Language Models
- 2025Catch Me If You Can: How Smaller Reasoning Models Pretend to Reason with Mathematical Fidelity
- 2026LiveMathematicianBench: A Live Benchmark for Research-Level Mathematical Reasoning with Proof Sketches
- 2026The Missing Primitive: Diagnosing and Repairing Mathematical Reasoning in Large Language Models
- 2025Evaluating Mathematical Reasoning Across Large Language Models: A Fine-Grained Approach
- 2026Convergence Without Understanding: When Language Models Agree on Representations but Disagree on Reasoning
- 2025Thinking Machines: Mathematical Reasoning in the Age of LLMs
- 2025Are Large Language Models Capable of Deep Relational Reasoning? Insights from DeepSeek-R1 and Benchmark Comparisons