H'an D=an Xu'e B`u (Mimicry) or Q=ing Ch=u Y'u L'an (Mastery)? A Cognitive Perspective on Reasoning Distillation in Large Language Models
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
also in 1 more
Abstract (arXiv)
Recent Large Reasoning Models trained via reinforcement learning exhibit a "natural" alignment with human cognitive costs. However, we show that the prevailing paradigm of reasoning distillation -- training student models to mimic these traces via Supervised Fine-Tuning (SFT) -- fails to transmit this cognitive structure. Testing the "H'an D=an Xu'e B`u" (Superficial Mimicry) hypothesis across 14 models, we find that distillation induces a "Functional Alignment Collapse": while teacher models mirror human difficulty scaling (barr=0.64), distilled students significantly degrade this alignment (barr=0.34), often underperforming their own pre-distillation baselines ("Negative Transfer"). Our analysis suggests that SFT induces a "Cargo Cult" effect, where students ritualistically replicate the linguistic form of reasoning (verbosity) without internalizing the teacher's dynamic resource allocation policy. Consequently, reasoning distillation decouples computational cost from cognitive demand, revealing that human-like cognition is an emergent property of active reinforcement, not passive imitation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 4 of its 30 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
4 of 30 references.
Closest ancestors · 1
Same direction, newest first
Other references · 3
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2024Language Models Resist Alignment: Evidence From Data Compressioncited by 53
- 2025ARC Is a Vision Problem!cited by 24
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Scale or Reason? A Compute-Equivalent Analysis of Reasoning Distillation
- 2026Knowledge Distillation under Teacher Misspecification: An Order-Parameter Analysis of the Gap between Teacher Mimicry and Task Performance
- 2025Scaling Competence, Shrinking Reasoning: Cognitive Signatures in Language Model Learning
- 2025Distilled Circuits: A Mechanistic Study of Internal Restructuring in Knowledge Distillation
- 2024Revisiting the Superficial Alignment Hypothesis
- 2026Thinking effort aligns between humans and reasoning models in abductive reasoning
- 2025RLKD: Distilling LLMs' Reasoning via Reinforcement Learning
- 2024Beyond Imitation: Learning Key Reasoning Steps from Dual Chain-of-Thoughts in Reasoning Distillation