Reasoning aligns language models to human cognition
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Do language models make decisions under uncertainty like humans do, and what role does chain-of-thought (CoT) reasoning play in the underlying decision process? We introduce an active probabilistic reasoning task that cleanly separates sampling (actively acquiring evidence) from inference (integrating evidence toward a decision). Benchmarking humans and a broad set of contemporary large language models against near-optimal reference policies reveals a consistent pattern: extended reasoning is the key determinant of strong performance, driving large gains in inference and producing belief trajectories that become strikingly human-like, while yielding only modest improvements in active sampling. To explain these differences, we fit a mechanistic model that captures systematic deviations from optimal behavior via four interpretable latent variables: memory, strategy, choice bias, and occlusion awareness. This model places humans and models in a shared low-dimensional cognitive space, reproduces behavioral signatures across agents, and shows how chain-of-thought shifts language models toward human-like regimes of evidence accumulation and belief-to-choice mapping, tightening alignment in inference while leaving a persistent gap in information acquisition.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 41 of its 107 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
41 of 107 references.
Closest ancestors · 5
Same direction, newest first
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models8 Aug
- 2023MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning24 Oct
- 2023Turning large language models into cognitive models6 Jun
- 2023LLaMA: Open and Efficient Foundation Language Models27 Feb
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Models30 Nov
Other references · 36
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2024GPT-4o System Cardcited by 4,467
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
- 2024OpenAI o1 System Cardcited by 1,220
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
24 more
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
- 2025Humanity's Last Examcited by 467
- 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
- 2025Reasoning Models Don't Always Say What They Thinkcited by 388
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
- 2023Language Models Represent Space and Timecited by 306
- 2022In-context Reinforcement Learning with Algorithm Distillationcited by 186
- 2025Open Problems in Mechanistic Interpretabilitycited by 173
- 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 166
- 2025Thought Anchors: Which LLM Reasoning Steps Matter?cited by 126
- 2025Competitive Programming with Large Reasoning Modelscited by 115
- 2023What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalizationcited by 112
- 2023The ConceptARC Benchmark: Evaluating Understanding and Generalization in the ARC Domaincited by 97
- 2024ICLR: In-Context Learning of Representationscited by 49
- 2023Reason for Future, Act for Now: A Principled Framework for Autonomous LLM Agents with Provable Sample Efficiencycited by 46
- 2025A Survey of In-Context Reinforcement Learningcited by 35
- 2024Centaur: a foundation model of human cognitioncited by 34
- 2024Do LLM Agents Have Regret? A Case Study in Online Learning and Gamescited by 33
- 2024EVOLvE: Evaluating and Optimizing LLMs For In-Context Explorationcited by 33
- 2024Controlling Large Language Model Agents with Entropic Activation Steeringcited by 29
- 2025Thought Branches: Interpreting LLM Reasoning Requires Resamplingcited by 15
- 2024In-context learning agents are asymmetric belief updaterscited by 13
- 2025Levels of Analysis for Large Language Modelscited by 9
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Chain-of-Thought as a Lens: Evaluating Structured Reasoning Alignment between Human Preferences and Large Language Models
- 2026Therefore I am. I Think
- 2023Why think step by step? Reasoning emerges from the locality of experience
- 2026Thinking effort aligns between humans and reasoning models in abductive reasoning
- 2025Rethinking the Chain-of-Thought: The Roles of In-Context Learning and Pre-trained Priors
- 2026Diagnosing and Improving Probabilistic Reasoning in Large Language Models
- 2026Free Energy Heuristics: Fast-And-Frugal Cognition as Active Inference Under Uncertain Precision
- 2025The Universal Landscape of Human Reasoning