Thinking effort aligns between humans and reasoning models in abductive reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
A major question in cognitive modeling concerns the behavioral alignment between large language models and humans across linguistic and non-linguistic tasks. Unlike standard LLMs, large reasoning models (LRMs) are optimized with reinforcement learning from verifiable rewards, encouraging correct solutions to reasoning tasks rather than preference-aligned responses. Recent work (de Varda et al., 2025) investigates the cost of thinking in humans and LRMs by comparing human reaction times with model reasoning traces across a range of reasoning tasks. We isolate this alignment by turning to abductive reasoning: unlike deductive tasks, its difficulty cannot be inferred from formal structure and offers no shortcuts a model could exploit to mimic effort without genuine search, providing firmer ground for empirical claims of shared effort. We find further evidence of alignment between LRM and human reasoning effort, as well as evidence that models and humans tend to make similar errors. Finally, we show that decoding methods that let models explore multiple reasoning paths increase alignment in reasoning cost between humans and LRMs across the three models tested.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 29 of its 58 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
29 of 58 references.
Closest ancestors · 6
Same direction, newest first
- 2026Wiring the 'Why': A Unified Taxonomy and Survey of Abductive Reasoning in LLMs9 Apr
- 2026Abductive Reasoning with Syllogistic Forms in Large Language Models6 Mar
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models8 Aug
- 2025Qwen3 Technical Report14 May
- 2024DeepSeek-V3 Technical Report27 Dec
- 2023Dissociating language and thought in large language models16 Jan
Other references · 23
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2025s1: Simple test-time scalingcited by 1,341
11 more
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2025Kimi K2: Open Agentic Intelligencecited by 567
- 2019Abductive Commonsense Reasoningcited by 301
- 2024Chain-of-Thought Reasoning Without Promptingcited by 210
- 2024Let's Think Dot by Dot: Hidden Computation in Transformer Language Modelscited by 191
- 2025MedCaseReasoning: Evaluating and learning diagnostic reasoning from clinical case reportscited by 36
- 2020Contextual Temperature for Language Modelingcited by 27
- 2025Wait, Wait, Wait... Why Do Reasoning Models Loop?cited by 26
- 2026Think Deep, Not Just Long: Measuring LLM Reasoning Effort via Deep-Thinking Tokenscited by 22
- 2025Frontier LLMs Still Struggle with Simple Reasoning Taskscited by 21
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Effort as Ceiling, Not Dial: Reasoning Budget Does Not Modulate Cognitive Cost Alignment Between Humans and Large Reasoning Models
- 2026To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks
- 2026Reasoning aligns language models to human cognition
- 2023Studying and improving reasoning in humans and machines
- 2025Large Reasoning Models are not thinking straight: on the unreliability of thinking trajectories
- 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models
- 2025What makes Reasoning Models Different? Follow the Reasoning Leader for Efficient Decoding
- 2026Rewarding Efficient Reasoning Improves Abstention on Underspecified Tasks in Reasoning Models