mlsanityData to 7 Oct 2026

Cognitive Decision Routing in Large Language Models: When to Think Fast, When to Think Slow

arXiv 2508.16636 ↗First posted 17 Aug 2025cs.CL cs.AIcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large Language Models (LLMs) face a fundamental challenge in deciding when to rely on rapid, intuitive responses versus engaging in slower, more deliberate reasoning. Inspired by Daniel Kahneman's dual-process theory and his insights on human cognitive biases, we propose a novel Cognitive Decision Routing (CDR) framework that dynamically determines the appropriate reasoning strategy based on query characteristics. Our approach addresses the current limitations where models either apply uniform reasoning depth or rely on computationally expensive methods for all queries. We introduce a meta-cognitive layer that analyzes query complexity through multiple dimensions: correlation strength between given information and required conclusions, domain boundary crossings, stakeholder multiplicity, and uncertainty levels. Through extensive experiments on diverse reasoning tasks, we demonstrate that CDR achieves superior performance while reducing computational costs by 34% compared to uniform deep reasoning approaches. Our framework shows particular strength in professional judgment tasks, achieving 23% improvement in consistency and 18% better accuracy on expert-level evaluations. This work bridges cognitive science principles with practical AI system design, offering a principled approach to adaptive reasoning in LLMs.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 15 of its 28 references that are in the map. First posted on arXiv 17 Aug 2025.

Builds on

15 of 28 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
  2. 2022Language Models (Mostly) Know What They Know11 Jul

Other references · 13

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  4. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  5. 2020A Primer in BERTology: What we know about how BERT workscited by 807
  6. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
  7. 2018MINE: Mutual Information Neural Estimationcited by 680
  8. 2022Towards Reasoning in Large Language Models: A Surveycited by 593
  9. 2022Using cognitive psychology to understand GPT-3cited by 389
  10. 2023Take a Step Back: Evoking Reasoning via Abstraction in Large Language Modelscited by 157
  11. 2021Can Machines Learn Morality? The Delphi Experimentcited by 140
  12. 2019Compositional generalization in a deep seq2seq model by separating syntax and semanticscited by 56
1 more
  1. 2013Reasoning About Beliefs and Actions Under Computational Resource Constraintscited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Beyond Fast and Slow: Cognitive-Inspired Elastic Reasoning for Large Language Models
  2. 2024DynaThink: Fast or Slow? A Dynamic Decision-Making Framework for Large Language Models
  3. 2025Route to Reason: Adaptive Routing for LLM and Reasoning Strategy Selection
  4. 2024The Role of Deductive and Inductive Reasoning in Large Language Models
  5. 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models
  6. 2025Language Models Coupled with Metacognition Can Outperform Reasoning Models
  7. 2025Advancing Reasoning in Large Language Models: Promising Methods and Approaches
  8. 2025From Chaos to Order: The Atomic Reasoner Framework for Fine-grained Reasoning in Large Language Models