Deliberative Reasoning Network: An Uncertainty-Driven Paradigm for Belief-Tracked Inference with Pretrained Language Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large language models often fail at logical reasoning when semantic heuristics conflict with decisive evidence - a phenomenon we term cognitive traps. To address this fundamental limitation, we introduce the Deliberative Reasoning Network (DRN), a novel paradigm that reframes logical reasoning from probability maximization to uncertainty minimization. Instead of asking "Which answer is most likely?", DRN asks "Which hypothesis has the most internally consistent evidence?". DRN achieves intrinsic interpretability by explicitly tracking belief states and quantifying epistemic uncertainty for competing hypotheses through an iterative evidence synthesis process. We validate our approach through two complementary architectures - a bespoke discriminative model that embodies the core uncertainty minimization principle, and a lightweight verification module that enhances existing generative LLMs. Evaluated on LCR-1000, our new adversarial reasoning benchmark designed to expose cognitive traps, the bespoke DRN achieves up to 15.2% improvement over standard baselines. When integrated as a parameter-efficient verifier with Mistral-7B, our hybrid system boosts accuracy from 20% to 80% on the most challenging problems. Critically, DRN demonstrates strong zero-shot generalization, improving TruthfulQA performance by 23.6% without additional training, indicating that uncertainty-driven deliberation learns transferable reasoning principles. We position DRN as a foundational, verifiable System 2 reasoning component for building more trustworthy AI systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 8 of its 17 references that are in the map. First posted on arXiv 6 Aug 2025.
Builds on
8 of 17 references.
References · 8
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2024OpenAI o1 System Cardcited by 1,244
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 217
- 2020LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoningcited by 69
- 2025LLMs for Explainable AI: A Comprehensive Surveycited by 45
- 2025Reasoning on a Spectrum: Aligning LLMs to System 1 and System 2 Thinkingcited by 16
- 2025Explainable artificial intelligence (XAI): from inherent explainability to large language modelscited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Improving reasoning at inference time via uncertainty minimisation
- 2026Diagnosing and Improving Probabilistic Reasoning in Large Language Models
- 2026Can We Trust LLM's Logic? Quantifying Uncertainty, Coherence, and Robustness via a Graph-Based Framework
- 2025Addressing Logical Fallacies In Scientific Reasoning From Large Language Models: Towards a Dual-Inference Training Framework
- 2025Certainty-Guided Reasoning in Large Language Models: A Dynamic Thinking Budget Approach
- 2024The Quantified Boolean Bayesian Network: Theory and Experiments with a Logical Graphical Model
- 2025A Survey on Latent Reasoning
- 2025Logical Reasoning in Large Language Models: A Survey