Reinforcement Inference: Leveraging Uncertainty for Self-Correcting Language Model Reasoning
On the map: LLM reasoning → Reinforcement learning for reasoning
Abstract (arXiv)
Modern large language models (LLMs) are often evaluated and deployed under a one-shot, greedy inference protocol, especially in professional settings that require deterministic behavior. This regime can systematically under-estimate a fixed model's true capability: many errors arise not from missing knowledge, but from premature commitment under internal ambiguity. We introduce Reinforcement Inference, an entropy-aware inference-time control strategy that uses the model's own uncertainty to selectively invoke a second, more deliberate reasoning attempt, enabling stronger performance without any retraining. On 12,032 MMLU-Pro questions across 14 subjects, using DeepSeek-v3.2 with deterministic decoding in a zero-shot setting, Reinforcement Inference improves accuracy from 60.72% to 84.03%, while only incurring 61.06% additional inference calls. A 100% re-asking ablation reaches 84.35%, indicating that uncertainty-aware selection captures most of the attainable improvement with substantially less compute. Moreover, a prompt-only ablation underperforms the baseline, suggesting that the gains are not explained by generic prompting alone. Beyond providing a practical inference-time upgrade, our results suggest a broader entropy-aware paradigm for measuring and expanding model capability: because modern decoder-based models generate outputs autoregressively, entropy and related confidence measures arise naturally as first-class control signals during generation. The resulting gap between one-pass greedy inference and uncertainty-conditioned deliberation offers a diagnostic lens on an LLM's latent reasoning horizon and motivates future training objectives that explicitly constrain correctness--confidence alignment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 39 of its 47 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
39 of 47 references.
Closest ancestors · 1
Same direction, newest first
Other references · 38
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
26 more
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2020Learning to summarize from human feedbackcited by 2,562
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
- 2019How Can We Know What Language Models Know?cited by 953
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 946
- 2017Selective Classification for Deep Neural Networkscited by 799
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2022Teaching Models to Express Their Uncertainty in Wordscited by 731
- 2020Aligning AI With Shared Human Valuescited by 706
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
- 2024Know Your Limits: A Survey of Abstention in Large Language Modelscited by 116
- 2024Large Language Models Must Be Taught to Know What They Don't Knowcited by 99
- 2025Uncertainty Quantification and Confidence Calibration in Large Language Models: A Surveycited by 93
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025T1: Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling
- 2025Post-Training Large Language Models via Reinforcement Learning from Self-Feedback
- 2026From Entropy to Calibrated Uncertainty: Training Language Models to Reason About Uncertainty
- 2025A Sober Look at Progress in Language Model Reasoning: Pitfalls and Paths to Reproducibility
- 2026Exploration-Driven Optimization for Test-Time Large Language Model Reasoning
- 2025Large Language Models Reasoning Abilities Under Non-Ideal Conditions After RL-Fine-Tuning
- 2025Optimizing Language Models for Inference Time Objectives using Reinforcement Learning
- 2026CARE-RFT: Confidence-Anchored Reinforcement Finetuning for Reliable Reasoning in Large Language Models