Bridging the Detection-to-Abstention Gap in Reasoning Models under Insufficient Information
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
We highlight a failure mode of large reasoning models on questions with insufficient information: models may recognize that a problem is under-specified, yet still continue reasoning and produce unsupported final answers instead of abstaining. We formalize this mismatch as the detection-to-abstention gap, where detected insufficiency fails to translate into final abstention. This gap is especially concerning in high-risk domains such as medical AI, where answers based on incomplete evidence can be more harmful than refusal. To close this gap, we propose Judge-Then-Solve (JTS), a trajectory-level reasoning-control framework that trains models to make an explicit answerability commitment before solution generation. Rather than treating abstention as a final-answer style, JTS casts it as a control decision: the model either proceeds to solve or terminates early based on its answerability judgment. We instantiate this policy through supervised warm-up and missing-premise reinforcement learning with consistency and length-shaping rewards. Experiments on dense and MoE reasoning models show that JTS substantially improves reliable abstention across datasets and pushes Abstention@Detection (A@D) to near-saturation, indicating that models not only detect missing information but also act on that detection. By terminating unanswerable trajectories immediately after the answerability judgment, JTS reduces unnecessary reasoning and improves inference efficiency when continued deliberation would amplify unsupported assumptions. We also observe that missing-premise training can alter reasoning behavior on difficult but answerable problems, reducing unproductive self-reflection. These results suggest that abstention under insufficient information is a key form of reasoning control for deploying reasoning models safely and efficiently.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 36 of its 51 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
36 of 51 references.
Closest ancestors · 5
Same direction, newest first
- 2025Revisiting Overthinking in Long Chain-of-Thought from the Perspective of Self-Doubt29 May
- 2025Missing Premise exacerbates Overthinking: Are Reasoning Models losing Critical Thinking Skill?9 Apr
- 2025s1: Simple test-time scaling31 Jan
- 2022Language Models (Mostly) Know What They Know11 Jul
- 2022STaR: Bootstrapping Reasoning With Reasoning28 Mar
Other references · 31
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
- 2022Teaching Models to Express Their Uncertainty in Wordscited by 731
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
19 more
- 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Modelscited by 277
- 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 145
- 2025AbstentionBench: Reasoning LLMs Fail on Unanswerable Questionscited by 129
- 2025Beyond Binary Rewards: Training LMs to Reason About Their Uncertaintycited by 107
- 2025Self-Rewarding Vision-Language Model via Reasoning Decompositioncited by 95
- 2025A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applicationscited by 91
- 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 91
- 2023Self-Evaluation Improves Selective Generation in Large Language Modelscited by 74
- 2019Don't Take the Premise for Granted: Mitigating Artifacts in Natural Language Inferencecited by 48
- 2025The Hallucination Tax of Reinforcement Finetuningcited by 35
- 2025Step-KTO: Optimizing Mathematical Reasoning through Stepwise Binary Feedbackcited by 22
- 2024HonestLLM: Toward an Honest and Helpful Large Language Modelcited by 17
- 2026Knowing When to Abstain: Medical LLMs Under Clinical Uncertaintycited by 13
- 2025Uncertainty-Aware Large Language Models for Explainable Disease Diagnosiscited by 9
- 2026Map2Thought: Explicit 3D Spatial Reasoning via Metric Cognitive Mapscited by 8
- 2025KnowGuard: Knowledge-Driven Abstention for Multi-Round Clinical Reasoningcited by 5
- 2026When Silence Is Golden: Can LLMs Learn to Abstain in Temporal QA and Beyond?cited by 5
- 2026Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalabilitycited by 4
- 2025Learning the Boundary of Solvability: Aligning LLMs to Detect Unsolvable Problemscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Answering the Unanswerable Is to Err Knowingly: Analyzing and Mitigating Abstention Failures in Large Reasoning Models
- 2026Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models
- 2026Abstain-R1: Calibrated Abstention and Post-Refusal Clarification via Verifiable RL
- 2025Stop Before You Fail: Operational Capability Boundaries for Mitigating Unproductive Reasoning in Large Reasoning Models
- 2026AERA: Adaptive Evidence Residual Allocation for Efficient Test-Time Reasoning
- 2026Early Stopping for Large Reasoning Models via Confidence Dynamics
- 2025Concise Reasoning via Reinforcement Learning
- 2026Ask, Condition or Abstain: Reinforcement Learning for Missing-Premise Reasoning