mlsanityData to 7 Oct 2026

Bridging the Detection-to-Abstention Gap in Reasoning Models under Insufficient Information

arXiv 2605.28070 ↗First posted 27 May 2026cs.AIcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

We highlight a failure mode of large reasoning models on questions with insufficient information: models may recognize that a problem is under-specified, yet still continue reasoning and produce unsupported final answers instead of abstaining. We formalize this mismatch as the detection-to-abstention gap, where detected insufficiency fails to translate into final abstention. This gap is especially concerning in high-risk domains such as medical AI, where answers based on incomplete evidence can be more harmful than refusal. To close this gap, we propose Judge-Then-Solve (JTS), a trajectory-level reasoning-control framework that trains models to make an explicit answerability commitment before solution generation. Rather than treating abstention as a final-answer style, JTS casts it as a control decision: the model either proceeds to solve or terminates early based on its answerability judgment. We instantiate this policy through supervised warm-up and missing-premise reinforcement learning with consistency and length-shaping rewards. Experiments on dense and MoE reasoning models show that JTS substantially improves reliable abstention across datasets and pushes Abstention@Detection (A@D) to near-saturation, indicating that models not only detect missing information but also act on that detection. By terminating unanswerable trajectories immediately after the answerability judgment, JTS reduces unnecessary reasoning and improves inference efficiency when continued deliberation would amplify unsupported assumptions. We also observe that missing-premise training can alter reasoning behavior on difficult but answerable problems, reducing unproductive self-reflection. These results suggest that abstention under insufficient information is a key form of reasoning control for deploying reasoning models safely and efficiently.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 36 of its 51 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

36 of 51 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Revisiting Overthinking in Long Chain-of-Thought from the Perspective of Self-Doubt29 May
  2. 2025Missing Premise exacerbates Overthinking: Are Reasoning Models losing Critical Thinking Skill?9 Apr
  3. 2025s1: Simple test-time scaling31 Jan
  4. 2022Language Models (Mostly) Know What They Know11 Jul
  5. 2022STaR: Bootstrapping Reasoning With Reasoning28 Mar

Other references · 31

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  7. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  8. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
  9. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
  10. 2022Teaching Models to Express Their Uncertainty in Wordscited by 731
  11. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
  12. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
19 more
  1. 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Modelscited by 277
  2. 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 145
  3. 2025AbstentionBench: Reasoning LLMs Fail on Unanswerable Questionscited by 129
  4. 2025Beyond Binary Rewards: Training LMs to Reason About Their Uncertaintycited by 107
  5. 2025Self-Rewarding Vision-Language Model via Reasoning Decompositioncited by 95
  6. 2025A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applicationscited by 91
  7. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 91
  8. 2023Self-Evaluation Improves Selective Generation in Large Language Modelscited by 74
  9. 2019Don't Take the Premise for Granted: Mitigating Artifacts in Natural Language Inferencecited by 48
  10. 2025The Hallucination Tax of Reinforcement Finetuningcited by 35
  11. 2025Step-KTO: Optimizing Mathematical Reasoning through Stepwise Binary Feedbackcited by 22
  12. 2024HonestLLM: Toward an Honest and Helpful Large Language Modelcited by 17
  13. 2026Knowing When to Abstain: Medical LLMs Under Clinical Uncertaintycited by 13
  14. 2025Uncertainty-Aware Large Language Models for Explainable Disease Diagnosiscited by 9
  15. 2026Map2Thought: Explicit 3D Spatial Reasoning via Metric Cognitive Mapscited by 8
  16. 2025KnowGuard: Knowledge-Driven Abstention for Multi-Round Clinical Reasoningcited by 5
  17. 2026When Silence Is Golden: Can LLMs Learn to Abstain in Temporal QA and Beyond?cited by 5
  18. 2026Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalabilitycited by 4
  19. 2025Learning the Boundary of Solvability: Aligning LLMs to Detect Unsolvable Problemscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Answering the Unanswerable Is to Err Knowingly: Analyzing and Mitigating Abstention Failures in Large Reasoning Models
  2. 2026Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models
  3. 2026Abstain-R1: Calibrated Abstention and Post-Refusal Clarification via Verifiable RL
  4. 2025Stop Before You Fail: Operational Capability Boundaries for Mitigating Unproductive Reasoning in Large Reasoning Models
  5. 2026AERA: Adaptive Evidence Residual Allocation for Efficient Test-Time Reasoning
  6. 2026Early Stopping for Large Reasoning Models via Confidence Dynamics
  7. 2025Concise Reasoning via Reinforcement Learning
  8. 2026Ask, Condition or Abstain: Reinforcement Learning for Missing-Premise Reasoning