mlsanityData to 7 Oct 2026

When Absence Is Evidence: Evaluating Completeness-Sensitive Negative Reasoning in Large Language Models

arXiv 2608.04591 ↗First posted 5 Aug 2026cs.CL cs.AIcited by 1

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models (LLMs) are often asked whether something is absent from a record, list, or retrieved context. Yet non-observation licenses a negative answer only when evidence completely covers the query scope; otherwise, the answer should remain unknown. We call this completeness-sensitive negative reasoning. We introduce CROWN-QA, comprising CROWN-Synth, a controlled paired core that fixes the question and observed facts while varying only query-relative coverage, and CROWN-Real, a real-document contrast-set evaluation with controlled coverage variants. Across three LLM families, models show unstable closure judgments and substantial over-closure, failing to reliably distinguish a justified negative answer (Certified-Negative) from insufficient evidence (Unknown). The dominant CROWN-Synth failure is asymmetric: models often recognize implicitly complete evidence yet treat implicitly partial evidence as query-covering. Prompting redistributes errors between over- and under-closure rather than consistently resolving them. Structured certificate elicitation traces many errors to evidence-coverage mischaracterization. CROWN-Real shows that the core partial-coverage asymmetry persists on real-document content, while its strength and the balance between over- and under-closure vary by model, prompt, and source.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 3 of its 31 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

3 of 31 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025AbstentionBench: Reasoning LLMs Fail on Unanswerable Questions10 Jun

Other references · 2

  1. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  2. 2025AbsenceBench: Language Models Can't Tell What's Missingcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Relevance Is Not Sufficient Evidence: Detecting Evidence Gaps Before Generation in RAG
  2. 2025Hypothetical Documents or Knowledge Leakage? Rethinking LLM-based Query Expansion
  3. 2026EviScope: Paired Counterfactual Evidence Diagnostics for Faithful and Efficient Grounded Language Models
  4. 2026Judging Is Not Enumerating: Silent Omissions in LLM-Authored Acceptable Sets
  5. 2026CUE-R: Beyond the Final Answer in Retrieval-Augmented Generation
  6. 2026Knowing When Not to Answer: Abstention-Aware Scientific Reasoning
  7. 2024BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack
  8. 2026Knowing, and Saying It Only When Asked: LLM Endognostics and the Schizognosis of Minerva-7B