When Absence Is Evidence: Evaluating Completeness-Sensitive Negative Reasoning in Large Language Models
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large language models (LLMs) are often asked whether something is absent from a record, list, or retrieved context. Yet non-observation licenses a negative answer only when evidence completely covers the query scope; otherwise, the answer should remain unknown. We call this completeness-sensitive negative reasoning. We introduce CROWN-QA, comprising CROWN-Synth, a controlled paired core that fixes the question and observed facts while varying only query-relative coverage, and CROWN-Real, a real-document contrast-set evaluation with controlled coverage variants. Across three LLM families, models show unstable closure judgments and substantial over-closure, failing to reliably distinguish a justified negative answer (Certified-Negative) from insufficient evidence (Unknown). The dominant CROWN-Synth failure is asymmetric: models often recognize implicitly complete evidence yet treat implicitly partial evidence as query-covering. Prompting redistributes errors between over- and under-closure rather than consistently resolving them. Structured certificate elicitation traces many errors to evidence-coverage mischaracterization. CROWN-Real shows that the core partial-coverage asymmetry persists on real-document content, while its strength and the balance between over- and under-closure vary by model, prompt, and source.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 3 of its 31 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
3 of 31 references.
Closest ancestors · 1
Same direction, newest first
Other references · 2
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2025AbsenceBench: Language Models Can't Tell What's Missingcited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Relevance Is Not Sufficient Evidence: Detecting Evidence Gaps Before Generation in RAG
- 2025Hypothetical Documents or Knowledge Leakage? Rethinking LLM-based Query Expansion
- 2026EviScope: Paired Counterfactual Evidence Diagnostics for Faithful and Efficient Grounded Language Models
- 2026Judging Is Not Enumerating: Silent Omissions in LLM-Authored Acceptable Sets
- 2026CUE-R: Beyond the Final Answer in Retrieval-Augmented Generation
- 2026Knowing When Not to Answer: Abstention-Aware Scientific Reasoning
- 2024BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack
- 2026Knowing, and Saying It Only When Asked: LLM Endognostics and the Schizognosis of Minerva-7B