mlsanityData to 7 Oct 2026

EVAR: Evidence-Validated Hypothesis Admission for Budget-Aware Narrative Reasoning

arXiv 2608.29835 ↗First posted 30 Aug 2026cs.CLcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models (LLMs) often produce fluent but weakly grounded conclusions when reasoning over non-interactive, long-form narratives. A central failure mode is that unsupported intermediate hypotheses can enter the reasoning trajectory and contaminate subsequent inference, especially when evidence is scattered across distant parts of the story. To address this problem, we propose EVAR, an evidence-validated hypothesis admission framework for budget-aware narrative reasoning. EVAR first compiles the narrative into an immutable evidence store of source-linked atomic claims and assigns an instance-specific inference budget from unresolved gaps and uncertainty signals. During refinement, EVAR directly proposes candidate hypotheses for unresolved gaps, constructs hypothesis-conditioned validation challenges, and verifies each candidate against the locked store before admission: supported hypotheses enter the answer-supporting state, unverifiable ones are quarantined, and contradictory ones are discarded. A sufficiency-based stopping mechanism further avoids unnecessary refinement. Experiments on NarraCrime and multiple public reasoning benchmarks show that EVAR improves both task performance and evidence faithfulness while maintaining controllable inference cost.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 18 of its 19 references that are in the map. First posted on arXiv 30 Aug 2026.

Builds on

18 of 19 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Self-Awareness before Action: Mitigating Logical Inertia via Proactive Cognitive Awareness22 Apr
  2. 2022True Detective: A Deep Abductive Reasoning Benchmark Undoable for GPT-3 and Challenging for GPT-420 Dec

Other references · 16

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  5. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  6. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  7. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
  8. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  9. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  10. 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
  11. 2017The NarrativeQA Reading Comprehension Challengecited by 590
  12. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 221
4 more
  1. 2023Avalon's Game of Thoughts: Battle Against Deception through Recursive Contemplationcited by 102
  2. 2023GPT-4 Doesn't Know It's Wrong: An Analysis of Iterative Prompting for Reasoning Problemscited by 88
  3. 2023Deciphering Digital Detectives: Understanding LLM Behaviors and Capabilities in Multi-Agent Mystery Gamescited by 29
  4. 2025Beyond Survival: Evaluating LLMs in Social Deduction Games with Human-Aligned Strategiescited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ClueWeaver: Reward-Guided Dual-Agent Evidence Reasoning for Compact LLMs on Literary Long Narratives
  2. 2026Narrative Knowledge Weaver: Narrative-Centric Retrieval-Augmented Reasoning for Long-Form Text Understanding
  3. 2024DetectiveQA: Evaluating Long-Context Reasoning on Detective Novels
  4. 2025ComoRAG: A Cognitive-Inspired Memory-Organized RAG for Stateful Long Narrative Reasoning
  5. 2026Narrative World Model: Narratology-Grounded Writer Memory for Long-Form Fiction
  6. 2023MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning
  7. 2025NovelHopQA: Diagnosing Multi-Hop Reasoning Failures in Long Narrative Contexts
  8. 2025PRELUDE: A Benchmark Designed to Require Global Comprehension and Reasoning over Long Contexts