Context Convergence Improves Answering Inferential Questions
Not on the map. Why?
Abstract (arXiv)
While Large Language Models (LLMs) are widely used in open-domain Question Answering (QA), their ability to handle inferential questions-where answers must be derived rather than directly retrieved-remains still underexplored. This study investigates how the structure and quality of passages influence LLM performance on such questions. We focus on convergence, a measure of how effectively sentences (hints) eliminate incorrect answers, as a criterion for constructing passages. Using subsets of the TriviaHG dataset, we form passages by combining sentences with varying convergence levels and evaluate six LLMs of different sizes and architectures. Our results show that passages built from higher convergence sentences lead to substantially better answer accuracy than those selected by cosine similarity, indicating that convergence captures meaningful relevance for inferential reasoning. Additionally, ordering sentences by descending convergence slightly improves performance, suggesting that LLMs tend to prioritize earlier, information-rich cues. These findings highlight convergence as a practical signal for guiding passage construction and analyzing inferential reasoning behavior in LLMs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
20 of 34 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Qwen3 Technical Reportcited by 8,820
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2025ReasonIR: Training Retrievers for Reasoning Taskscited by 77
- 2025ReasonRank: Empowering Passage Ranking with Strong Reasoning Abilitycited by 42
- 2025DIVER: A Multi-Stage Approach for Reasoning-intensive Information Retrievalcited by 37
8 more
- 2025RaDeR: Reasoning-aware Dense Retrieval Modelscited by 27
- 2022Choose Your QA Model Wisely: A Systematic Study of Generative and Extractive Readers for Question Answeringcited by 11
- 2024TriviaHG: A Dataset for Automatic Hint Generation from Factoid Questionscited by 7
- 2024Exploring Hint Generation Approaches in Open-Domain Question Answeringcited by 7
- 2024Navigating the Landscape of Hint Generation Research: From the Past to the Futurecited by 6
- 2024BoolQuestions: Does Dense Retrieval Understand Boolean Logic in Language?cited by 6
- 2025Wrong Answers Can Also Be Useful: PlausibleQA -- A Large-Scale QA Dataset with Answer Plausibility Scorescited by 5
- 2024WikiHint: A Human-Annotated Dataset for Hint Ranking and Generationcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Inferential Question Answering
- 2025T2: An Adaptive Test-Time Scaling Strategy for Contextual Question Answering
- 2026Same Question, Different Answers: Evaluating LLM Reliability Beyond Accuracy
- 2025Answer-Centric or Reasoning-Driven? Uncovering the Latent Memory Anchor in LLMs
- 2025Read Before You Think: Mitigating LLM Comprehension Failures with Step-by-Step Reading
- 2026Exploring the Meta-level Reasoning of Large Language Models via a Tool-based Multi-hop Tabular Question Answering Task
- 2026Regime Boundary Alignment for Evidence-Gated Question Answering
- 2024ALR2: A Retrieve-then-Reason Framework for Long-context Question Answering