mlsanityData to 7 Oct 2026

Separating Semantic Competition from Context Length in RAG Reading

arXiv 2605.27294 ↗First posted 26 May 2026cs.CL cs.IRcited by 0

On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval

Abstract (arXiv)

Retrieval-augmented generation (RAG) systems can respond incorrectly even when the correct passage was retrieved. The model must still read the retrieved passages and identify which one contains the answer among others that look relevant. This passage-reading model is called the reader. Does it fail simply because the context is longer or because the other passages genuinely compete with the correct one? We introduce and demonstrate a matched-control protocol for RAG reading: we keep the number and length of passages fixed, but replace hard competitors with less competitive real passages. We apply this control across two compact open models on SQuAD. This replacement partially restores performance, with the strongest effects on F1 and answer inclusion. For Phi-2, this recovers +6.0 EM points, +7.0 answer-inclusion points, and +0.057 F1. For Qwen2.5-1.5B, it recovers +4.5 EM points, +9.0 answer-inclusion points, and +0.068 F1. To track how performance changes as competitors accumulate, we also report retention curves and summarize them with a right-censored half-life when the curves do not cross half-retention. Together, these results show the protocol isolates a competition effect distinct from context length, though the effect is clearer for F1 and answer inclusion than for exact match, and also varies with snippet length.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 6 of its 6 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

6 of 6 references.

References · 6

  1. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  3. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,270
  4. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  5. 2024Seven Failure Points When Engineering a Retrieval Augmented Generation Systemcited by 138
  6. 2025NoLiMa: Long-Context Evaluation Beyond Literal Matchingcited by 120

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Optimizing Retrieval-Augmented Generation: Analysis of Hyperparameter Impact on Performance and Efficiency
  2. 2024Toward Optimal Search and Retrieval for RAG
  3. 2024In Defense of RAG in the Era of Long-Context Language Models
  4. 2024RAGGED: Towards Informed Design of Scalable and Stable RAG Systems
  5. 2026On the impact of retrieved content representations in RAG Pipelines
  6. 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning
  7. 2025Enhancing Retrieval-Augmented Generation: A Study of Best Practices
  8. 2025The Distracting Effect: Understanding Irrelevant Passages in RAG