Don't Lose Entities from Retrieval to Generation: Dual Entity Recovery RAG for multi-hop QA
On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG
Abstract (arXiv)
Retrieval-augmented multi-hop question answering (QA) decomposes a query into sub-questions and decomposes the corpus into smaller retrieval units such as sentences. Both forms of decomposition improve the pipeline, but we show that both share the same vulnerability, the loss of entity information, and that this loss breaks the pipeline at two separate points. The first point is retrieval, where a sub-question loses the entity resolved at the previous hop, leaving the retriever with nothing to match against. The second point is harder to see, because retrieval still appears to succeed. Once a passage is split into sentences, an isolated sentence loses the context that grounds its pronouns, so even with the correct sentence in hand the LLM cannot tell which entity the sentence is about. We isolate this second point as a distinct failure mode that we call lost-in-generation, and a retrieval-controlled experiment shows that it degrades answers even when the gold evidence is fixed in the context. We then propose Dual Entity Recovery RAG (DER-RAG), which keeps the grounding entity explicit from retrieval through to generation with two lightweight components, a two-way query decomposition that carries the resolved entity across sub-questions and a subject entity prefix attached to each sentence at generation time. DER-RAG needs no graph construction, no corpus modification, and no fine-tuning, yet on three multi-hop QA benchmarks it matches or exceeds strong baselines, including graph-based methods that depend on costly offline structures.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 14 of its 21 references that are in the map. First posted on arXiv 5 Sep 2026.
Builds on
14 of 21 references.
Closest ancestors · 3
Same direction, newest first
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval31 Jan
- 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy24 May
Other references · 11
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2020Unsupervised Question Decomposition for Question Answeringcited by 118
- 2024LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMscited by 108
- 2021Decontextualization: Making Sentences Stand-Alonecited by 102
- 2024Lighter And Better: Towards Flexible Context Adaptation For Retrieval Augmented Generationcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Question Decomposition for Retrieval-Augmented Generation
- 2025Mitigating Lost-in-Retrieval Problems in Retrieval Augmented Multi-Hop Question Answering
- 2026CompactRAG: Reducing LLM Calls and Token Overhead in Multi-Hop Question Answering
- 2024Hierarchical Retrieval-Augmented Generation Model with Rethink for Multi-hop Question Answering
- 2025Investigating Retrieval-Augmented Generation Systems on Unanswerable, Uncheatable, Realistic, Multi-hop Queries
- 2026Reasoning in Trees: Improving Retrieval-Augmented Generation for Multi-Hop Question Answering
- 2026EnSI-RAG: Entity-Structure-Indexed Retrieval-Augmented Generation for Long-Document Question Answering
- 2026MDER-DR: Multi-Hop Question Answering with Entity-Centric Summaries