Inter-Passage Verification for Multi-evidence Multi-answer QA
On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval
Abstract (arXiv)
Multi-answer question answering (QA), where questions can have many valid answers, presents a significant challenge for existing retrieval-augmented generation-based QA systems, as these systems struggle to retrieve and then synthesize a large number of evidence passages. To tackle these challenges, we propose a new multi-answer QA framework -- Retrieval-augmented Independent Reading with Inter-passage Verification (RI2VER). Our framework retrieves a large set of passages and processes each passage individually to generate an initial high-recall but noisy answer set. Then we propose a new inter-passage verification pipeline that validates every candidate answer through (1) Verification Question Generation, (2) Gathering Additional Evidence, and (3) Verification with inter-passage synthesis. Evaluations on the QAMPARI and RoMQA datasets demonstrate that our framework significantly outperforms existing baselines across various model sizes, achieving an average F1 score improvement of 11.17%. Further analysis validates that our inter-passage verification pipeline enables our framework to be particularly beneficial for questions requiring multi-evidence synthesis.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 48 of its 64 references that are in the map. First posted on arXiv 31 May 2025.
Builds on
48 of 64 references.
Closest ancestors · 3
Same direction, newest first
- 2024Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answering4 Sep
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents16 Apr
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection17 Oct
Other references · 45
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 841
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
33 more
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 737
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2023Enabling Large Language Models to Generate Text with Citationscited by 595
- 2020Fact or Fiction: Verifying Scientific Claimscited by 554
- 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 472
- 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 458
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
- 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 390
- 2024Measuring short-form factuality in large language modelscited by 373
- 2023Making Retrieval-Augmented Language Models Robust to Irrelevant Contextcited by 369
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
- 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 234
- 2023Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?cited by 168
- 2024Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QAcited by 122
- 2024VERISCORE: Evaluating the factuality of verifiable claims in long-form text generationcited by 117
- 2024Jasper and Stella: distillation of SOTA embedding modelscited by 112
- 2018The Fact Extraction and VERification (FEVER) Shared Taskcited by 108
- 2023Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompting Methodcited by 97
- 2023LLatrieval: LLM-Verified Retrieval for Verifiable Generationcited by 52
- 2023Effective Large Language Model Adaptation for Improved Grounding and Citation Generationcited by 45
- 2021Joint Passage Ranking for Diverse Multi-Answer Retrievalcited by 43
- 2022QAMPARI: An Open-domain Question Answering Benchmark for Questions with Many Answers from Multiple Paragraphscited by 42
- 2023Language Models Hallucinate, but May Excel at Fact Verificationcited by 37
- 2024DMQR-RAG: Diverse Multi-Query Rewriting for RAGcited by 27
- 2024AmbigDocs: Reasoning across Documents on Different Entities under the Same Namecited by 21
- 2020Answering Ambiguous Questions through Generative Evidence Fusion and Round-Trip Predictioncited by 19
- 2022RoMQA: A Benchmark for Robust, Multi-evidence, Multi-answer Question Answeringcited by 19
- 2024Narrowing the Knowledge Evaluation Gap: Open-Domain Question Answering with Multi-Granularity Answerscited by 18
- 2023Answering Ambiguous Questions via Iterative Promptingcited by 13
- 2021Answering Open-Domain Multi-Answer Questions via a Recall-then-Verify Frameworkcited by 11
- 2021Design Challenges for a Multi-Perspective Search Enginecited by 7
- 2023Answering Ambiguous Questions with a Database of Questions, Answers, and Revisionscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026SURE-RAG: Sufficiency and Uncertainty-Aware Evidence Verification for Selective Retrieval-Augmented Generation
- 2026S2G-RAG: Structured Sufficiency and Gap Judging for Iterative Retrieval-Augmented QA
- 2026PAVE: Premise-Aware Validation and Editing for Retrieval-Augmented LLMs
- 2026QUBO-Optimized Evidence Selection for Retrieval-Augmented Question Answering with Unconventional Solvers
- 2025Beyond Independent Passages: Adaptive Passage Combination Retrieval for Retrieval Augmented Open-Domain Question Answering
- 2026MARA: A Multimodal Adaptive Retrieval-Augmented Framework for Document Question Answering
- 2025Uncertainty Quantification in Retrieval Augmented Question Answering
- 2026Dual-Confidence Contrastive Decoding for Retrieval-Augmented Generation