Joint Passage Ranking for Diverse Multi-Answer Retrieval
Not on the map. Why?
Abstract (arXiv)
We study multi-answer retrieval, an under-explored problem that requires retrieving passages to cover multiple distinct answers for a given question. This task requires joint modeling of retrieved passages, as models should not repeatedly retrieve passages containing the same answer at the cost of missing a different valid answer. In this paper, we introduce JPR, the first joint passage retrieval model for multi-answer retrieval. JPR makes use of an autoregressive reranker that selects a sequence of passages, each conditioned on previously selected passages. JPR is trained to select passages that cover new answers at each timestep and uses a tree-decoding algorithm to enable flexibility in the degree of diversity. Compared to prior approaches, JPR achieves significantly better answer coverage on three multi-answer datasets. When combined with downstream question answering, the improved retrieval enables larger answer generation models since they need to consider fewer passages, establishing a new state-of-the-art.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Builds on 22 of its 38 references that are in the map. First posted on arXiv 17 Apr 2021.
Builds on
22 of 38 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
- 2015Pointer Networkscited by 882
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 691
- 2019Passage Re-ranking with BERTcited by 629
- 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
10 more
- 2020Document Ranking with a Pretrained Sequence-to-Sequence Modelcited by 373
- 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 213
- 2018Mesh-TensorFlow: Deep Learning for Supercomputerscited by 168
- 2020Answering Complex Open-Domain Questions with Multi-Hop Dense Retrievalcited by 160
- 2019Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answeringcited by 147
- 2019Compositional Questions Do Not Necessitate Multi-hop Reasoningcited by 87
- 2021Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrievalcited by 63
- 2019Understanding Dataset Design Choices for Multi-hop Reasoningcited by 50
- 2020Answering Ambiguous Questions through Generative Evidence Fusion and Round-Trip Predictioncited by 19
- 2020Managing Diversity in Airbnb Searchcited by 11
Built on by
Citing papers per year: 2021: 2; 2022: 8; 2023: 7; 2024: 12; 2025: 8; 2026: 6.
43 papers.
Sort:
By area:
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
- 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 231
- 2022Diverse Demonstrations Improve In-context Compositional Generalizationcited by 136
- 2024Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?cited by 53
- 2023Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Modelscited by 42
- 2022LidarCLIP or: How I Learned to Talk to Point Cloudscited by 33
- 2023QUEST: A Retrieval Dataset of Entity-Seeking Queries with Implicit Set Operationscited by 30
- 2021Retrieval-guided Counterfactual Generation for QAcited by 28
- 2025NodeRAG: Structuring Graph-based RAG with Heterogeneous Nodescited by 25
- 2022You can't pick your neighbors, or can you? When and how to rely on retrieval in the kNN-LMcited by 18
- 2022MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspectivecited by 17
- 2023Generative Knowledge Selection for Knowledge-Grounded Dialoguescited by 15
31 more
- 2024Adaptive Question Answering: Enhancing Language Model Proficiency for Addressing Knowledge Conflicts with Source Citationscited by 15
- 2024Merging Facts, Crafting Fallacies: Evaluating the Contradictory Nature of Aggregated Factual Claims in Long-Form Generationscited by 14
- 2023Answering Ambiguous Questions via Iterative Promptingcited by 13
- 2021Answering Open-Domain Multi-Answer Questions via a Recall-then-Verify Frameworkcited by 11
- 2024Open-World Evaluation for Retrieving Diverse Perspectivescited by 11
- 2024Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answeringcited by 10
- 2025Direct Retrieval-augmented Optimization: Synergizing Knowledge Selection and Language Modelscited by 9
- 2024SetBERT: Enhancing Retrieval Performance for Boolean Logic and Set Operation Queriescited by 5
- 2025Beyond Single Embeddings: Capturing Diverse Targets with Multi-Query Retrievalcited by 5
- 2023Answering Ambiguous Questions with a Database of Questions, Answers, and Revisionscited by 4
- 2024Enhancing Long Context Performance in LLMs Through Inner Loop Query Mechanismcited by 4
- 2026DTCRS: Dynamic Tree Construction for Recursive Summarizationcited by 4
- 2022Grounded Keys-to-Text Generation: Towards Factual Open-Ended Generationcited by 3
- 2025CORG: Generating Answers from Complex, Interrelated Contextscited by 3
- 2022Diverse Multi-Answer Retrieval with Determinantal Point Processescited by 2
- 2023Model Analysis & Evaluation for Ambiguous Question Answeringcited by 2
- 2024Corpus-informed Retrieval Augmented Generation of Clarifying Questionscited by 2
- 2025Agentic Verification for Ambiguous Query Disambiguationcited by 2
- 2022Answer Consolidation: Formulation and Benchmarkingcited by 1
- 2025Inter-Passage Verification for Multi-evidence Multi-answer QAcited by 1
- 2026RVR: Retrieve-Verify-Retrieve for Comprehensive Question Answeringcited by 1
- 2023Dialogue-Contextualized Re-ranking for Medical History-Takingcited by 0
- 2024GEM-RAG: Graphical Eigen Memories For Retrieval Augmented Generationcited by 0
- 2024PECAN: LLM-Guided Dynamic Progress Control with Attention-Guided Hierarchical Weighted Graph for Long-Document QAcited by 0
- 2024Retrieving Contextual Information for Long-Form Question Answering using Weak Supervisioncited by 0
- 2025GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Frameworkcited by 0
- 2025Evaluation of retrieval-based QA on QUEST-LOFTcited by 0
- 2026Clarify, Abstain or Answer? Strategising in Conversation with Belief-Augmented Generationcited by 0
- 2026Search for Coverage: Learning Coverage-Aware Retrieval with Augmented Sub-Question Answerabilitycited by 0
- 2026A knowledge-guided agentic framework for mitigating patient-context ambiguity in health queriescited by 0
- 2026Beyond One-Shot Expansion: Contrastive Evidence Exploration for Multi-Hop Retrievalcited by 0
- 2026Beyond One-Shot Expansion: Contrastive Evidence Exploration for Multi-Hop Retrieval7 Sep 2026
- 2026A knowledge-guided agentic framework for mitigating patient-context ambiguity in health queries20 Aug 2026
- 2026Search for Coverage: Learning Coverage-Aware Retrieval with Augmented Sub-Question Answerability27 May 2026
- 2026Clarify, Abstain or Answer? Strategising in Conversation with Belief-Augmented Generation25 May 2026
- 2026DTCRS: Dynamic Tree Construction for Recursive Summarization8 Apr 2026
- 2026RVR: Retrieve-Verify-Retrieve for Comprehensive Question Answering20 Feb 2026
- 2025Evaluation of retrieval-based QA on QUEST-LOFT8 Nov 2025
- 2025Beyond Single Embeddings: Capturing Diverse Targets with Multi-Query Retrieval4 Nov 2025
- 2025GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Framework30 Aug 2025
- 2025Inter-Passage Verification for Multi-evidence Multi-answer QA31 May 2025
- 2025Direct Retrieval-augmented Optimization: Synergizing Knowledge Selection and Language Models5 May 2025
- 2025CORG: Generating Answers from Complex, Interrelated Contexts25 Apr 2025
31 more
- 2025NodeRAG: Structuring Graph-based RAG with Heterogeneous Nodes15 Apr 2025
- 2025Agentic Verification for Ambiguous Query Disambiguation14 Feb 2025
- 2024Enhancing Long Context Performance in LLMs Through Inner Loop Query Mechanism11 Oct 2024
- 2024Retrieving Contextual Information for Long-Form Question Answering using Weak Supervision11 Oct 2024
- 2024PECAN: LLM-Guided Dynamic Progress Control with Attention-Guided Hierarchical Weighted Graph for Long-Document QA7 Oct 2024
- 2024Adaptive Question Answering: Enhancing Language Model Proficiency for Addressing Knowledge Conflicts with Source Citations5 Oct 2024
- 2024Corpus-informed Retrieval Augmented Generation of Clarifying Questions27 Sep 2024
- 2024Open-World Evaluation for Retrieving Diverse Perspectives26 Sep 2024
- 2024GEM-RAG: Graphical Eigen Memories For Retrieval Augmented Generation23 Sep 2024
- 2024Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answering4 Sep 2024
- 2024SetBERT: Enhancing Retrieval Performance for Boolean Logic and Set Operation Queries25 Jun 2024
- 2024Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?19 Jun 2024
- 2024Merging Facts, Crafting Fallacies: Evaluating the Contradictory Nature of Aggregated Factual Claims in Long-Form Generations8 Feb 2024
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval31 Jan 2024
- 2023Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Models23 Oct 2023
- 2023Answering Ambiguous Questions with a Database of Questions, Answers, and Revisions16 Aug 2023
- 2023Answering Ambiguous Questions via Iterative Prompting8 Jul 2023
- 2023Model Analysis & Evaluation for Ambiguous Question Answering21 May 2023
- 2023QUEST: A Retrieval Dataset of Entity-Seeking Queries with Implicit Set Operations19 May 2023
- 2023Generative Knowledge Selection for Knowledge-Grounded Dialogues10 Apr 2023
- 2023Dialogue-Contextualized Re-ranking for Medical History-Taking4 Apr 2023
- 2022LidarCLIP or: How I Learned to Talk to Point Clouds13 Dec 2022
- 2022Diverse Demonstrations Improve In-context Compositional Generalization13 Dec 2022
- 2022Grounded Keys-to-Text Generation: Towards Factual Open-Ended Generation4 Dec 2022
- 2022Diverse Multi-Answer Retrieval with Determinantal Point Processes29 Nov 2022
- 2022You can't pick your neighbors, or can you? When and how to rely on retrieval in the kNN-LM28 Oct 2022
- 2022Answer Consolidation: Formulation and Benchmarking29 Apr 2022
- 2022ASQA: Factoid Questions Meet Long-Form Answers12 Apr 2022
- 2022MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspective9 Apr 2022
- 2021Answering Open-Domain Multi-Answer Questions via a Recall-then-Verify Framework16 Oct 2021
- 2021Retrieval-guided Counterfactual Generation for QA14 Oct 2021
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
- 2023Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Modelscited by 42
- 2025NodeRAG: Structuring Graph-based RAG with Heterogeneous Nodescited by 25
- 2024Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answeringcited by 10
- 2025Direct Retrieval-augmented Optimization: Synergizing Knowledge Selection and Language Modelscited by 9
- 2024Enhancing Long Context Performance in LLMs Through Inner Loop Query Mechanismcited by 4
- 2026DTCRS: Dynamic Tree Construction for Recursive Summarizationcited by 4
- 2024Corpus-informed Retrieval Augmented Generation of Clarifying Questionscited by 2
- 2025Agentic Verification for Ambiguous Query Disambiguationcited by 2
- 2025Inter-Passage Verification for Multi-evidence Multi-answer QAcited by 1
- 2024GEM-RAG: Graphical Eigen Memories For Retrieval Augmented Generationcited by 0
- 2024PECAN: LLM-Guided Dynamic Progress Control with Attention-Guided Hierarchical Weighted Graph for Long-Document QAcited by 0
12 most cited of 16 All 16 (JSON)
- 2026Beyond One-Shot Expansion: Contrastive Evidence Exploration for Multi-Hop Retrieval7 Sep 2026
- 2026Search for Coverage: Learning Coverage-Aware Retrieval with Augmented Sub-Question Answerability27 May 2026
- 2026DTCRS: Dynamic Tree Construction for Recursive Summarization8 Apr 2026
- 2025Evaluation of retrieval-based QA on QUEST-LOFT8 Nov 2025
- 2025GOSU: Retrieval-Augmented Generation with Global-Level Optimized Semantic Unit-Centric Framework30 Aug 2025
- 2025Inter-Passage Verification for Multi-evidence Multi-answer QA31 May 2025
- 2025Direct Retrieval-augmented Optimization: Synergizing Knowledge Selection and Language Models5 May 2025
- 2025NodeRAG: Structuring Graph-based RAG with Heterogeneous Nodes15 Apr 2025
- 2025Agentic Verification for Ambiguous Query Disambiguation14 Feb 2025
- 2024Enhancing Long Context Performance in LLMs Through Inner Loop Query Mechanism11 Oct 2024
- 2024PECAN: LLM-Guided Dynamic Progress Control with Attention-Guided Hierarchical Weighted Graph for Long-Document QA7 Oct 2024
- 2024Corpus-informed Retrieval Augmented Generation of Clarifying Questions27 Sep 2024
12 newest of 16 All 16 (JSON)
- 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 231
- 2022Diverse Demonstrations Improve In-context Compositional Generalizationcited by 136
- 2024Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?cited by 53
- 2022LidarCLIP or: How I Learned to Talk to Point Cloudscited by 33
- 2023QUEST: A Retrieval Dataset of Entity-Seeking Queries with Implicit Set Operationscited by 30
- 2021Retrieval-guided Counterfactual Generation for QAcited by 28
- 2022You can't pick your neighbors, or can you? When and how to rely on retrieval in the kNN-LMcited by 18
- 2022MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspectivecited by 17
- 2023Generative Knowledge Selection for Knowledge-Grounded Dialoguescited by 15
- 2024Adaptive Question Answering: Enhancing Language Model Proficiency for Addressing Knowledge Conflicts with Source Citationscited by 15
- 2024Merging Facts, Crafting Fallacies: Evaluating the Contradictory Nature of Aggregated Factual Claims in Long-Form Generationscited by 14
- 2023Answering Ambiguous Questions via Iterative Promptingcited by 13
12 most cited of 26 All 26 (JSON)
- 2026Clarify, Abstain or Answer? Strategising in Conversation with Belief-Augmented Generation25 May 2026
- 2026RVR: Retrieve-Verify-Retrieve for Comprehensive Question Answering20 Feb 2026
- 2025Beyond Single Embeddings: Capturing Diverse Targets with Multi-Query Retrieval4 Nov 2025
- 2025CORG: Generating Answers from Complex, Interrelated Contexts25 Apr 2025
- 2024Retrieving Contextual Information for Long-Form Question Answering using Weak Supervision11 Oct 2024
- 2024Adaptive Question Answering: Enhancing Language Model Proficiency for Addressing Knowledge Conflicts with Source Citations5 Oct 2024
- 2024Open-World Evaluation for Retrieving Diverse Perspectives26 Sep 2024
- 2024SetBERT: Enhancing Retrieval Performance for Boolean Logic and Set Operation Queries25 Jun 2024
- 2024Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?19 Jun 2024
- 2024Merging Facts, Crafting Fallacies: Evaluating the Contradictory Nature of Aggregated Factual Claims in Long-Form Generations8 Feb 2024
- 2023Answering Ambiguous Questions with a Database of Questions, Answers, and Revisions16 Aug 2023
- 2023Answering Ambiguous Questions via Iterative Prompting8 Jul 2023
12 newest of 26 All 26 (JSON)