mlsanityData to 7 Oct 2026

Multiview Identifiers Enhanced Generative Retrieval

arXiv 2305.16675 ↗First posted 26 May 2023cs.CL cs.AI cs.IRcited by 16

Not on the map. Why?

Abstract (arXiv)

Instead of simply matching a query to pre-existing passages, generative retrieval generates identifier strings of passages as the retrieval target. At a cost, the identifier must be distinctive enough to represent a passage. Current approaches use either a numeric ID or a text piece (such as a title or substrings) as the identifier. However, these identifiers cannot cover a passage's content well. As such, we are motivated to propose a new type of identifier, synthetic identifiers, that are generated based on the content of a passage and could integrate contextualized information that text pieces lack. Furthermore, we simultaneously consider multiview identifiers, including synthetic identifiers, titles, and substrings. These views of identifiers complement each other and facilitate the holistic ranking of passages from multiple perspectives. We conduct a series of experiments on three public datasets, and the results indicate that our proposed approach performs the best in generative retrieval, demonstrating its effectiveness and robustness.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 24 of its 32 references that are in the map. First posted on arXiv 26 May 2023.

Builds on

24 of 32 references.

References · 24

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  7. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  8. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  9. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  10. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 691
  11. 2019Passage Re-ranking with BERTcited by 629
  12. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
12 more
  1. 2020Autoregressive Entity Retrievalcited by 333
  2. 2022Transformer Memory as a Differentiable Search Indexcited by 242
  3. 2022Promptagator: Few-shot Dense Retrieval From 8 Examplescited by 233
  4. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 198
  5. 2020Generation-Augmented Retrieval for Open-domain Question Answeringcited by 186
  6. 2020Pre-training Tasks for Embedding-based Large-scale Retrievalcited by 153
  7. 2022Autoregressive Search Engines: Generating Substrings as Document Identifierscited by 112
  8. 2022A Neural Corpus Indexer for Document Retrievalcited by 107
  9. 2022SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrievalcited by 90
  10. 2021Learning Passage Impacts for Inverted Indexescited by 68
  11. 2022Multi-View Document Representation Learning for Open-Domain Dense Retrievalcited by 41
  12. 2022Generative Multi-hop Retrievalcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 5; 2025: 5; 2026: 5.

16 papers.

Sort:

By area: