mlsanityData to 14 Oct 2026

Improving Scientific Document Retrieval with Concept Coverage-based Query Set Generation

arXiv 2502.11181 ↗First posted 16 Feb 2025cs.IR cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

In specialized fields like the scientific domain, constructing large-scale human-annotated datasets poses a significant challenge due to the need for domain expertise. Recent methods have employed large language models to generate synthetic queries, which serve as proxies for actual user queries. However, they lack control over the content generated, often resulting in incomplete coverage of academic concepts in documents. We introduce Concept Coverage-based Query set Generation (CCQGen) framework, designed to generate a set of queries with comprehensive coverage of the document's concepts. A key distinction of CCQGen is that it adaptively adjusts the generation process based on the previously generated queries. We identify concepts not sufficiently covered by previous queries, and leverage them as conditions for subsequent query generation. This approach guides each new query to complement the previous ones, aiding in a thorough understanding of the document. Extensive experiments demonstrate that CCQGen significantly enhances query quality and retrieval performance.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 44 of its 56 references that are in the map. First posted on arXiv 16 Feb 2025.

Builds on

44 of 56 references.

References · 44

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  4. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
  5. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  6. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  7. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
  8. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  9. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
  10. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 413
  11. 2022Promptagator: Few-shot Dense Retrieval From 8 Examplescited by 235
  12. 2019Document Expansion by Query Predictioncited by 231
32 more
  1. 2021Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrievalcited by 203
  2. 2022Improving Passage Retrieval with Zero-Shot Question Generationcited by 165
  3. 2021Optimizing Dense Retrieval Model Training with Hard Negativescited by 155
  4. 2019Synthetic QA Corpora Generation with Roundtrip Consistencycited by 143
  5. 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 129
  6. 2021GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrievalcited by 119
  7. 2022From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effectivecited by 98
  8. 2023Controlled Text Generation with Natural Language Instructionscited by 87
  9. 2022Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddingscited by 75
  10. 2023InPars-v2: Large Language Models as Efficient Dataset Generators for Information Retrievalcited by 73
  11. 2017Automated Phrase Mining from Massive Text Corporacited by 70
  12. 2023SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrievalcited by 62
  13. 2021Improving Query Representations for Dense Retrieval with Pseudo Relevance Feedbackcited by 47
  14. 2020BERT-QE: Contextualized Query Expansion for Document Re-rankingcited by 40
  15. 2018A Web-scale system for scientific knowledge explorationcited by 39
  16. 2023UDAPDR: Unsupervised Domain Adaptation via LLM Prompting and Distillation of Rerankerscited by 37
  17. 2021Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similaritycited by 35
  18. 2022TaxoCom: Topic Taxonomy Completion with Hierarchical Discovery of Novel Topic Clusterscited by 30
  19. 2020DE-RRD: A Knowledge Distillation Framework for Recommender Systemcited by 28
  20. 2020Embedding-based Zero-shot Retrieval through Query Generationcited by 24
  21. 2021OAG-BERT: Towards A Unified Backbone Language Model For Academic Knowledge Servicescited by 20
  22. 2021CSFCube -- A Test Collection of Computer Science Research Articles for Faceted Query by Examplecited by 20
  23. 2023Generative Relevance Feedback with Large Language Modelscited by 20
  24. 2023Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understandingcited by 16
  25. 2024Taxonomy-guided Semantic Indexing for Academic Paper Searchcited by 12
  26. 2024Improving Retrieval in Theme-specific Applications using a Corpus Topical Taxonomycited by 11
  27. 2023MvFS: Multi-view Feature Selection for Recommender Systemcited by 10
  28. 2023It's All Relative! -- A Synthetic Query Generation Approach for Improving Zero-Shot Relevance Predictioncited by 10
  29. 2023Exploring the Viability of Synthetic Query Generation for Relevance Predictioncited by 9
  30. 2024Synthetic Query Generation using Large Language Models for Virtual Assistantscited by 9
  31. 2023Improving Content Retrievability in Search with Controllable Query Generationcited by 6
  32. 2023MIReAD: Simple Method for Learning High-quality Representations from Scientific Documentscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 2.

7 papers.

  1. 2025Iterative Self-Incentivization Empowers Large Language Models as Agentic Searcherscited by 11
  2. 2025Scientific Paper Retrieval with LLM-Guided Semantic-Based Rankingcited by 10
  3. 2025CoRank: LLM-Based Compact Reranking with Document Features for Scientific Retrievalcited by 5
  4. 2025Topic Coverage-based Demonstration Retrieval for In-Context Learningcited by 3
  5. 2025Dual Knowledge-Enhanced Two-Stage Reasoner for Multimodal Dialog Systemscited by 0
  6. 2026Improving Scientific Document Retrieval with Academic Concept Indexcited by 0
  7. 2026CoverSynth: Coverage-Guided Generation of Retrieval Evaluation Setscited by 0