mlsanityData to 7 Oct 2026

Simple Applications of BERT for Ad Hoc Document Retrieval

arXiv 1903.10972 ↗First posted 26 Mar 2019cs.IR cs.CLcited by 34

Not on the map. Why?

Abstract (arXiv)

Following recent successes in applying BERT to question answering, we explore simple applications to ad hoc document retrieval. This required confronting the challenge posed by documents that are typically longer than the length of input BERT was designed to handle. We address this issue by applying inference on sentences individually, and then aggregating sentence scores to produce document scores. Experiments on TREC microblog and newswire test collections show that our approach is simple yet effective, as we report the highest average precision on these datasets by neural approaches that we are aware of.

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Mar 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 17; 2022: 7; 2023: 4; 2024: 5; 2025: 1.

34 papers.

Sort:

By area:

  1. 2023LLMs4OL: Large Language Models for Ontology Learningcited by 75
  2. 2022THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryptioncited by 55
  3. 2021Benchmarking Chinese Text Recognition: Datasets, Baselines, and an Empirical Studycited by 52
  4. 2022Bi-PointFlowNet: Bidirectional Learning for Point Cloud Based Scene Flow Estimationcited by 38
  5. 2022Order-Disorder: Imitation Adversarial Attacks for Black-box Neural Ranking Modelscited by 37
  6. 2022Transfer Learning Approaches for Building Cross-Language Dense Retrieval Modelscited by 36
  7. 2023A Review of Deep Learning for Video Captioningcited by 28
  8. 2021B-PROP: Bootstrapped Pre-training with Representative Words Prediction for Ad-hoc Retrievalcited by 25
  9. 2021On the Calibration and Uncertainty of Neural Learning to Rank Modelscited by 24
  10. 2024Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challengescited by 20
  11. 2021Assisting the Human Fact-Checkers: Detecting All Previously Fact-Checked Claims in a Documentcited by 19
  12. 2021Neural ranking models for document retrievalcited by 16
22 more
  1. 2021Article Reranking by Memory-Enhanced Key Sentence Matching for Detecting Previously Fact-Checked Claimscited by 16
  2. 2024Enhancing Q&A Text Retrieval with Ranking Models: Benchmarking, fine-tuning and deploying Rerankers for RAGcited by 16
  3. 2024MINERS: Multilingual Language Models as Semantic Retrieverscited by 11
  4. 2021Discovering Explanatory Sentences in Legal Case Decisions Using Pre-trained Language Modelscited by 9
  5. 2024Large Language Models for Relevance Judgment in Product Searchcited by 8
  6. 2021Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literaturecited by 6
  7. 2023Glitter or Gold? Deriving Structured Insights from Sustainability Reports via Large Language Modelscited by 6
  8. 2021Synthetic Document Generator for Annotation-free Layout Recognitioncited by 5
  9. 2022Diagnosing BERT with Retrieval Heuristicscited by 5
  10. 2021Cross-Lingual Training with Dense Retrieval for Document Retrievalcited by 4
  11. 2021Multistage BiCross encoder for multilingual access to COVID-19 health informationcited by 3
  12. 2021News Article Retrieval in Context for Event-centric Narrative Creationcited by 3
  13. 2022MetricBERT: Text Representation Learning via Self-Supervised Triplet Trainingcited by 3
  14. 2021A Neural Model for Joint Document and Snippet Ranking in Question Answering for Large Document Collectionscited by 2
  15. 2024Enhancing ID-based Recommendation with Large Language Modelscited by 2
  16. 2021An Analysis of a BERT Deep Learning Strategy on a Technology Assisted Review Taskcited by 1
  17. 2023Topics in Contextualised Attention Embeddingscited by 1
  18. 2021COVID-19: Comparative Analysis of Methods for Identifying Articles Related to Therapeutics and Vaccines without Using Labeled Datacited by 0
  19. 2021LRG at TREC 2020: Document Ranking with XLNet-Based Modelscited by 0
  20. 2021SAUCE: Truncated Sparse Document Signature Bit-Vectors for Fast Web-Scale Corpus Expansioncited by 0
  21. 2022MuCPAD: A Multi-Domain Chinese Predicate-Argument Datasetcited by 0
  22. 2025SecPE: Secure Prompt Ensembling for Private and Robust Large Language Modelscited by 0