mlsanityData to 7 Oct 2026

Passage Re-ranking with BERT

arXiv 1901.04085 ↗First posted 13 Jan 2019cs.IR cs.CL cs.LGcited by 629

Not on the map. Why?

Cited by 136 in Retrieval-augmented generation, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Recently, neural models pretrained on a language modeling task, such as ELMo (Peters et al., 2017), OpenAI GPT (Radford et al., 2018), and BERT (Devlin et al., 2018), have achieved impressive results on various natural language processing tasks such as question-answering and natural language inference. In this paper, we describe a simple re-implementation of BERT for query-based passage re-ranking. Our system is the state of the art on the TREC-CAR dataset and the top entry in the leaderboard of the MS MARCO passage retrieval task, outperforming the previous state of the art by 27% (relative) in MRR@10. The code to reproduce our results is available at https://github.com/nyu-dl/dl4marco-bert

Key facts. Cited by 629 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jan 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 1; 2021: 77; 2022: 73; 2023: 70; 2024: 89; 2025: 122; 2026: 197.

629 papers.

Sort:

By area:

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  3. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
  4. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
  5. 2023Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agentscited by 356
  6. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  7. 2023Large Language Models are Effective Text Rankers with Pairwise Ranking Promptingcited by 302
  8. 2021Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Samplingcited by 238
  9. 2022Promptagator: Few-shot Dense Retrieval From 8 Examplescited by 233
  10. 2024Generative Representational Instruction Tuningcited by 227
  11. 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
  12. 2021RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingcited by 175
38 more
  1. 2021SPLADE v2: Sparse Lexical and Expansion Model for Information Retrievalcited by 126
  2. 2021GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrievalcited by 119
  3. 2021COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted Listcited by 113
  4. 2022Task-aware Retrieval with Instructionscited by 107
  5. 2022Re2G: Retrieve, Rerank, Generatecited by 102
  6. 2022PLAID: An Efficient Engine for Late Interaction Retrievalcited by 95
  7. 2021Adversarial Retriever-Ranker for dense text retrievalcited by 82
  8. 2023Learning to Filter Context for Retrieval-Augmented Generationcited by 82
  9. 2021The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Modelscited by 81
  10. 2023Zero-Shot Listwise Document Reranking with a Large Language Modelcited by 81
  11. 2021NaturalProofs: Mathematical Theorem Proving in Natural Languagecited by 80
  12. 2023RankVicuna: Zero-Shot Listwise Document Reranking with Open-Source Large Language Modelscited by 69
  13. 2024FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructionscited by 67
  14. 2021KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answeringcited by 66
  15. 2024TrojanRAG: Retrieval-Augmented Generation Can Be Backdoor Driver in Large Language Modelscited by 63
  16. 2022SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarizationcited by 61
  17. 2026SkillRouter: Skill Routing for LLM Agents at Scalecited by 57
  18. 2022Dialog Inpainting: Turning Documents into Dialogscited by 56
  19. 2024Scaling Retrieval-Based Language Models with a Trillion-Token Datastorecited by 54
  20. 2023LLatrieval: LLM-Verified Retrieval for Verifiable Generationcited by 52
  21. 2023Magnushammer: A Transformer-Based Approach to Premise Selectioncited by 50
  22. 2022Questions Are All You Need to Train a Dense Passage Retrievercited by 47
  23. 2022Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languagescited by 47
  24. 2023How Does Generative Retrieval Scale to Millions of Passages?cited by 47
  25. 2024TourRank: Utilizing Large Language Models for Documents Ranking with a Tournament-Inspired Strategycited by 47
  26. 2023Learning to Rank in Generative Retrievalcited by 46
  27. 2023Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Rankingcited by 44
  28. 2025Creating General User Models from Computer Usecited by 44
  29. 2021Joint Passage Ranking for Diverse Multi-Answer Retrievalcited by 43
  30. 2022Neural Approaches to Conversational Information Retrievalcited by 41
  31. 2022Multi-View Document Representation Learning for Open-Domain Dense Retrievalcited by 41
  32. 2022ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrievalcited by 41
  33. 2025s3: You Don't Need That Much Data to Train a Search Agent via RLcited by 41
  34. 2021BERTnesia: Investigating the capture and forgetting of knowledge in BERTcited by 40
  35. 2022Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Codingcited by 40
  36. 2022GERE: Generative Evidence Retrieval for Fact Verificationcited by 38
  37. 2022Curriculum Learning for Dense Retrieval Distillationcited by 38
  38. 2021R2-D2: A Modular Baseline for Open-Domain Question Answeringcited by 37

50 most cited of 629 All 629 (JSON)