mlsanityData to 7 Oct 2026

Towards Robust Ranker for Text Retrieval

arXiv 2206.08063 ↗First posted 16 Jun 2022cs.IR cs.CLcited by 37

Not on the map. Why?

Abstract (arXiv)

A ranker plays an indispensable role in the de facto 'retrieval & rerank' pipeline, but its training still lags behind -- learning from moderate negatives or/and serving as an auxiliary module for a retriever. In this work, we first identify two major barriers to a robust ranker, i.e., inherent label noises caused by a well-trained retriever and non-ideal negatives sampled for a high-capable ranker. Thereby, we propose multiple retrievers as negative generators improve the ranker's robustness, where i) involving extensive out-of-distribution label noises renders the ranker against each noise distribution, and ii) diverse hard negatives from a joint distribution are relatively close to the ranker's negative distribution, leading to more challenging thus effective training. To evaluate our robust ranker (dubbed R2anker), we conduct experiments in various settings on the popular passage retrieval benchmark, including BM25-reranking, full-ranking, retriever distillation, etc. The empirical results verify the new state-of-the-art effectiveness of our model.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Builds on 43 of its 64 references that are in the map. First posted on arXiv 16 Jun 2022.

Builds on

43 of 64 references.

References · 43

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  6. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  7. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
  8. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
  9. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
  10. 2017A Closer Look at Memorization in Deep Networkscited by 936
  11. 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
  12. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
31 more
  1. 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 691
  2. 2019Passage Re-ranking with BERTcited by 629
  3. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
  4. 2019Unsupervised Label Noise Modeling and Loss Correctioncited by 327
  5. 2019ERNIE: Enhanced Representation through Knowledge Integrationcited by 301
  6. 2020Combating noisy labels by agreement: A joint training method with co-regularizationcited by 289
  7. 2020Overview of the TREC 2019 deep learning trackcited by 282
  8. 2017Decoupling "when to update" from "how to update"cited by 230
  9. 2019Document Expansion by Query Predictioncited by 225
  10. 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 213
  11. 2020Does label smoothing mitigate label noise?cited by 204
  12. 2021Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrievalcited by 203
  13. 2019Multi-Stage Document Ranking with BERTcited by 200
  14. 2021RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingcited by 175
  15. 2021Condenser: a Pre-training Architecture for Dense Retrievalcited by 162
  16. 2021Optimizing Dense Retrieval Model Training with Hard Negativescited by 154
  17. 2020Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillationcited by 143
  18. 2021SPLADE v2: Sparse Lexical and Expansion Model for Information Retrievalcited by 126
  19. 2021COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted Listcited by 113
  20. 2019Deeper Text Understanding for IR with Contextual Neural Language Modelingcited by 111
  21. 2019Multi-class Classification without Multi-class Labelscited by 100
  22. 2021Adversarial Retriever-Ranker for dense text retrievalcited by 82
  23. 2021Salient Phrase Aware Dense Retrieval: Can a Dense Retriever Imitate a Sparse One?cited by 59
  24. 2021Open-set Label Noise Can Improve Robustness Against Inherent Label Noisecited by 58
  25. 2021Semantic Models for the First-stage Retrieval: A Comprehensive Reviewcited by 57
  26. 2021Domain-matched Pre-training Tasks for Dense Retrievalcited by 53
  27. 2021PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrievalcited by 50
  28. 2019Understanding the Behaviors of BERT in Rankingcited by 49
  29. 2022ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrievalcited by 41
  30. 2020EnsembleGAN: Adversarial Learning for Retrieval-Generation Ensemble Model on Short-Text Conversationcited by 6
  31. 2018Stochastic Answer Networks for Natural Language Inferencecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 2; 2024: 18; 2025: 13; 2026: 1.

37 papers.

Sort:

By area:

  1. 2024Visual In-Context Learning for Large Vision-Language Modelscited by 124
  2. 2024LLMs are Also Effective Embedding Models: An In-depth Overviewcited by 32
  3. 2022Fine-Grained Distillation for Long Document Retrievalcited by 29
  4. 2023Large Language Models are Strong Zero-Shot Retrievercited by 25
  5. 2024MemoryMamba: Memory-Augmented State Space Model for Defect Recognitioncited by 24
  6. 2024Task-Agnostic Detector for Insertion-Based Backdoor Attackscited by 23
  7. 2023GAR-meets-RAG Paradigm for Zero-Shot Information Retrievalcited by 18
  8. 2025Literature-Grounded Novelty Assessment of Scientific Ideascited by 17
  9. 2022LED: Lexicon-Enlightened Dense Retriever for Large-Scale Retrievalcited by 15
  10. 2024Robust Neural Information Retrieval: An Adversarial and Out-of-distribution Perspectivecited by 15
  11. 2024KADEL: Knowledge-Aware Denoising Learning for Commit Message Generationcited by 10
  12. 2025DocReRank: Single-Page Hard Negative Query Generation for Training Multi-Modal RAG Rerankerscited by 9
25 more
  1. 2024Exploiting Diffusion Prior for Out-of-Distribution Detectioncited by 7
  2. 2022Adam: Dense Retrieval Distillation with Adaptive Dark Examplescited by 4
  3. 2025Contextualizing Search Queries In-Context Learning for Conversational Rewriting with LLMscited by 4
  4. 2024Optimizing Psychological Counseling with Instruction-Tuned Large Language Modelscited by 2
  5. 2024Improving Visual Storytelling with Multimodal Large Language Modelscited by 2
  6. 2024Large Vision-Language Models for Remote Sensing Visual Question Answeringcited by 2
  7. 2024Multi-Facet Blending for Faceted Query-by-Example Retrievalcited by 2
  8. 2025Incomplete In-context Learningcited by 2
  9. 2024End-To-End Training and Testing Gamification Framework to Learn Human Highway Drivingcited by 1
  10. 2025MPCAR: Multi-Perspective Contextual Augmentation for Enhanced Visual Reasoning in Large Vision-Language Modelscited by 1
  11. 2024Analyzing Multi-Head Attention on Trojan BERT Modelscited by 0
  12. 2024LLMs for Enhanced Agricultural Meteorological Recommendationscited by 0
  13. 2024Consultation on Industrial Machine Faults with Large language Modelscited by 0
  14. 2024Leveraging Large Language Models for Comparative Literature Summarization with Reflective Incremental Mechanismscited by 0
  15. 2024Reasoning-Aware Query-Focused Summarization over Multi-Table Datacited by 0
  16. 2024Leveraging Retrieval-Augmented Tags for Large Vision-Language Understanding in Complex Scenescited by 0
  17. 2025Vision-Driven Prompt Optimization for Large Language Models in Multimodal Generative Taskscited by 0
  18. 2025Cross-Domain Semantic Segmentation with Large Language Model-Assisted Descriptor Generationcited by 0
  19. 2025A Generative Framework for Bidirectional Image-Report Understanding in Chest Radiographycited by 0
  20. 2025Multi-granular Training Strategies for Robust Multi-hop Reasoning Over Noisy and Heterogeneous Knowledge Sourcescited by 0
  21. 2025Enhancing Contrastive Demonstration Selection with Semantic Diversity for Robust In-Context Machine Translationcited by 0
  22. 2025Harnessing Generative LLMs for Enhanced Financial Event Entity Extraction Performancecited by 0
  23. 2025VisuCraft: Enhancing Large Vision-Language Models for Complex Visual-Guided Creative Content Generation via Structured Information Extractioncited by 0
  24. 2025VL-MedGuide: A Visual-Linguistic Large Model for Intelligent and Explainable Skin Disease Auxiliary Diagnosiscited by 0
  25. 2026QUARK: Robust Retrieval under Non-Faithful Queries via Query-Anchored Aggregationcited by 0