Simple Yet Effective Neural Ranking and Reranking Baselines for Cross-Lingual Information Retrieval
Not on the map. Why?
Abstract (arXiv)
The advent of multilingual language models has generated a resurgence of interest in cross-lingual information retrieval (CLIR), which is the task of searching documents in one language with queries from another. However, the rapid pace of progress has led to a confusing panoply of methods and reproducibility has lagged behind the state of the art. In this context, our work makes two important contributions: First, we provide a conceptual framework for organizing different approaches to cross-lingual retrieval using multi-stage architectures for mono-lingual retrieval as a scaffold. Second, we implement simple yet effective reproducible baselines in the Anserini and Pyserini IR toolkits for test collections from the TREC 2022 NeuCLIR Track, in Persian, Russian, and Chinese. Our efforts are built on a collaboration of the two teams that submitted the most effective runs to the TREC evaluation. These contributions provide a firm foundation for future advances.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 32 of its 53 references that are in the map. First posted on arXiv 3 Apr 2023.
Builds on
32 of 53 references.
References · 32
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
- 2019Passage Re-ranking with BERTcited by 629
- 2020Document Ranking with a Pretrained Sequence-to-Sequence Modelcited by 373
- 2020Overview of the TREC 2019 deep learning trackcited by 282
- 2019Document Expansion by Query Predictioncited by 225
20 more
- 2019Multi-Stage Document Ranking with BERTcited by 200
- 2021Overview of the TREC 2020 deep learning trackcited by 193
- 2020XOR QA: Cross-lingual Open-Retrieval Question Answeringcited by 121
- 2021Mr. TyDi: A Multi-lingual Benchmark for Dense Retrievalcited by 118
- 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
- 2022From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effectivecited by 98
- 2023InPars-v2: Large Language Models as Efficient Dataset Generators for Information Retrievalcited by 73
- 2021A Few Brief Notes on DeepImpact, COIL, and a Conceptual Framework for Information Retrieval Techniquescited by 69
- 2021Learning Passage Impacts for Inverted Indexescited by 68
- 2020Complementing Lexical Retrieval with Semantic Residual Embeddingcited by 27
- 2021Pseudo Relevance Feedback with Deep Language Models and Dense Retrievers: Successes and Pitfallscited by 26
- 2022Towards Best Practices for Training Multilingual Dense Retrieval Modelscited by 26
- 2019Critically Examining the "Neural Hype": Weak Baselines and the Additivity of Effectiveness Gains from Neural Ranking Modelscited by 24
- 2021A Proposed Conceptual Framework for a Representational Approach to Information Retrievalcited by 24
- 2021Fast Passage Re-ranking with Contextualized Exact Term Matching and Efficient Passage Expansioncited by 20
- 2021Wacky Weights in Learned Sparse Representations and the Revenge of Score-at-a-Time Query Evaluationcited by 15
- 2020A Study of Neural Matching Models for Cross-lingual IRcited by 12
- 2022To Interpolate or not to Interpolate: PRF, Dense and Sparse Retrieverscited by 12
- 2022Billions of Parameters Are Worth More Than In-domain Training Data: A case study in the Legal Case Entailment Taskcited by 8
- 2023An Experimental Study on Pretraining Transformers from Scratch for IRcited by 3
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 1.
4 papers.
- 2024JaColBERTv2.5: Optimising Multi-Vector Retrievers to Create State-of-the-Art Japanese Retrievers with Constrained Resourcescited by 15
- 2023Zero-Shot Cross-Lingual Reranking with Large Language Models for Low-Resource Languagescited by 8
- 2023IndicIRSuite: Multilingual Dataset and Neural Information Models for Indian Languagescited by 5
- 2025CLIRudit: Cross-Lingual Information Retrieval of Scientific Documentscited by 2
- 2025CLIRudit: Cross-Lingual Information Retrieval of Scientific Documents22 Apr 2025
- 2024JaColBERTv2.5: Optimising Multi-Vector Retrievers to Create State-of-the-Art Japanese Retrievers with Constrained Resources30 Jul 2024
- 2023Zero-Shot Cross-Lingual Reranking with Large Language Models for Low-Resource Languages26 Dec 2023
- 2023IndicIRSuite: Multilingual Dataset and Neural Information Models for Indian Languages15 Dec 2023