Neural Approaches to Multilingual Information Retrieval
Not on the map. Why?
Abstract (arXiv)
Providing access to information across languages has been a goal of Information Retrieval (IR) for decades. While progress has been made on Cross Language IR (CLIR) where queries are expressed in one language and documents in another, the multilingual (MLIR) task to create a single ranked list of documents across many languages is considerably more challenging. This paper investigates whether advances in neural document translation and pretrained multilingual neural language models enable improvements in the state of the art over earlier MLIR techniques. The results show that although combining neural document translation with neural ranking yields the best Mean Average Precision (MAP), 98% of that MAP score can be achieved with an 84% reduction in indexing time by using a pretrained XLM-R multilingual language model to index documents in their native language, and that 2% difference in effectiveness is not statistically significant. Key to achieving these results for MLIR is to fine-tune XLM-R using mixed-language batches from neural translations of MS MARCO passages.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 21 of its 49 references that are in the map. First posted on arXiv 3 Sep 2022.
Builds on
21 of 49 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
- 2021Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Modelscited by 132
- 2021Mr. TyDi: A Multi-lingual Benchmark for Dense Retrievalcited by 118
- 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
- 2019Deeper Text Understanding for IR with Contextual Neural Language Modelingcited by 111
- 2022PLAID: An Efficient Engine for Late Interaction Retrievalcited by 95
- 2022Tevatron: An Efficient and Flexible Toolkit for Dense Retrievalcited by 47
- 2022Transfer Learning Approaches for Building Cross-Language Dense Retrieval Modelscited by 36
9 more
- 2021BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translationcited by 35
- 2018Marian: Cost-effective High-Quality Neural Machine Translation in C++cited by 22
- 2020The Sockeye 2 Neural Machine Translation Toolkit at AMTA 2020cited by 16
- 2017Sockeye: A Toolkit for Neural Machine Translationcited by 15
- 2022C3: Continued Pretraining with Contrastive Weak Supervision for Cross Language Ad-Hoc Retrievalcited by 14
- 2021Streamlining Evaluation with ir-measurescited by 10
- 2022HC4: A New Suite of Test Collections for Ad Hoc CLIRcited by 10
- 2019Cross-Lingual Relevance Transfer for Document Retrievalcited by 9
- 2022Patapasco: A Python Framework for Cross-Language Information Retrieval Experimentscited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 7; 2025: 5; 2026: 4.
18 papers.
Sort:
By area:
- 2024Jina-ColBERT-v2: A General-Purpose Multilingual Late Interaction Retrievercited by 25
- 2024Multilingual Retrieval Augmented Generation for Culturally-Sensitive Tasks: A Benchmark for Cross-lingual Robustnesscited by 13
- 2025MMMORRF: Multimodal Multilingual Modularized Reciprocal Rank Fusioncited by 8
- 2023IndicIRSuite: Multilingual Dataset and Neural Information Models for Indian Languagescited by 5
- 2024Language Fairness in Multilingual Information Retrievalcited by 5
- 2023Multi-EuP: The Multilingual European Parliament Dataset for Analysis of Bias in Information Retrievalcited by 4
- 2024PLAID SHIRTTT for Large-Scale Streaming Dense Retrievalcited by 3
- 2024Distillation for Multilingual Information Retrievalcited by 3
- 2025V-Agent: An Interactive Video Search System Using Vision-Language Modelscited by 3
- 2026DenseOn with the LateOn: Fully Open Dense and Late-Interaction Models for Multilingual, Long-Context, and Code Searchcited by 3
- 2025CLIRudit: Cross-Lingual Information Retrieval of Scientific Documentscited by 2
- 2025Language Bias in Information Retrieval: The Nature of the Beast and Mitigation Methodscited by 2
6 more
- 2026CLEAR: Cross-Lingual Enhancement in Alignment via Reverse-trainingcited by 2
- 2024HLTCOE at TREC 2023 NeuCLIR Trackcited by 1
- 2024Synergistic Approach for Simultaneous Optimization of Monolingual, Cross-lingual, and Multilingual Information Retrievalcited by 1
- 2025Efficient and Versatile Model for Multilingual Information Retrieval of Islamic Text: Development and Deployment in Real-World Scenarioscited by 1
- 2026Learning from AVA: Early Lessons from a Curated and Trustworthy Generative AI for Policy and Development Researchcited by 1
- 2026SHIFT: Semantic Harmonization via Index-side Feature Transformation for Multilingual Information Retrievalcited by 0
- 2026DenseOn with the LateOn: Fully Open Dense and Late-Interaction Models for Multilingual, Long-Context, and Code Search29 Jul 2026
- 2026SHIFT: Semantic Harmonization via Index-side Feature Transformation for Multilingual Information Retrieval17 Jun 2026
- 2026Learning from AVA: Early Lessons from a Curated and Trustworthy Generative AI for Policy and Development Research20 Apr 2026
- 2026CLEAR: Cross-Lingual Enhancement in Alignment via Reverse-training7 Apr 2026
- 2025V-Agent: An Interactive Video Search System Using Vision-Language Models4 Nov 2025
- 2025Efficient and Versatile Model for Multilingual Information Retrieval of Islamic Text: Development and Deployment in Real-World Scenarios18 Sep 2025
- 2025Language Bias in Information Retrieval: The Nature of the Beast and Mitigation Methods7 Sep 2025
- 2025CLIRudit: Cross-Lingual Information Retrieval of Scientific Documents22 Apr 2025
- 2025MMMORRF: Multimodal Multilingual Modularized Reciprocal Rank Fusion26 Mar 2025
- 2024Multilingual Retrieval Augmented Generation for Culturally-Sensitive Tasks: A Benchmark for Cross-lingual Robustness2 Oct 2024
- 2024Jina-ColBERT-v2: A General-Purpose Multilingual Late Interaction Retriever29 Aug 2024
- 2024Synergistic Approach for Simultaneous Optimization of Monolingual, Cross-lingual, and Multilingual Information Retrieval20 Aug 2024
6 more
- 2024Language Fairness in Multilingual Information Retrieval2 May 2024
- 2024Distillation for Multilingual Information Retrieval2 May 2024
- 2024PLAID SHIRTTT for Large-Scale Streaming Dense Retrieval2 May 2024
- 2024HLTCOE at TREC 2023 NeuCLIR Track11 Apr 2024
- 2023IndicIRSuite: Multilingual Dataset and Neural Information Models for Indian Languages15 Dec 2023
- 2023Multi-EuP: The Multilingual European Parliament Dataset for Analysis of Bias in Information Retrieval3 Nov 2023
- 2024Jina-ColBERT-v2: A General-Purpose Multilingual Late Interaction Retrievercited by 25
- 2023IndicIRSuite: Multilingual Dataset and Neural Information Models for Indian Languagescited by 5
- 2024Language Fairness in Multilingual Information Retrievalcited by 5
- 2023Multi-EuP: The Multilingual European Parliament Dataset for Analysis of Bias in Information Retrievalcited by 4
- 2024PLAID SHIRTTT for Large-Scale Streaming Dense Retrievalcited by 3
- 2024Distillation for Multilingual Information Retrievalcited by 3
- 2026DenseOn with the LateOn: Fully Open Dense and Late-Interaction Models for Multilingual, Long-Context, and Code Searchcited by 3
- 2025CLIRudit: Cross-Lingual Information Retrieval of Scientific Documentscited by 2
- 2025Language Bias in Information Retrieval: The Nature of the Beast and Mitigation Methodscited by 2
- 2026CLEAR: Cross-Lingual Enhancement in Alignment via Reverse-trainingcited by 2
- 2024HLTCOE at TREC 2023 NeuCLIR Trackcited by 1
- 2024Synergistic Approach for Simultaneous Optimization of Monolingual, Cross-lingual, and Multilingual Information Retrievalcited by 1
12 most cited of 15 All 15 (JSON)
- 2026DenseOn with the LateOn: Fully Open Dense and Late-Interaction Models for Multilingual, Long-Context, and Code Search29 Jul 2026
- 2026SHIFT: Semantic Harmonization via Index-side Feature Transformation for Multilingual Information Retrieval17 Jun 2026
- 2026Learning from AVA: Early Lessons from a Curated and Trustworthy Generative AI for Policy and Development Research20 Apr 2026
- 2026CLEAR: Cross-Lingual Enhancement in Alignment via Reverse-training7 Apr 2026
- 2025Efficient and Versatile Model for Multilingual Information Retrieval of Islamic Text: Development and Deployment in Real-World Scenarios18 Sep 2025
- 2025Language Bias in Information Retrieval: The Nature of the Beast and Mitigation Methods7 Sep 2025
- 2025CLIRudit: Cross-Lingual Information Retrieval of Scientific Documents22 Apr 2025
- 2024Jina-ColBERT-v2: A General-Purpose Multilingual Late Interaction Retriever29 Aug 2024
- 2024Synergistic Approach for Simultaneous Optimization of Monolingual, Cross-lingual, and Multilingual Information Retrieval20 Aug 2024
- 2024Language Fairness in Multilingual Information Retrieval2 May 2024
- 2024Distillation for Multilingual Information Retrieval2 May 2024
- 2024PLAID SHIRTTT for Large-Scale Streaming Dense Retrieval2 May 2024
12 newest of 15 All 15 (JSON)