MIMO: Multilingual Information Retrieval via Monolingual Objectives
Not on the map. Why?
Abstract (arXiv)
Multilingual Information Retrieval (MLIR) reflects real-world search environments in which queries and relevant documents may appear in different languages within a mixed-language corpus. However, existing embedding models are primarily optimized for Multi-Monolingual retrieval and their performance often degrades in MLIR settings. Moreover, directly applying conventional contrastive learning to MLIR can exacerbate language clustering and expose a trade-off between cross-lingual alignment and embedding uniformity. To address these limitations, we propose MIMO: Multilingual Information Retrieval via Monolingual Objectives, a two-stage framework that uses a stable English semantic space from a high-performing teacher model as an anchor. MIMO first initializes the student model's cross-lingual alignment through knowledge distillation, and then jointly optimizes distillation and cross-lingual contrastive learning to improve retrieval discrimination while preserving alignment. Extensive experiments show that MIMO consistently outperforms existing cross-lingual training baselines across various MLIR and Multi-Monolingual benchmarks. MIMO also remains competitive with off-the-shelf models of similar or larger parameter scales. Furthermore, our cross-lingual Alignment-Uniformity analysis clarifies the distinct roles of the two loss components and shows that their combination yields a favorable trade-off between alignment and uniformity.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 39 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
22 of 39 references.
References · 22
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
- 2019On the Cross-lingual Transferability of Monolingual Representationscited by 575
- 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 339
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
- 2020Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translationcited by 277
- 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
- 2021Scaling Deep Contrastive Learning Batch Size under Memory Limited Setupcited by 123
10 more
- 2021Mr. TyDi: A Multi-lingual Benchmark for Dense Retrievalcited by 118
- 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
- 2025Llama-Embed-Nemotron-8B: A Universal Text Embedding Model for Multilingual and Cross-Lingual Taskscited by 46
- 2020LAReQA: Language-agnostic answer retrieval from a multilingual poolcited by 41
- 2025Training Sparse Mixture Of Experts Text Embedding Modelscited by 32
- 2025Investigating Language Preference of Multilingual RAG Systemscited by 22
- 2024Overview of the TREC 2023 NeuCLIR Trackcited by 17
- 2023EmbedDistill: A Geometric Knowledge Distillation for Information Retrievalcited by 11
- 2023Overview of the TREC 2022 NeuCLIR Trackcited by 11
- 2025NeuCLIRBench: A Modern Evaluation Collection for Monolingual, Cross-Language, and Multilingual Information Retrievalcited by 6
Built on by
Not cited yet.