mlsanityData to 7 Oct 2026

MIMO: Multilingual Information Retrieval via Monolingual Objectives

arXiv 2605.31171 ↗First posted 29 May 2026cs.IR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Multilingual Information Retrieval (MLIR) reflects real-world search environments in which queries and relevant documents may appear in different languages within a mixed-language corpus. However, existing embedding models are primarily optimized for Multi-Monolingual retrieval and their performance often degrades in MLIR settings. Moreover, directly applying conventional contrastive learning to MLIR can exacerbate language clustering and expose a trade-off between cross-lingual alignment and embedding uniformity. To address these limitations, we propose MIMO: Multilingual Information Retrieval via Monolingual Objectives, a two-stage framework that uses a stable English semantic space from a high-performing teacher model as an anchor. MIMO first initializes the student model's cross-lingual alignment through knowledge distillation, and then jointly optimizes distillation and cross-lingual contrastive learning to improve retrieval discrimination while preserving alignment. Extensive experiments show that MIMO consistently outperforms existing cross-lingual training baselines across various MLIR and Multi-Monolingual benchmarks. MIMO also remains competitive with off-the-shelf models of similar or larger parameter scales. Furthermore, our cross-lingual Alignment-Uniformity analysis clarifies the distinct roles of the two loss components and shows that their combination yields a favorable trade-off between alignment and uniformity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 39 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

22 of 39 references.

References · 22

  1. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  2. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  3. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  4. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
  5. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
  6. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  7. 2019On the Cross-lingual Transferability of Monolingual Representationscited by 575
  8. 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 339
  9. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
  10. 2020Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translationcited by 277
  11. 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
  12. 2021Scaling Deep Contrastive Learning Batch Size under Memory Limited Setupcited by 123
10 more
  1. 2021Mr. TyDi: A Multi-lingual Benchmark for Dense Retrievalcited by 118
  2. 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
  3. 2025Llama-Embed-Nemotron-8B: A Universal Text Embedding Model for Multilingual and Cross-Lingual Taskscited by 46
  4. 2020LAReQA: Language-agnostic answer retrieval from a multilingual poolcited by 41
  5. 2025Training Sparse Mixture Of Experts Text Embedding Modelscited by 32
  6. 2025Investigating Language Preference of Multilingual RAG Systemscited by 22
  7. 2024Overview of the TREC 2023 NeuCLIR Trackcited by 17
  8. 2023EmbedDistill: A Geometric Knowledge Distillation for Information Retrievalcited by 11
  9. 2023Overview of the TREC 2022 NeuCLIR Trackcited by 11
  10. 2025NeuCLIRBench: A Modern Evaluation Collection for Monolingual, Cross-Language, and Multilingual Information Retrievalcited by 6

Built on by

Not cited yet.