mlsanityData to 14 Oct 2026

When Does Mixing Help? Analyzing Query Embedding Interpolation in Multilingual Dense Retrieval

arXiv 2606.13537 ↗First posted 11 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

While mixed-language querying is ubiquitous in multilingual communities, the sensitivity of dense retrievers to such queries remains poorly understood. We present a ratio-controlled study on mMARCO that systematically evaluates retrieval performance by varying the mixing proportion of parallel query translations via embedding-level mixing -- constructing mixed queries as an interpolation of monolingual embeddings. Experiments with BGE-M3 demonstrate that an optimal mixing ratio outperforms the best monolingual endpoint in 88/105 cases. We uncover a distinct asymmetry driven by English dominance: mixing is uniformly beneficial when retrieving from non-English document indices, whereas indices containing English are best served by pure English queries. Furthermore, English acts as the strongest mixing partner for every non-English document language. Finally, when controlling for English dominance, mixing gains correlate negatively with typological distance. We conclude that language-mix sensitivity is structured and predictable, and we validate the robustness of these patterns across model families and scales.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

18 of 30 references.

References · 18

  1. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  2. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  3. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
  4. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  5. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  6. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  7. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  8. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
  9. 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 236
  10. 2023MADLAD-400: A Multilingual And Document-Level Large Audited Datasetcited by 181
  11. 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
  12. 2021Mr. TyDi: A Multi-lingual Benchmark for Dense Retrievalcited by 119
6 more
  1. 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
  2. 2020GLUECoS : An Evaluation Benchmark for Code-Switched NLPcited by 102
  3. 2020LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluationcited by 93
  4. 2019A Survey of Code-switched Speech and Language Processingcited by 75
  5. 2023Multilingual Large Language Models Are Not (Yet) Code-Switcherscited by 65
  6. 2023Boosting Zero-shot Cross-lingual Retrieval by Training on Artificially Code-Switched Datacited by 4

Built on by

Not cited yet.