mlsanityData to 7 Oct 2026

Analyzing and Improving Cross-lingual Knowledge Transfer for Machine Translation

arXiv 2601.04036 ↗First posted 7 Jan 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Multilingual machine translation systems aim to make knowledge accessible across languages, yet learning effective cross-lingual representations remains challenging. These challenges are especially pronounced for low-resource languages, where limited parallel data constrains generalization and transfer. Understanding how multilingual models share knowledge across languages requires examining the interaction between representations, data availability, and training strategies. In this thesis, we study cross-lingual knowledge transfer in neural models and develop methods to improve robustness and generalization in multilingual settings, using machine translation as a central testbed. We analyze how similarity between languages influences transfer, how retrieval and auxiliary supervision can strengthen low-resource translation, and how fine-tuning on parallel data can introduce unintended trade-offs in large language models. We further examine the role of language diversity during training and show that increasing translation coverage improves generalization and reduces off-target behavior. Together, this work highlights how modeling choices and data composition shape multilingual learning and offers insights toward more inclusive and resilient multilingual NLP systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 4 of its 5 references that are in the map. First posted on arXiv 7 Jan 2026.

Builds on

4 of 5 references.

References · 4

  1. 2024The Fine-Tuning Paradox: Boosting Translation Quality Without Sacrificing LLM Abilitiescited by 22
  2. 2023Viewing Knowledge Transfer in Multilingual Machine Translation Through a Representational Lenscited by 15
  3. 2023Multilingual k-Nearest-Neighbor Machine Translationcited by 3
  4. 2025The Effect of Language Diversity When Fine-Tuning Large Language Models for Translationcited by 1

Built on by

Not cited yet.