mlsanityData to 7 Oct 2026

Can Linguistically Related Languages Guide LLM Translation in Low-Resource Settings?

arXiv 2603.16660 ↗First posted 17 Mar 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have achieved strong performance across many downstream tasks, yet their effectiveness in extremely low-resource machine translation remains limited. Standard adaptation techniques typically rely on large-scale parallel data or extensive fine-tuning, which are infeasible for the long tail of underrepresented languages. In this work, we investigate a more constrained question: in data-scarce settings, to what extent can linguistically similar pivot languages and few-shot demonstrations provide useful guidance for on-the-fly adaptation in LLMs? We study a data-efficient experimental setup that combines linguistically related pivot languages with few-shot in-context examples, without any parameter updates, and evaluate translation behavior under controlled conditions. Our analysis shows that while pivot-based prompting can yield improvements in certain configurations, particularly in settings where the target language is less well represented in the model's vocabulary, the gains are often modest and sensitive to few shot example construction. For closely related or better represented varieties, we observe diminishing or inconsistent gains. Our findings provide empirical guidance on how and when inference-time prompting and pivot-based examples can be used as a lightweight alternative to fine-tuning in low-resource translation settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

17 of 36 references.

References · 17

  1. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  3. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  4. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  5. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
  6. 2019Massively Multilingual Neural Machine Translation in the Wild: Findings and Challengescited by 253
  7. 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 205
  8. 2024When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Methodcited by 201
  9. 2022In-context Examples Selection for Machine Translationcited by 172
  10. 2023IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languagescited by 149
  11. 2022Prompting PaLM for Translation: Assessing Strategies and Performancecited by 144
  12. 2023The unreasonable effectiveness of few-shot learning for machine translationcited by 91
5 more
  1. 2022BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Promptingcited by 90
  2. 2022Bloom Library: Multimodal Datasets in 300+ Languages for a Variety of Downstream Taskscited by 28
  3. 2024An Empirical Study of In-context Learning in LLMs for Machine Translationcited by 9
  4. 2025Pivot Language for Low-Resource Machine Translationcited by 3
  5. 2025How Well Do LLMs Understand Tunisian Arabic?cited by 2

Built on by

Not cited yet.