mlsanityData to 7 Oct 2026

Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation

arXiv 2504.01919 ↗First posted 2 Apr 2025cs.CL cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are rapidly reshaping machine translation (MT), particularly by introducing instruction-following, in-context learning, and preference-based alignment into what has traditionally been a supervised encoder-decoder paradigm. This survey provides a comprehensive and up-to-date overview of how LLMs are being leveraged for MT across data regimes, languages, and application settings. We systematically analyze prompting-based methods, parameter-efficient and full fine-tuning strategies, synthetic data generation, preference-based optimization, and reinforcement learning with human and weakly supervised feedback. Special attention is given to low-resource translation, where we examine the roles of synthetic data quality, diversity, and preference signals, as well as the limitations of current RLHF pipelines. We further review recent advances in Mixture-of-Experts models, MT-focused LLMs, and multilingual alignment, highlighting trade-offs between scalability, specialization, and accessibility. Beyond sentence-level translation, we survey emerging document-level and discourse-aware MT methods with LLMs, showing that most approaches extend sentence-level pipelines through structured context selection, post-editing, or reranking rather than requiring fundamentally new data regimes or architectures. Finally, we discuss LLM-based evaluation, its strengths and biases, and its role alongside learned metrics. Overall, this survey positions LLM-based MT as an evolution of traditional MT systems, where gains increasingly depend on data quality, preference alignment, and context utilization rather than scale alone, and outlines open challenges for building robust, inclusive, and controllable translation systems.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 103 of its 170 references that are in the map. First posted on arXiv 2 Apr 2025.

Builds on

103 of 170 references.

References · 103

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  7. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  8. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  9. 2023Mistral 7Bcited by 3,065
  10. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  11. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  12. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
38 more
  1. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  2. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  3. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
  4. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
  5. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  6. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  7. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  8. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  9. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
  10. 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 416
  11. 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 390
  12. 2023GPTScore: Evaluate as You Desirecited by 357
  13. 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 344
  14. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 292
  15. 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 260
  16. 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 249
  17. 2023Prompting Large Language Model for Machine Translation: A Case Studycited by 247
  18. 2023Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessmentcited by 227
  19. 2020Nearest Neighbor Machine Translationcited by 209
  20. 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
  21. 2022In-context Examples Selection for Machine Translationcited by 172
  22. 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 172
  23. 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 156
  24. 2022Prompting PaLM for Translation: Assessing Strategies and Performancecited by 144
  25. 2023GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4cited by 143
  26. 2022mGPT: Few-Shot Learners Go Multilingualcited by 141
  27. 2017Data Augmentation for Low-Resource Neural Machine Translationcited by 139
  28. 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
  29. 2023Hallucinations in Large Multilingual Translation Modelscited by 126
  30. 2023The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluationcited by 95
  31. 2021Survey of Low-Resource Machine Translationcited by 92
  32. 2023The unreasonable effectiveness of few-shot learning for machine translationcited by 91
  33. 2023Document-Level Machine Translation with Large Language Modelscited by 90
  34. 2023A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Modelscited by 88
  35. 2023Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Modelscited by 87
  36. 2023Large language models effectively leverage document-level context for literary translation, but critical errors persistcited by 80
  37. 2022Detecting and Mitigating Hallucinations in Machine Translation: Model Internal Workings Alone Do Well, Sentence Similarity Even Bettercited by 75
  38. 2018Universal Neural Machine Translation for Extremely Low Resource Languagescited by 66

50 most cited of 103 All 103 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 4.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Enhancing Document-Level Machine Translation via Filtered Synthetic Corpora and Two-Stage LLM Adaptation
  2. 2024A critical review of methods and challenges in large language models
  3. 2022Bootstrapping Multilingual Semantic Parsers using Large Language Models
  4. 2025Aligning Large Language Models to Low-Resource Languages through LLM-Based Selective Translation: A Systematic Study
  5. 2023A Comprehensive Overview of Large Language Models
  6. 2024Responsible Multilingual Large Language Models: A Survey of Development, Applications, and Societal Impact
  7. 2024Multilingual Large Language Models: A Systematic Survey
  8. 2023Aligning Large Language Models with Human: A Survey