Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) are rapidly reshaping machine translation (MT), particularly by introducing instruction-following, in-context learning, and preference-based alignment into what has traditionally been a supervised encoder-decoder paradigm. This survey provides a comprehensive and up-to-date overview of how LLMs are being leveraged for MT across data regimes, languages, and application settings. We systematically analyze prompting-based methods, parameter-efficient and full fine-tuning strategies, synthetic data generation, preference-based optimization, and reinforcement learning with human and weakly supervised feedback. Special attention is given to low-resource translation, where we examine the roles of synthetic data quality, diversity, and preference signals, as well as the limitations of current RLHF pipelines. We further review recent advances in Mixture-of-Experts models, MT-focused LLMs, and multilingual alignment, highlighting trade-offs between scalability, specialization, and accessibility. Beyond sentence-level translation, we survey emerging document-level and discourse-aware MT methods with LLMs, showing that most approaches extend sentence-level pipelines through structured context selection, post-editing, or reranking rather than requiring fundamentally new data regimes or architectures. Finally, we discuss LLM-based evaluation, its strengths and biases, and its role alongside learned metrics. Overall, this survey positions LLM-based MT as an evolution of traditional MT systems, where gains increasingly depend on data quality, preference alignment, and context utilization rather than scale alone, and outlines open challenges for building robust, inclusive, and controllable translation systems.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 103 of its 170 references that are in the map. First posted on arXiv 2 Apr 2025.
Builds on
103 of 170 references.
References · 103
- 2017Attention Is All You Needcited by 59,932
- 2023GPT-4 Technical Reportcited by 18,132
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2023Mistral 7Bcited by 3,065
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
38 more
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
- 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 416
- 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 390
- 2023GPTScore: Evaluate as You Desirecited by 357
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 344
- 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 292
- 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 260
- 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 249
- 2023Prompting Large Language Model for Machine Translation: A Case Studycited by 247
- 2023Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessmentcited by 227
- 2020Nearest Neighbor Machine Translationcited by 209
- 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
- 2022In-context Examples Selection for Machine Translationcited by 172
- 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 172
- 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 156
- 2022Prompting PaLM for Translation: Assessing Strategies and Performancecited by 144
- 2023GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4cited by 143
- 2022mGPT: Few-Shot Learners Go Multilingualcited by 141
- 2017Data Augmentation for Low-Resource Neural Machine Translationcited by 139
- 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
- 2023Hallucinations in Large Multilingual Translation Modelscited by 126
- 2023The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluationcited by 95
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2023The unreasonable effectiveness of few-shot learning for machine translationcited by 91
- 2023Document-Level Machine Translation with Large Language Modelscited by 90
- 2023A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Modelscited by 88
- 2023Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Modelscited by 87
- 2023Large language models effectively leverage document-level context for literary translation, but critical errors persistcited by 80
- 2022Detecting and Mitigating Hallucinations in Machine Translation: Model Internal Workings Alone Do Well, Sentence Similarity Even Bettercited by 75
- 2018Universal Neural Machine Translation for Extremely Low Resource Languagescited by 66
50 most cited of 103 All 103 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2025Enhancing Large Language Model Reasoning with Reward Models: An Analytical Surveycited by 7
- 2025Injecting Knowledge Graphs into Large Language Modelscited by 5
- 2026Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigationcited by 4
- 2026One Model to Translate Them All? A Journey to Mount Doom for Multilingual Model Mergingcited by 2
- 2025LaTeXTrans: Structured LaTeX Translation with Multi-Agent Coordinationcited by 1
- 2025Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Modelscited by 0
- 2026Beyond Scalar Scores: Reinforcement Learning for Error-Aware Quality Estimation of Machine Translationcited by 0
- 2026All In Good Time: Causality-Aware Framework for LLM-Based Simultaneous Speech-to-Speech Translationcited by 0
- 2026All In Good Time: Causality-Aware Framework for LLM-Based Simultaneous Speech-to-Speech Translation24 Sep 2026
- 2026Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigation27 Apr 2026
- 2026One Model to Translate Them All? A Journey to Mount Doom for Multilingual Model Merging3 Apr 2026
- 2026Beyond Scalar Scores: Reinforcement Learning for Error-Aware Quality Estimation of Machine Translation9 Feb 2026
- 2025Enhancing Large Language Model Reasoning with Reward Models: An Analytical Survey2 Oct 2025
- 2025LaTeXTrans: Structured LaTeX Translation with Multi-Agent Coordination26 Aug 2025
- 2025Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Models9 Jun 2025
- 2025Injecting Knowledge Graphs into Large Language Models12 May 2025
Similar, not cited
Close in wording, no citation either way
- 2026Enhancing Document-Level Machine Translation via Filtered Synthetic Corpora and Two-Stage LLM Adaptation
- 2024A critical review of methods and challenges in large language models
- 2022Bootstrapping Multilingual Semantic Parsers using Large Language Models
- 2025Aligning Large Language Models to Low-Resource Languages through LLM-Based Selective Translation: A Systematic Study
- 2023A Comprehensive Overview of Large Language Models
- 2024Responsible Multilingual Large Language Models: A Survey of Development, Applications, and Societal Impact
- 2024Multilingual Large Language Models: A Systematic Survey
- 2023Aligning Large Language Models with Human: A Survey