Improving Low-Resource Machine Translation via Round-Trip Reinforcement Learning
On the map: Deep reinforcement learning methods → RL training of language and agent models
Abstract (arXiv)
Low-resource machine translation (MT) has gained increasing attention as parallel data from low-resource language communities is collected, but many approaches for improving low-resource MT remain underexplored. We investigate a self-supervised reinforcement learning fine-tuning for translation in low-resource settings using round-trip bootstrapping with the No Language Left Behind (NLLB) family of models. Our approach translates English into a target low-resource language and then back into English, using a combination of chrF++ and BLEU as the reward function on the reconstructed English sentences. Using the NLLB-MD dataset, we evaluate both the 600M and 1.3B parameter NLLB models and observe consistent improvements for the following languages: Central Aymara, Friulian, Wolof, Dyula, Bhojpuri and Russian. Qualitative inspection of translation outputs indicates increased fluency and semantic fidelity. We argue that our method can further benefit from scale, enabling models to increasingly leverage their pretrained knowledge and continue self-improving. Code available at: https://github.com/Copticoder/MT-via-Round-Trip-RL
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 25 of its 42 references that are in the map. First posted on arXiv 18 Jan 2026.
Builds on
25 of 42 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 803
13 more
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
- 2017A Deep Reinforced Model for Abstractive Summarizationcited by 365
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
- 2017Six Challenges for Neural Machine Translationcited by 335
- 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 273
- 2020On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translationcited by 127
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2018A Study of Reinforcement Learning for Neural Machine Translationcited by 74
- 2020Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learningcited by 66
- 2019The FLoRes Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-Englishcited by 62
- 2025MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learningcited by 48
- 2024Goldfish: Monolingual Language Models for 350 Languagescited by 29
- 2018Eliminating Exposure Bias and Loss-Evaluation Mismatch in Multiple Object Trackingcited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Reference-Free Reinforcement Learning Fine-Tuning for MT: A Seq2Seq Perspectivecited by 0
- 2026Reinforcement Learning Elicits Contextual Learning of Unseen Language Translationcited by 0
- 2026Back-Translation Still Matters: Leveraging Monolingual Data for Low-Resource Machine Translation with LLMscited by 0
- 2026Back-Translation Still Matters: Leveraging Monolingual Data for Low-Resource Machine Translation with LLMs13 Oct 2026
- 2026Reinforcement Learning Elicits Contextual Learning of Unseen Language Translation4 Jun 2026
- 2026Reference-Free Reinforcement Learning Fine-Tuning for MT: A Seq2Seq Perspective15 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Improving Low-Resource Translation with Dictionary-Guided Fine-Tuning and RL: A Spanish-to-Wayuunaiki Study
- 2024Towards Neural No-Resource Language Translation: A Comparative Evaluation of Approaches
- 2025Is Small Language Model the Silver Bullet to Low-Resource Languages Machine Translation?
- 2024From LLM to NMT: Advancing Low-Resource Machine Translation with Claude
- 2026Mending the Holes: Mitigating Reward Hacking in Reinforcement Learning for Multilingual Translation
- 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation
- 2026North Small Translate: Advanced Cost-Effective Translation (Cohere CAT+)
- 2026PEGRL: Improving Machine Translation by Post-Editing Guided Reinforcement Learning