Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Task
Not on the map. Why?
Abstract (arXiv)
This paper presents the submission of Huawei Translate Services Center (HW-TSC) to the WMT24 general machine translation (MT) shared task, where we participate in the English to Chinese (en2zh) language pair. Similar to previous years' work, we use training strategies such as regularized dropout, bidirectional training, data diversification, forward translation, back translation, alternated training, curriculum learning, and transductive ensemble learning to train the neural machine translation (NMT) model based on the deep Transformer-big architecture. The difference is that we also use continue pre-training, supervised fine-tuning, and contrastive preference optimization to train the large language model (LLM) based MT model. By using Minimum Bayesian risk (MBR) decoding to select the final translation from multiple hypotheses for NMT and LLM-based MT models, our submission receives competitive results in the final evaluation.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 32 of its 56 references that are in the map. First posted on arXiv 23 Sep 2024.
Builds on
32 of 56 references.
References · 32
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2023LIMA: Less Is More for Alignmentcited by 1,100
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
20 more
- 2020Beyond English-Centric Multilingual Machine Translationcited by 561
- 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 394
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
- 2016FastText.zip: Compressing text classification modelscited by 335
- 2019Learning Deep Transformer Models for Machine Translationcited by 309
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 207
- 2021R-Drop: Regularized Dropout for Neural Networkscited by 202
- 2022Prompting PaLM for Translation: Assessing Strategies and Performancecited by 145
- 2020Is MAP Decoding All You Need? The Inadequacy of the Mode in Neural Machine Translationcited by 138
- 2023The unreasonable effectiveness of few-shot learning for machine translationcited by 91
- 2019Tagged Back-Translationcited by 77
- 2023BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languagescited by 60
- 2019Curriculum Learning for Domain Adaptation in Neural Machine Translationcited by 59
- 2023Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOMcited by 59
- 2023Eliciting the Translation Ability of Large Language Models via Multilingual Finetuning with Translation Instructionscited by 56
- 2023TIM: Teaching Large Language Models to Translate with Comparisoncited by 50
- 2023MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methodscited by 33
- 2021Improving Neural Machine Translation by Bidirectional Trainingcited by 17
- 2019Learning a Multi-Domain Curriculum for Neural Machine Translationcited by 16
- 2021Alternated Training with Synthetic and Authentic Data for Neural Machine Translationcited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2024IsoChronoMeter: A simple and effective isochronic translation evaluation metriccited by 1
- 2025DIMT25@ICDAR2025: HW-TSC's End-to-End Document Image Machine Translation System Leveraging Large Vision-Language Modelcited by 0
- 2025Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Modelscited by 0
- 2025Unlocking Latent Discourse Translation in LLMs Through Quality-Aware Decodingcited by 0
- 2025Unlocking Latent Discourse Translation in LLMs Through Quality-Aware Decoding8 Oct 2025
- 2025Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Models9 Jun 2025
- 2025DIMT25@ICDAR2025: HW-TSC's End-to-End Document Image Machine Translation System Leveraging Large Vision-Language Model24 Apr 2025
- 2024IsoChronoMeter: A simple and effective isochronic translation evaluation metric14 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2025Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation
- 2025Calibrating Translation Decoding with Quality Estimation on LLMs
- 2024Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Data
- 2024From LLM to NMT: Advancing Low-Resource Machine Translation with Claude
- 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation
- 2026North Small Translate: Advanced Cost-Effective Translation (Cohere CAT+)
- 2025FuxiMT: Sparsifying Large Language Models for Chinese-Centric Multilingual Machine Translation
- 2025HY-MT1.5 Technical Report