mlsanityData to 7 Oct 2026

HW-TSC's Submission to the CCMT 2024 Machine Translation Tasks

arXiv 2409.14842 ↗First posted 23 Sep 2024cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper presents the submission of Huawei Translation Services Center (HW-TSC) to machine translation tasks of the 20th China Conference on Machine Translation (CCMT 2024). We participate in the bilingual machine translation task and multi-domain machine translation task. For these two translation tasks, we use training strategies such as regularized dropout, bidirectional training, data diversification, forward translation, back translation, alternated training, curriculum learning, and transductive ensemble learning to train neural machine translation (NMT) models based on the deep Transformer-big architecture. Furthermore, to explore whether large language model (LLM) can help improve the translation quality of NMT systems, we use supervised fine-tuning to train llama2-13b as an Automatic post-editing (APE) model to improve the translation results of the NMT model on the multi-domain machine translation task. By using these plyometric strategies, our submission achieves a competitive result in the final evaluation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 23 Sep 2024.

Builds on

28 of 40 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  7. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  8. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  9. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  10. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  11. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  12. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
16 more
  1. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  2. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  3. 2017Convolutional Sequence to Sequence Learningcited by 550
  4. 2019Learning Deep Transformer Models for Machine Translationcited by 309
  5. 2017Beam Search Strategies for Neural Machine Translationcited by 232
  6. 2023How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Compositioncited by 222
  7. 2021R-Drop: Regularized Dropout for Neural Networkscited by 202
  8. 2019Tagged Back-Translationcited by 76
  9. 2019Curriculum Learning for Domain Adaptation in Neural Machine Translationcited by 59
  10. 2023Leveraging GPT-4 for Automatic Translation Post-Editingcited by 56
  11. 2024GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translatorscited by 22
  12. 2021Improving Neural Machine Translation by Bidirectional Trainingcited by 17
  13. 2019Learning a Multi-Domain Curriculum for Neural Machine Translationcited by 16
  14. 2021Alternated Training with Synthetic and Authentic Data for Neural Machine Translationcited by 3
  15. 2024A Novel Paradigm Boosting Translation Capabilities of Large Language Modelscited by 3
  16. 2023Text Style Transfer Back-Translationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.