mlsanityData to 14 Oct 2026

Improving Neural Machine Translation by Multi-Knowledge Integration with Prompting

arXiv 2312.04807 ↗First posted 8 Dec 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Improving neural machine translation (NMT) systems with prompting has achieved significant progress in recent years. In this work, we focus on how to integrate multi-knowledge, multiple types of knowledge, into NMT models to enhance the performance with prompting. We propose a unified framework, which can integrate effectively multiple types of knowledge including sentences, terminologies/phrases and translation templates into NMT models. We utilize multiple types of knowledge as prefix-prompts of input for the encoder and decoder of NMT models to guide the translation process. The approach requires no changes to the model architecture and effectively adapts to domain-specific translation without retraining. The experiments on English-Chinese and English-German translation demonstrate that our approach significantly outperform strong baselines, achieving high translation quality and terminology match accuracy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 48 references that are in the map. First posted on arXiv 8 Dec 2023.

Builds on

24 of 48 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  5. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  6. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
  7. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  8. 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 237
  9. 2020Nearest Neighbor Machine Translationcited by 209
  10. 2018Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine Translationcited by 182
  11. 2020Unsupervised Domain Clusters in Pretrained Language Modelscited by 160
  12. 2019Training Neural Machine Translation To Apply Terminology Constraintscited by 73
12 more
  1. 2018Guiding Neural Machine Translation with Retrieved Translation Piecescited by 63
  2. 2021Neural Machine Translation with Monolingual Translation Memorycited by 61
  3. 2019Code-Switching for Enhancing NMT with Pre-Specified Translationcited by 53
  4. 2020Lexically Constrained Neural Machine Translation with Levenshtein Transformercited by 45
  5. 2021TranSmart: A Practical Interactive Machine Translation Systemcited by 17
  6. 2021On the Evaluation of Machine Translation for Terminology Consistencycited by 15
  7. 2019Neural Machine Translation with Explicit Phrase Alignmentcited by 12
  8. 2018Prior Knowledge Integration for Neural Machine Translation using Posterior Regularizationcited by 9
  9. 2019Neural Machine Translation with Noisy Lexical Constraintscited by 8
  10. 2021End-to-End Lexically Constrained Machine Translation for Morphologically Rich Languagescited by 6
  11. 2016Neural Machine Translation with External Phrase Memorycited by 4
  12. 2016Agreement-based Learning of Parallel Lexicons and Phrases from Non-Parallel Corporacited by 1

Built on by

Not cited yet.