Incorporating Discrete Translation Lexicons into Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
Neural machine translation (NMT) often makes mistakes in translating low-frequency content words that are essential to understanding the meaning of the sentence. We propose a method to alleviate this problem by augmenting NMT systems with discrete translation lexicons that efficiently encode translations of these low-frequency words. We describe a method to calculate the lexicon probability of the next word in the translation candidate by using the attention vector of the NMT model to select which source word lexical probabilities the model should focus on. We test two methods to combine this probability with the standard NMT probability: (1) using it as a bias, and (2) linear interpolation. Experiments on two corpora show an improvement of 2.0-2.3 BLEU and 0.13-0.44 NIST score, and faster convergence time.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 4; 2023: 5; 2024: 6; 2025: 4.
33 papers.
Sort:
By area:
- 2021Word Alignment by Fine-tuning Embeddings on Parallel Corporacited by 186
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2023Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translationcited by 74
- 2023Benchmarking Machine Translation with Cultural Awarenesscited by 53
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translationcited by 34
- 2021Lexicon Learning for Few-Shot Neural Sequence Modelingcited by 28
- 2021Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMTcited by 21
- 2023Chain-of-Dictionary Prompting Elicits Translation in Large Language Modelscited by 16
- 2021On the Evaluation of Machine Translation for Terminology Consistencycited by 15
- 2021Don't Go Far Off: An Empirical Study on Neural Poetry Translationcited by 15
- 2024What is the Best Way for ChatGPT to Translate Poetry?cited by 14
21 more
- 2021Phrase-level Active Learning for Neural Machine Translationcited by 13
- 2021Lexically Aware Semi-Supervised Learning for OCR Post-Correctioncited by 12
- 2021Continuous Learning in Neural Machine Translation using Bilingual Dictionariescited by 11
- 2021Frequency-Aware Contrastive Learning for Neural Machine Translationcited by 11
- 2024GenAudit: Fixing Factual Errors in Language Model Outputs with Evidencecited by 10
- 2024LLM-based Translation Inference with Iterative Bilingual Understandingcited by 6
- 2025Retrieval-Augmented Code Review Comment Generationcited by 6
- 2021Harnessing Cross-lingual Features to Improve Cognate Detection for Low-resource Languagescited by 4
- 2024Improving Retrieval-Augmented Code Comment Generation by Retrieving for Generationcited by 4
- 2022Word Alignment in the Era of Deep Learning: A Tutorialcited by 3
- 2024Dictionary Insertion Prompting for Multilingual Reasoning on Multilingual Large Language Modelscited by 3
- 2022Domain Adaptation in Neural Machine Translation using a Qualia-Enriched FrameNetcited by 2
- 2022Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignmentcited by 2
- 2023Extract and Attend: Improving Entity Translation in Neural Machine Translationcited by 2
- 2023Layer-wise Representation Fusion for Compositional Generalizationcited by 2
- 2024A Morphologically-Aware Dictionary-based Data Augmentation Technique for Machine Translation of Under-Represented Languagescited by 2
- 2021Bilingual Terminology Extraction from Comparable E-Commerce Corporacited by 0
- 2022Third-Party Aligner for Neural Word Alignmentscited by 0
- 2025SLoW: Select Low-frequency Words! Automatic Dictionary Selection for Translation on Large Language Modelscited by 0
- 2025A New NMT Model for Translating Clinical Texts from English to Spanishcited by 0
- 2025LLMs for Low-Resource Dialect Translation Using Context-Aware Prompting: A Case Study on Sylheticited by 0
- 2025LLMs for Low-Resource Dialect Translation Using Context-Aware Prompting: A Case Study on Sylheti24 Nov 2025
- 2025A New NMT Model for Translating Clinical Texts from English to Spanish26 Aug 2025
- 2025SLoW: Select Low-frequency Words! Automatic Dictionary Selection for Translation on Large Language Models25 Jul 2025
- 2025Retrieval-Augmented Code Review Comment Generation13 Jun 2025
- 2024Dictionary Insertion Prompting for Multilingual Reasoning on Multilingual Large Language Models2 Nov 2024
- 2024LLM-based Translation Inference with Iterative Bilingual Understanding16 Oct 2024
- 2024Improving Retrieval-Augmented Code Comment Generation by Retrieving for Generation7 Aug 2024
- 2024What is the Best Way for ChatGPT to Translate Poetry?5 Jun 2024
- 2024GenAudit: Fixing Factual Errors in Language Model Outputs with Evidence19 Feb 2024
- 2024A Morphologically-Aware Dictionary-based Data Augmentation Technique for Machine Translation of Under-Represented Languages2 Feb 2024
- 2023Layer-wise Representation Fusion for Compositional Generalization20 Jul 2023
- 2023Extract and Attend: Improving Entity Translation in Neural Machine Translation4 Jun 2023
21 more
- 2023Benchmarking Machine Translation with Cultural Awareness23 May 2023
- 2023Chain-of-Dictionary Prompting Elicits Translation in Large Language Models11 May 2023
- 2023Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translation15 Feb 2023
- 2022Word Alignment in the Era of Deep Learning: A Tutorial30 Nov 2022
- 2022Third-Party Aligner for Neural Word Alignments8 Nov 2022
- 2022Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment9 Oct 2022
- 2022Domain Adaptation in Neural Machine Translation using a Qualia-Enriched FrameNet21 Feb 2022
- 2021Frequency-Aware Contrastive Learning for Neural Machine Translation29 Dec 2021
- 2021Harnessing Cross-lingual Features to Improve Cognate Detection for Low-resource Languages16 Dec 2021
- 2021Lexically Aware Semi-Supervised Learning for OCR Post-Correction4 Nov 2021
- 2021Don't Go Far Off: An Empirical Study on Neural Poetry Translation7 Sep 2021
- 2021Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMT3 Sep 2021
- 2021Survey of Low-Resource Machine Translation1 Sep 2021
- 2021On the Evaluation of Machine Translation for Terminology Consistency22 Jun 2021
- 2021Phrase-level Active Learning for Neural Machine Translation21 Jun 2021
- 2021Lexicon Learning for Few-Shot Neural Sequence Modeling7 Jun 2021
- 2021Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation2 Jun 2021
- 2021Bilingual Terminology Extraction from Comparable E-Commerce Corpora15 Apr 2021
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Survey14 Apr 2021
- 2021Continuous Learning in Neural Machine Translation using Bilingual Dictionaries12 Feb 2021
- 2021Word Alignment by Fine-tuning Embeddings on Parallel Corpora20 Jan 2021
- 2021Word Alignment by Fine-tuning Embeddings on Parallel Corporacited by 186
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2023Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translationcited by 74
- 2023Benchmarking Machine Translation with Cultural Awarenesscited by 53
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translationcited by 34
- 2021Lexicon Learning for Few-Shot Neural Sequence Modelingcited by 28
- 2021Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMTcited by 21
- 2023Chain-of-Dictionary Prompting Elicits Translation in Large Language Modelscited by 16
- 2021On the Evaluation of Machine Translation for Terminology Consistencycited by 15
- 2021Don't Go Far Off: An Empirical Study on Neural Poetry Translationcited by 15
- 2024What is the Best Way for ChatGPT to Translate Poetry?cited by 14
12 most cited of 30 All 30 (JSON)
- 2025LLMs for Low-Resource Dialect Translation Using Context-Aware Prompting: A Case Study on Sylheti24 Nov 2025
- 2025A New NMT Model for Translating Clinical Texts from English to Spanish26 Aug 2025
- 2025SLoW: Select Low-frequency Words! Automatic Dictionary Selection for Translation on Large Language Models25 Jul 2025
- 2024LLM-based Translation Inference with Iterative Bilingual Understanding16 Oct 2024
- 2024What is the Best Way for ChatGPT to Translate Poetry?5 Jun 2024
- 2024GenAudit: Fixing Factual Errors in Language Model Outputs with Evidence19 Feb 2024
- 2024A Morphologically-Aware Dictionary-based Data Augmentation Technique for Machine Translation of Under-Represented Languages2 Feb 2024
- 2023Layer-wise Representation Fusion for Compositional Generalization20 Jul 2023
- 2023Extract and Attend: Improving Entity Translation in Neural Machine Translation4 Jun 2023
- 2023Benchmarking Machine Translation with Cultural Awareness23 May 2023
- 2023Chain-of-Dictionary Prompting Elicits Translation in Large Language Models11 May 2023
- 2023Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translation15 Feb 2023
12 newest of 30 All 30 (JSON)