Training Neural Machine Translation To Apply Terminology Constraints
Not on the map. Why?
Abstract (arXiv)
This paper proposes a novel method to inject custom terminology into neural machine translation at run time. Previous works have mainly proposed modifications to the decoding algorithm in order to constrain the output to include run-time-provided target terms. While being effective, these constrained decoding methods add, however, significant computational overhead to the inference step, and, as we show in this paper, can be brittle when tested in realistic conditions. In this paper we approach the problem by training a neural MT system to learn how to use custom terminology when provided with the input. Comparative experiments show that our method is not only more effective than a state-of-the-art implementation of constrained decoding, but is also as fast as constraint-free decoding.
Key facts. Cited by 73 papers in the map (data through 13 Oct 2026). First posted on arXiv 3 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 11; 2023: 21; 2024: 7; 2025: 9; 2026: 6.
73 papers.
Sort:
By area:
- 2022Survey of Hallucination in Natural Language Generationcited by 2,068
- 2021NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristicscited by 154
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2023Controlled Text Generation with Natural Language Instructionscited by 87
- 2023Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translationcited by 74
- 2023COLLIE: Systematic Construction of Constrained Text Generation Taskscited by 69
- 2022Gradient-Based Constrained Sampling from Language Modelscited by 64
- 2023Adaptive Machine Translation with Large Language Modelscited by 58
- 2023Benchmarking Machine Translation with Cultural Awarenesscited by 53
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021Controlling Conditional Language Models without Catastrophic Forgettingcited by 32
- 2022General and Domain Adaptive Chinese Spelling Check with Error Consistent Pretrainingcited by 25
38 more
- 2023Gender Neutralization for an Inclusive Machine Translation: from Theoretical Foundations to Open Challengescited by 22
- 2021Can You Traducir This? Machine Translation for Code-Switched Inputcited by 21
- 2021Facilitating Terminology Translation with Target Lemma Annotationscited by 19
- 2023A Paradigm Shift: The Future of Machine Translation Lies with Large Language Modelscited by 19
- 2021TranSmart: A Practical Interactive Machine Translation Systemcited by 17
- 2023Domain Terminology Integration into Machine Translation: Leveraging Large Language Modelscited by 17
- 2023Chain-of-Dictionary Prompting Elicits Translation in Large Language Modelscited by 16
- 2021On the Evaluation of Machine Translation for Terminology Consistencycited by 15
- 2021Continuous Learning in Neural Machine Translation using Bilingual Dictionariescited by 11
- 2021Is "moby dick" a Whale or a Bird? Named Entities and Terminology in Speech Translationcited by 11
- 2021Encouraging Neural Machine Translation to Satisfy Terminology Constraintscited by 10
- 2024Fairness Definitions in Language Models Explainedcited by 10
- 2022Integrating Vectorized Lexical Constraints for Neural Machine Translationcited by 9
- 2023Terminology-Aware Translation with Constrained Decoding and Large Language Model Promptingcited by 8
- 2024Cultural Adaptation of Menus: A Fine-Grained Approachcited by 8
- 2021GWLAN: General Word-Level AutocompletioN for Computer-Aided Translationcited by 7
- 2022Zero-shot Domain Adaptation for Neural Machine Translation with Retrieved Phrase-level Promptscited by 7
- 2023Toward Unified Controllable Text Generation via Regular Expression Instructioncited by 7
- 2024Efficient Terminology Integration for LLM-based Translation in Specialized Domainscited by 7
- 2021End-to-End Lexically Constrained Machine Translation for Morphologically Rich Languagescited by 6
- 2022DICTDIS: Dictionary Constrained Disambiguation for Improved NMTcited by 4
- 2024Dictionary Insertion Prompting for Multilingual Reasoning on Multilingual Large Language Modelscited by 4
- 2025Specification-Aware Machine Translation and Evaluation for Purpose Alignmentcited by 4
- 2021Improving Lexically Constrained Neural Machine Translation with Source-Conditioned Masked Span Predictioncited by 3
- 2021Rule-based Morphological Inflection Improves Neural Terminology Translationcited by 3
- 2022Neighbors Are Not Strangers: Improving Non-Autoregressive Translation under Low-Frequency Lexical Constraintscited by 3
- 2023Towards Accurate Translation via Semantically Appropriate Application of Lexical Constraintscited by 3
- 2023To be or not to be? an exploration of continuously controllable prompt engineeringcited by 3
- 2024Optimizing Rare Word Accuracy in Direct Speech Translation with a Retrieval-and-Demonstration Approachcited by 3
- 2025Low-resource Machine Translation for Code-switched Kazakh-Russian Language Paircited by 3
- 2025Locate-and-Focus: Enhancing Terminology Translation in Speech Language Modelscited by 3
- 2021Machine Translation Customization via Automatic Training Data Selection from the Webcited by 2
- 2021CUNI systems for WMT21: Terminology translation Shared Taskcited by 2
- 2021Lingua Custodia's participation at the WMT 2021 Machine Translation using Terminologies shared taskcited by 2
- 2023Extract and Attend: Improving Entity Translation in Neural Machine Translationcited by 2
- 2024Improving Rare Word Translation With Dictionaries and Attention Maskingcited by 2
- 2021Modeling Target-side Inflection in Placeholder Translationcited by 1
- 2022Accurate Online Posterior Alignments for Principled Lexically-Constrained Decodingcited by 1
50 most cited of 73 All 73 (JSON)
- 2026SalamandraTA at WMT 2026 Terminology Shared Task: Hard Examples Are Better Teachers9 Sep 2026
- 2026Improving Term Evaluation in Machine Translation: Variation Matters8 Sep 2026
- 2026From Zero to Hero: An Open LLM Ecosystem for Armenian3 Sep 2026
- 2026When to Use Extra Context: Evidence-Grounded Terminology Adaptation for Simultaneous Speech Translation20 Jul 2026
- 2026HardMTBench: Stress-Testing Chinese-English Translation on Knowledge-Intensive Domains27 May 2026
- 2026IFMTBench: A Comprehensive Benchmark for Multilingual Translation Instruction Following27 May 2026
- 2025It Takes Two: A Dual Stage Approach for Terminology-Aware Translation7 Nov 2025
- 2025Lingua Custodi's participation at the WMT 2025 Terminology shared task20 Oct 2025
- 2025Specification-Aware Machine Translation and Evaluation for Purpose Alignment22 Sep 2025
- 2025MedCOD: Enhancing English-to-Spanish Medical Translation of Large Language Models Using Enriched Chain-of-Dictionary Framework31 Aug 2025
- 2025Attention2Probability: Attention-Driven Terminology Probability Estimation for Robust Speech-to-Text System26 Aug 2025
- 2025SLoW: Select Low-frequency Words! Automatic Dictionary Selection for Translation on Large Language Models25 Jul 2025
38 more
- 2025Locate-and-Focus: Enhancing Terminology Translation in Speech Language Models24 Jul 2025
- 2025Learning to Translate Ambiguous Terminology by Preference Optimization on Post-Edits4 Jul 2025
- 2025Low-resource Machine Translation for Code-switched Kazakh-Russian Language Pair25 Mar 2025
- 2024Towards Global AI Inclusivity: A Large-Scale Multilingual Terminology Dataset (GIST)24 Dec 2024
- 2024Dictionary Insertion Prompting for Multilingual Reasoning on Multilingual Large Language Models2 Nov 2024
- 2024Efficient Terminology Integration for LLM-based Translation in Specialized Domains21 Oct 2024
- 2024Optimizing Rare Word Accuracy in Direct Speech Translation with a Retrieval-and-Demonstration Approach13 Sep 2024
- 2024Cultural Adaptation of Menus: A Fine-Grained Approach24 Aug 2024
- 2024Improving Rare Word Translation With Dictionaries and Attention Masking17 Aug 2024
- 2024Fairness Definitions in Language Models Explained26 Jul 2024
- 2023Improving Neural Machine Translation by Multi-Knowledge Integration with Prompting8 Dec 2023
- 2023To be or not to be? an exploration of continuously controllable prompt engineering16 Nov 2023
- 2023Evaluating, Understanding, and Improving Constrained Text Generation for Large Language Models25 Oct 2023
- 2023Domain Terminology Integration into Machine Translation: Leveraging Large Language Models22 Oct 2023
- 2023Terminology-Aware Translation with Constrained Decoding and Large Language Model Prompting9 Oct 2023
- 2023Toward Unified Controllable Text Generation via Regular Expression Instruction19 Sep 2023
- 2023A Benchmark for Text Expansion: Datasets, Metrics, and Baselines17 Sep 2023
- 2023The Effect of Alignment Objectives on Code-Switching Translation10 Sep 2023
- 2023Negative Lexical Constraints in Neural Machine Translation7 Aug 2023
- 2023COLLIE: Systematic Construction of Constrained Text Generation Tasks17 Jul 2023
- 2023Towards Accurate Translation via Semantically Appropriate Application of Lexical Constraints21 Jun 2023
- 2023Extract and Attend: Improving Entity Translation in Neural Machine Translation4 Jun 2023
- 2023Disambiguated Lexically Constrained Neural Machine Translation27 May 2023
- 2023Cascaded Beam Search: Plug-and-Play Terminology-Forcing For Neural Machine Translation23 May 2023
- 2023Benchmarking Machine Translation with Cultural Awareness23 May 2023
- 2023Chain-of-Dictionary Prompting Elicits Translation in Large Language Models11 May 2023
- 2023A Paradigm Shift: The Future of Machine Translation Lies with Large Language Models2 May 2023
- 2023Controlled Text Generation with Natural Language Instructions27 Apr 2023
- 2023Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translation15 Feb 2023
- 2023Adaptive Machine Translation with Large Language Models30 Jan 2023
- 2023Gender Neutralization for an Inclusive Machine Translation: from Theoretical Foundations to Open Challenges24 Jan 2023
- 2022DICTDIS: Dictionary Constrained Disambiguation for Improved NMT13 Oct 2022
- 2022Zero-shot Domain Adaptation for Neural Machine Translation with Retrieved Phrase-level Prompts23 Sep 2022
- 2022Knowledge Based Template Machine Translation In Low-Resource Setting8 Sep 2022
- 2022Open Terminology Management and Sharing Toolkit for Federation of Terminology Databases14 Jul 2022
- 2022Gradient-Based Constrained Sampling from Language Models25 May 2022
- 2022A Template-based Method for Constrained Neural Machine Translation23 May 2022
- 2022Neighbors Are Not Strangers: Improving Non-Autoregressive Translation under Low-Frequency Lexical Constraints28 Apr 2022
50 newest of 73 All 73 (JSON)
- 2022Survey of Hallucination in Natural Language Generationcited by 2,068
- 2021NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristicscited by 154
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2023Controlled Text Generation with Natural Language Instructionscited by 87
- 2023Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translationcited by 74
- 2023COLLIE: Systematic Construction of Constrained Text Generation Taskscited by 69
- 2022Gradient-Based Constrained Sampling from Language Modelscited by 64
- 2023Adaptive Machine Translation with Large Language Modelscited by 58
- 2023Benchmarking Machine Translation with Cultural Awarenesscited by 53
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021Controlling Conditional Language Models without Catastrophic Forgettingcited by 32
- 2022General and Domain Adaptive Chinese Spelling Check with Error Consistent Pretrainingcited by 25
12 most cited of 71 All 71 (JSON)
- 2026SalamandraTA at WMT 2026 Terminology Shared Task: Hard Examples Are Better Teachers9 Sep 2026
- 2026Improving Term Evaluation in Machine Translation: Variation Matters8 Sep 2026
- 2026From Zero to Hero: An Open LLM Ecosystem for Armenian3 Sep 2026
- 2026When to Use Extra Context: Evidence-Grounded Terminology Adaptation for Simultaneous Speech Translation20 Jul 2026
- 2026HardMTBench: Stress-Testing Chinese-English Translation on Knowledge-Intensive Domains27 May 2026
- 2026IFMTBench: A Comprehensive Benchmark for Multilingual Translation Instruction Following27 May 2026
- 2025It Takes Two: A Dual Stage Approach for Terminology-Aware Translation7 Nov 2025
- 2025Lingua Custodi's participation at the WMT 2025 Terminology shared task20 Oct 2025
- 2025Specification-Aware Machine Translation and Evaluation for Purpose Alignment22 Sep 2025
- 2025MedCOD: Enhancing English-to-Spanish Medical Translation of Large Language Models Using Enriched Chain-of-Dictionary Framework31 Aug 2025
- 2025Attention2Probability: Attention-Driven Terminology Probability Estimation for Robust Speech-to-Text System26 Aug 2025
- 2025SLoW: Select Low-frequency Words! Automatic Dictionary Selection for Translation on Large Language Models25 Jul 2025
12 newest of 71 All 71 (JSON)