mlsanityData to 7 Oct 2026

Rule-based Morphological Inflection Improves Neural Terminology Translation

arXiv 2109.04620 ↗First posted 10 Sep 2021cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Current approaches to incorporating terminology constraints in machine translation (MT) typically assume that the constraint terms are provided in their correct morphological forms. This limits their application to real-world scenarios where constraint terms are provided as lemmas. In this paper, we introduce a modular framework for incorporating lemma constraints in neural MT (NMT) in which linguistic knowledge and diverse types of NMT models can be flexibly applied. It is based on a novel cross-lingual inflection module that inflects the target lemma constraints based on the source context. We explore linguistically motivated rule-based and data-driven neural-based inflection modules and design English-German health and English-Lithuanian news test suites to evaluate them in domain adaptation and low-resource MT settings. Results show that our rule-based inflection module helps NMT models incorporate lemma constraints more accurately than a neural module and outperforms the existing end-to-end approach with lower training costs.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 10 Sep 2021.

Builds on

36 of 53 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  6. 2016Sequence-Level Knowledge Distillationcited by 761
  7. 2017Non-Autoregressive Neural Machine Translationcited by 457
  8. 2016Using the Output Embedding to Improve Language Modelscited by 266
  9. 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 234
  10. 2017Parallel WaveNet: Fast High-Fidelity Speech Synthesiscited by 214
  11. 2019Levenshtein Transformercited by 197
  12. 2018Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative Refinementcited by 194
24 more
  1. 2018Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine Translationcited by 181
  2. 2019Understanding Knowledge Distillation in Non-autoregressive Machine Translationcited by 121
  3. 2019FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flowcited by 89
  4. 2020End-to-End Slot Alignment and Recognition for Cross-Lingual NLUcited by 82
  5. 2019Training Neural Machine Translation To Apply Terminology Constraintscited by 73
  6. 2020Understanding and Improving Lexical Choice in Non-Autoregressive Translationcited by 55
  7. 2019Code-Switching for Enhancing NMT with Pre-Specified Translationcited by 53
  8. 2020Lexically Constrained Neural Machine Translation with Levenshtein Transformercited by 45
  9. 2018The CoNLL--SIGMORPHON 2018 Shared Task: Universal Morphological Reinflectioncited by 41
  10. 2017CoNLL-SIGMORPHON 2017 Shared Task: Universal Morphological Reinflection in 52 Languagescited by 40
  11. 2018UniMorph 2.0: Universal Morphologycited by 40
  12. 2020EDITOR: an Edit-Based Transformer with Repositioning for Neural Machine Translation with Soft Lexical Constraintscited by 24
  13. 2020A Systematic Analysis of Morphological Content in BERT Models for Multiple Languagescited by 20
  14. 2021Facilitating Terminology Translation with Target Lemma Annotationscited by 19
  15. 2017Improving Lexical Choice in Neural Machine Translationcited by 17
  16. 2015Morphological Inflection Generation Using Character Sequence to Sequence Learningcited by 14
  17. 2018Compositional Representation of Morphologically-Rich Input for Neural Machine Translationcited by 12
  18. 2021How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation?cited by 12
  19. 2017Modeling Target-Side Inflection in Neural Machine Translationcited by 9
  20. 2020Dual Reconstruction: a Unifying Objective for Semi-Supervised Neural Machine Translationcited by 7
  21. 2021Soft Layer Selection with Meta-Learning for Zero-Shot Cross-Lingual Transfercited by 5
  22. 2018DEMorphy, German Language Morphological Analyzercited by 4
  23. 2018Copenhagen at CoNLL--SIGMORPHON 2018: Multilingual Inflection in Context with Explicit Morphosyntactic Decodingcited by 3
  24. 2020Incorporating Terminology Constraints in Automatic Post-Editingcited by 3

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 1; 2024: 0; 2025: 1.

3 papers.