mlsanityData to 14 Oct 2026

Selecting Parallel In-domain Sentences for Neural Machine Translation Using Monolingual Texts

arXiv 2112.06096 ↗First posted 11 Dec 2021cs.CL cs.AI cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Continuously-growing data volumes lead to larger generic models. Specific use-cases are usually left out, since generic models tend to perform poorly in domain-specific cases. Our work addresses this gap with a method for selecting in-domain data from generic-domain (parallel text) corpora, for the task of machine translation. The proposed method ranks sentences in parallel general-domain data according to their cosine similarity with a monolingual domain-specific data set. We then select the top K sentences with the highest similarity score to train a new machine translation system tuned to the specific in-domain data. Our experimental results show that models trained on this in-domain data outperform models trained on generic or a mixture of generic and domain data. That is, our method selects high-quality domain-specific training instances at low computational cost and data size.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 21 of its 43 references that are in the map. First posted on arXiv 11 Dec 2021.

Builds on

21 of 43 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  7. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  8. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  9. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  10. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  11. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 1,001
  12. 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
9 more
  1. 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
  2. 2020Unsupervised Domain Clusters in Pretrained Language Modelscited by 160
  3. 2017Data Augmentation for Low-Resource Neural Machine Translationcited by 139
  4. 2018A Survey of Domain Adaptation for Neural Machine Translationcited by 64
  5. 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
  6. 2016Domain Control for Neural Machine Translationcited by 36
  7. 2017Dynamic Data Selection for Neural Machine Translationcited by 33
  8. 2020A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Modelscited by 30
  9. 2021Multi-Domain Adaptation in Neural Machine Translation Through Multidimensional Taggingcited by 8

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 3.

4 papers.