mlsanityData to 13 Oct 2026

Learning How to Translate North Korean through South Korean

arXiv 2201.11258 ↗First posted 27 Jan 2022cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

South and North Korea both use the Korean language. However, Korean NLP research has focused on South Korean only, and existing NLP systems of the Korean language, such as neural machine translation (NMT) models, cannot properly handle North Korean inputs. Training a model using North Korean data is the most straightforward approach to solving this problem, but there is insufficient data to train NMT models. In this study, we create data for North Korean NMT models using a comparable corpus. First, we manually create evaluation data for automatic alignment and machine translation. Then, we investigate automatic alignment methods suitable for North Korean. Finally, we verify that a model trained by North Korean bilingual data without human annotation can significantly boost North Korean translation accuracy compared to existing South Korean models in zero-shot settings.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 13 of its 35 references that are in the map. First posted on arXiv 27 Jan 2022.

Builds on

13 of 35 references.

References · 13

  1. 2017Attention Is All You Needcited by 60,106
  2. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,979
  3. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,487
  4. 2021Deduplicating Training Data Makes Language Models Bettercited by 710
  5. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  6. 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
  7. 2018Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddingscited by 83
  8. 2017Learning Joint Multilingual Sentence Representations with Neural Machine Translationcited by 52
  9. 2019Domain Adaptation of Neural Machine Translation by Lexicon Inductioncited by 33
  10. 2018Filtering and Mining Parallel Data in a Joint Multilingual Spacecited by 32
  11. 2020Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddingscited by 16
  12. 2018Neural Machine Translation into Language Varietiescited by 9
1 more
  1. 2017Extracting an English-Persian Parallel Corpus from Comparable Corporacited by 4

Built on by

Not cited yet.