Learning How to Translate North Korean through South Korean
Not on the map. Why?
Abstract (arXiv)
South and North Korea both use the Korean language. However, Korean NLP research has focused on South Korean only, and existing NLP systems of the Korean language, such as neural machine translation (NMT) models, cannot properly handle North Korean inputs. Training a model using North Korean data is the most straightforward approach to solving this problem, but there is insufficient data to train NMT models. In this study, we create data for North Korean NMT models using a comparable corpus. First, we manually create evaluation data for automatic alignment and machine translation. Then, we investigate automatic alignment methods suitable for North Korean. Finally, we verify that a model trained by North Korean bilingual data without human annotation can significantly boost North Korean translation accuracy compared to existing South Korean models in zero-shot settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 35 references that are in the map. First posted on arXiv 27 Jan 2022.
Builds on
13 of 35 references.
References · 13
- 2017Attention Is All You Needcited by 60,361
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
- 2021Deduplicating Training Data Makes Language Models Bettercited by 714
- 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
- 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
- 2018Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddingscited by 83
- 2017Learning Joint Multilingual Sentence Representations with Neural Machine Translationcited by 52
- 2019Domain Adaptation of Neural Machine Translation by Lexicon Inductioncited by 33
- 2018Filtering and Mining Parallel Data in a Joint Multilingual Spacecited by 32
- 2020Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddingscited by 16
- 2018Neural Machine Translation into Language Varietiescited by 9
1 more
Built on by
Not cited yet.