mlsanityData to 7 Oct 2026

Finetuning a Kalaallisut-English machine translation system using web-crawled data

arXiv 2206.02230 ↗First posted 5 Jun 2022cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

West Greenlandic, known by native speakers as Kalaallisut, is an extremely low-resource polysynthetic language spoken by around 56,000 people in Greenland. Here, we attempt to finetune a pretrained Kalaallisut-to-English neural machine translation (NMT) system using web-crawled pseudoparallel sentences from around 30 multilingual websites. We compile a corpus of over 93,000 Kalaallisut sentences and over 140,000 Danish sentences, then use cross-lingual sentence embeddings and approximate nearest-neighbors search in an attempt to mine near-translations from these corpora. Finally, we translate the Danish sentence to English to obtain a synthetic Kalaallisut-English aligned corpus. Although the resulting dataset is too small and noisy to improve the pretrained MT model, we believe that with additional resources, we could construct a better pseudoparallel corpus and achieve more promising results on MT. We also note other possible uses of the monolingual Kalaallisut data and discuss directions for future work. We make the code and data for our experiments publicly available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 43 references that are in the map. First posted on arXiv 5 Jun 2022.

Builds on

19 of 43 references.

References · 19

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  3. 2017Billion-scale similarity search with GPUscited by 2,477
  4. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  5. 2020Language-agnostic BERT Sentence Embeddingcited by 621
  6. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  7. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  8. 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 221
  9. 2018Marian: Fast Neural Machine Translation in C++cited by 202
  10. 2019CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEBcited by 177
  11. 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
  12. 2021Survey of Low-Resource Machine Translationcited by 92
7 more
  1. 2018Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddingscited by 83
  2. 2020Cross-lingual Retrieval for Iterative Self-Supervised Trainingcited by 54
  3. 2018Filtering and Mining Parallel Data in a Joint Multilingual Spacecited by 32
  4. 2020Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddingscited by 16
  5. 2021Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Miningcited by 9
  6. 2021A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Spacecited by 8
  7. 2018Neural Machine Translation for Low Resource Languages using Bilingual Lexicon Induced from Comparable Corporacited by 5

Built on by

Not cited yet.