mlsanityData to 7 Oct 2026

Local Translation Services for Neglected Languages

arXiv 2101.01628 ↗First posted 5 Jan 2021cs.CL cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Taking advantage of computationally lightweight, but high-quality translators prompt consideration of new applications that address neglected languages. Locally run translators for less popular languages may assist data projects with protected or personal data that may require specific compliance checks before posting to a public translation API, but which could render reasonable, cost-effective solutions if done with an army of local, small-scale pair translators. Like handling a specialist's dialect, this research illustrates translating two historically interesting, but obfuscated languages: 1) hacker-speak ("l33t") and 2) reverse (or "mirror") writing as practiced by Leonardo da Vinci. The work generalizes a deep learning architecture to translatable variants of hacker-speak with lite, medium, and hard vocabularies. The original contribution highlights a fluent translator of hacker-speak in under 50 megabytes and demonstrates a generator for augmenting future datasets with greater than a million bilingual sentence pairs. The long short-term memory, recurrent neural network (LSTM-RNN) extends previous work demonstrating an English-to-foreign translation service built from as little as 10,000 bilingual sentence pairs. This work further solves the equivalent translation problem in twenty-six additional (non-obfuscated) languages and rank orders those models and their proficiency quantitatively with Italian as the most successful and Mandarin Chinese as the most challenging. For neglected languages, the method prototypes novel services for smaller niche translations such as Kabyle (Algerian dialect) which covers between 5-7 million speakers but one which for most enterprise translators, has not yet reached development. One anticipates the extension of this approach to other important dialects, such as translating technical (medical or legal) jargon and processing health records.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 11 of its 42 references that are in the map. First posted on arXiv 5 Jan 2021.

Builds on

11 of 42 references.

References · 11

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  3. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  4. 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
  5. 2017Data Augmentation for Low-Resource Neural Machine Translationcited by 139
  6. 2020As Good as New. How to Successfully Recycle English GPT-2 to Make Models for Other Languagescited by 54
  7. 2017A4NT: Author Attribute Anonymity by Adversarial Training of Neural Machine Translationcited by 41
  8. 2020A Comprehensive Survey of Multilingual Neural Machine Translationcited by 12
  9. 2016Bi-directional LSTM Recurrent Neural Network for Chinese Word Segmentationcited by 4
  10. 2017Where to put the Image in an Image Caption Generatorcited by 4
  11. 2020Systematic Attack Surface Reduction For Deployed Sentiment Analysis Modelscited by 3

Built on by

Cited by year

Citing papers per year: 2023: 2.

2 papers.