mlsanityData to 14 Oct 2026

Low-Resource Neural Machine Translation Using Recurrent Neural Networks and Transfer Learning: A Case Study on English-to-Igbo

arXiv 2504.17252 ↗First posted 24 Apr 2025cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In this study, we develop Neural Machine Translation (NMT) and Transformer-based transfer learning models for English-to-Igbo translation - a low-resource African language spoken by over 40 million people across Nigeria and West Africa. Our models are trained on a curated and benchmarked dataset compiled from Bible corpora, local news, Wikipedia articles, and Common Crawl, all verified by native language experts. We leverage Recurrent Neural Network (RNN) architectures, including Long Short-Term Memory (LSTM) and Gated Recurrent Units (GRU), enhanced with attention mechanisms to improve translation accuracy. To further enhance performance, we apply transfer learning using MarianNMT pre-trained models within the SimpleTransformers framework. Our RNN-based system achieves competitive results, closely matching existing English-Igbo benchmarks. With transfer learning, we observe a performance gain of +4.83 BLEU points, reaching an estimated translation accuracy of 70%. These findings highlight the effectiveness of combining RNNs with transfer learning to address the performance gap in low-resource language translation tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 74 references that are in the map. First posted on arXiv 24 Apr 2025.

Builds on

33 of 74 references.

References · 33

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  7. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  8. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  9. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  10. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  11. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  12. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
21 more
  1. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
  2. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
  3. 2014Deep Learning in Neural Networks: An Overviewcited by 770
  4. 2016Professor Forcing: A New Algorithm for Training Recurrent Networkscited by 216
  5. 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
  6. 2024Large Language Models Meet NLP: A Surveycited by 103
  7. 2018The Best of Both Worlds: Combining Recent Advances in Neural Machine Translationcited by 102
  8. 2016Quasi-Recurrent Neural Networkscited by 87
  9. 2017Graph Convolutional Encoders for Syntax-aware Neural Machine Translationcited by 70
  10. 2016Neural Machine Translation in Linear Timecited by 66
  11. 2017Transfer Learning across Low-Resource, Related Languages for Neural Machine Translationcited by 58
  12. 2020A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translationcited by 51
  13. 2016Minimal Gated Unit for Recurrent Neural Networkscited by 40
  14. 2022Transfer Learning Approaches for Building Cross-Language Dense Retrieval Modelscited by 36
  15. 2019Convolutional Self-Attention Networkscited by 32
  16. 2019MIDAS: Microcluster-Based Detector of Anomalies in Edge Streamscited by 29
  17. 2020F-FADE: Frequency Factorization for Anomaly Detection in Edge Streamscited by 26
  18. 2017Neural Machine Translation and Sequence-to-sequence Models: A Tutorialcited by 25
  19. 2018Probabilistic FastText for Multi-Sense Word Embeddingscited by 25
  20. 2020Igbo-English Machine Translation: An Evaluation Benchmarkcited by 14
  21. 2017Simplified Minimal Gated Unit Variations for Recurrent Neural Networkscited by 13

Built on by

Not cited yet.