mlsanityData to 7 Oct 2026

Developing neural machine translation models for Hungarian-English

arXiv 2111.04099 ↗First posted 7 Nov 2021cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

I train models for the task of neural machine translation for English-Hungarian and Hungarian-English, using the Hunglish2 corpus. The main contribution of this work is evaluating different data augmentation methods during the training of NMT models. I propose 5 different augmentation methods that are structure-aware, meaning that instead of randomly selecting words for blanking or replacement, the dependency tree of sentences is used as a basis for augmentation. I start my thesis with a detailed literature review on neural networks, sequential modeling, neural machine translation, dependency parsing and data augmentation. After a detailed exploratory data analysis and preprocessing of the Hunglish2 corpus, I perform experiments with the proposed data augmentation techniques. The best model for Hungarian-English achieves a BLEU score of 33.9, while the best model for English-Hungarian achieves a BLEU score of 28.6.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 7 Nov 2021.

Builds on

24 of 55 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  6. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  7. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  8. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  9. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
  10. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
  11. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  12. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
12 more
  1. 2017Convolutional Sequence to Sequence Learningcited by 550
  2. 2017A Deep Reinforced Model for Abstractive Summarizationcited by 364
  3. 2017A Structured Self-attentive Sentence Embeddingcited by 318
  4. 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
  5. 2018Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relationscited by 201
  6. 2016Long Short-Term Memory-Networks for Machine Readingcited by 161
  7. 2017Data Noising as Smoothing in Neural Network Language Modelscited by 78
  8. 2016Neural Machine Translation in Linear Timecited by 65
  9. 2019Data Augmentation via Dependency Tree Morphing for Low-Resource Languagescited by 45
  10. 2016Improved Relation Classification by Deep Recurrent Neural Networks with Data Augmentationcited by 26
  11. 2020Neural Machine Translation: A Review of Methods, Resources, and Toolscited by 18
  12. 2020Syntax-aware Data Augmentation for Neural Machine Translationcited by 10

Built on by

Cited by year

Citing papers per year: 2022: 1.

1 paper.