Developing neural machine translation models for Hungarian-English
Not on the map. Why?
Abstract (arXiv)
I train models for the task of neural machine translation for English-Hungarian and Hungarian-English, using the Hunglish2 corpus. The main contribution of this work is evaluating different data augmentation methods during the training of NMT models. I propose 5 different augmentation methods that are structure-aware, meaning that instead of randomly selecting words for blanking or replacement, the dependency tree of sentences is used as a basis for augmentation. I start my thesis with a detailed literature review on neural networks, sequential modeling, neural machine translation, dependency parsing and data augmentation. After a detailed exploratory data analysis and preprocessing of the Hunglish2 corpus, I perform experiments with the proposed data augmentation techniques. The best model for Hungarian-English achieves a BLEU score of 33.9, while the best model for English-Hungarian achieves a BLEU score of 28.6.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 55 references that are in the map. First posted on arXiv 7 Nov 2021.
Builds on
24 of 55 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
12 more
- 2017Convolutional Sequence to Sequence Learningcited by 550
- 2017A Deep Reinforced Model for Abstractive Summarizationcited by 364
- 2017A Structured Self-attentive Sentence Embeddingcited by 318
- 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
- 2018Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relationscited by 201
- 2016Long Short-Term Memory-Networks for Machine Readingcited by 161
- 2017Data Noising as Smoothing in Neural Network Language Modelscited by 78
- 2016Neural Machine Translation in Linear Timecited by 65
- 2019Data Augmentation via Dependency Tree Morphing for Low-Resource Languagescited by 45
- 2016Improved Relation Classification by Deep Recurrent Neural Networks with Data Augmentationcited by 26
- 2020Neural Machine Translation: A Review of Methods, Resources, and Toolscited by 18
- 2020Syntax-aware Data Augmentation for Neural Machine Translationcited by 10
Built on by
Citing papers per year: 2022: 1.
1 paper.