Domain Adaptation for Arabic Machine Translation: The Case of Financial Texts
Not on the map. Why?
Abstract (arXiv)
Neural machine translation (NMT) has shown impressive performance when trained on large-scale corpora. However, generic NMT systems have demonstrated poor performance on out-of-domain translation. To mitigate this issue, several domain adaptation methods have recently been proposed which often lead to better translation quality than genetic NMT systems. While there has been some continuous progress in NMT for English and other European languages, domain adaption in Arabic has received little attention in the literature. The current study, therefore, aims to explore the effectiveness of domain-specific adaptation for Arabic MT (AMT), in yet unexplored domain, financial news articles. To this end, we developed carefully a parallel corpus for Arabic-English (AR- EN) translation in the financial domain for benchmarking different domain adaptation methods. We then fine-tuned several pre-trained NMT and Large Language models including ChatGPT-3.5 Turbo on our dataset. The results showed that the fine-tuning is successful using just a few well-aligned in-domain AR-EN segments. The quality of ChatGPT translation was superior than other models based on automatic and human evaluations. To the best of our knowledge, this is the first work on fine-tuning ChatGPT towards financial domain transfer learning. To contribute to research in domain translation, we made our datasets and fine-tuned models available at https://huggingface.co/asas-ai/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 65 references that are in the map. First posted on arXiv 22 Sep 2023.
Builds on
39 of 65 references.
References · 39
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
- 2017Convolutional Sequence to Sequence Learningcited by 552
- 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 469
27 more
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 362
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
- 2017Six Challenges for Neural Machine Translationcited by 335
- 2019Simple, Scalable Adaptation for Neural Machine Translationcited by 242
- 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
- 2020The Tatoeba Translation Challenge -- Realistic Data Sets for Low Resource and Multilingual MTcited by 128
- 2019Neural Machine Translation: A Review and Surveycited by 100
- 2016Neural Machine Translation in Linear Timecited by 66
- 2019Domain Robustness in Neural Machine Translationcited by 65
- 2021AraT5: Text-to-Text Transformers for Arabic Language Generationcited by 63
- 2023Adaptive Machine Translation with Large Language Modelscited by 58
- 2020AraGPT2: Pre-Trained Transformer for Arabic Language Generationcited by 55
- 2016A Convolutional Encoder Model for Neural Machine Translationcited by 54
- 2020A Survey of Deep Learning Techniques for Neural Machine Translationcited by 50
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2023GPTAraEval: A Comprehensive Evaluation of ChatGPT on Arabic NLPcited by 37
- 2016Character-based Neural Machine Translationcited by 33
- 2016Achieving Open Vocabulary Neural Machine Translation with Hybrid Word-Character Modelscited by 18
- 2018Investigating Backtranslation in Neural Machine Translationcited by 14
- 2021The Trade-offs of Domain Adaptation for Neural Language Modelscited by 14
- 2022Domain-Specific Text Generation for Machine Translationcited by 12
- 2023Taqyim: Evaluating Arabic NLP Tasks Using ChatGPT Modelscited by 10
- 2016Deep Recurrent Models with Fast-Forward Connections for Neural Machine Translationcited by 8
- 2019A Latent Morphology Model for Open-Vocabulary Neural Machine Translationcited by 8
- 2019Post-editing Productivity with Neural Machine Translation: An Empirical Assessment of Speed and Quality in the Banking and Finance Domaincited by 7
- 2019The Impact of Preprocessing on Arabic-English Statistical and Neural Machine Translationcited by 6
- 2015Encoding Source Language with Convolutional Neural Network for Machine Translationcited by 4
Built on by
Citing papers per year: 2024: 1.
1 paper.