MultiScript30k: Leveraging Multilingual Embeddings to Extend Cross Script Parallel Data
Not on the map. Why?
Abstract (arXiv)
Multi30k is frequently cited in the multimodal machine translation (MMT) literature, offering parallel text data for training and fine-tuning deep learning models. However, it is limited to four languages: Czech, English, French, and German. This restriction has led many researchers to focus their investigations only on these languages. As a result, MMT research on diverse languages has been stalled because the official Multi30k dataset only represents European languages in Latin scripts. Previous efforts to extend Multi30k exist, but the list of supported languages, represented language families, and scripts is still very short. To address these issues, we propose MultiScript30k, a new Multi30k dataset extension for global languages in various scripts, created by translating the English version of Multi30k (Multi30k-En) using NLLB200-3.3B. The dataset consists of over (30000) sentences and provides translations of all sentences in Multi30k-En into Ar, Es, Uk, ZhHans and ZhHant. Similarity analysis shows that Multi30k extension consistently achieves greater than (0.8) cosine similarity and symmetric KL divergence less than (0.000251) for all languages supported except ZhHant which is comparable to the previous Multi30k extensions ArEnMulti30k and Multi30k-Uk. COMETKiwi scores reveal mixed assessments of MultiScript30k as a translation of Multi30k-En in comparison to the related work. ArEnMulti30k scores nearly equal MultiScript30k-Ar, but Multi30k-Uk scores 6.4% greater than MultiScript30k-Uk per split.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 13 of its 22 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
13 of 22 references.
References · 13
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2016Multi30K: Multilingual English-German Image Descriptionscited by 250
- 2023Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Taskcited by 88
- 2017Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Descriptioncited by 76
- 2019Probing the Need for Visual Context in Multimodal Machine Translationcited by 54
- 2022LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translationcited by 21
- 2023CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translationcited by 14
- 2022Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translationcited by 7
1 more
- 2024Towards Zero-Shot Multimodal Machine Translationcited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Improving Indigenous Language Machine Translation with Synthetic Data and Language-Specific Preprocessingcited by 2
- 2026Retrieval-Augmented Long-Context Translation for Cultural Image Captioning: Gators submission for AmericasNLP 2026 shared taskcited by 1
- 2026InsightBoard: An Interactive Multi-Metric Visualization and Fairness Analysis Plugin for TensorBoardcited by 0
- 2026BM25-Augmented Many-Shot Translation for Low-Resource North-Eastern Indian Languagescited by 0
- 2026BM25-Augmented Many-Shot Translation for Low-Resource North-Eastern Indian Languages13 Aug 2026
- 2026Retrieval-Augmented Long-Context Translation for Cultural Image Captioning: Gators submission for AmericasNLP 2026 shared task20 May 2026
- 2026InsightBoard: An Interactive Multi-Metric Visualization and Fairness Analysis Plugin for TensorBoard2 Apr 2026
- 2026Improving Indigenous Language Machine Translation with Synthetic Data and Language-Specific Preprocessing6 Jan 2026